-- Logs begin at Sun 2022-09-11 10:07:47 UTC, end at Sun 2022-09-11 11:05:34 UTC. -- Sep 11 10:32:02.970361 dv-cinder-856460-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 11 10:32:02.979175 dv-cinder-856460-3-smb devstack@keystone.service[88064]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 11 10:32:02.981201 dv-cinder-856460-3-smb devstack@keystone.service[88064]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 11 10:32:02 2022] *** Sep 11 10:32:02.981201 dv-cinder-856460-3-smb devstack@keystone.service[88064]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 11 10:32:02.981201 dv-cinder-856460-3-smb devstack@keystone.service[88064]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 11 10:32:02.981201 dv-cinder-856460-3-smb devstack@keystone.service[88064]: nodename: dv-cinder-856460-3-smb Sep 11 10:32:02.981201 dv-cinder-856460-3-smb devstack@keystone.service[88064]: machine: x86_64 Sep 11 10:32:02.981201 dv-cinder-856460-3-smb devstack@keystone.service[88064]: clock source: unix Sep 11 10:32:02.981201 dv-cinder-856460-3-smb devstack@keystone.service[88064]: pcre jit disabled Sep 11 10:32:02.981201 dv-cinder-856460-3-smb devstack@keystone.service[88064]: detected number of CPU cores: 4 Sep 11 10:32:02.981201 dv-cinder-856460-3-smb devstack@keystone.service[88064]: current working directory: / Sep 11 10:32:02.981201 dv-cinder-856460-3-smb devstack@keystone.service[88064]: detected binary path: /usr/bin/uwsgi-core Sep 11 10:32:02.981201 dv-cinder-856460-3-smb devstack@keystone.service[88064]: your processes number limit is 47680 Sep 11 10:32:02.981774 dv-cinder-856460-3-smb devstack@keystone.service[88064]: your memory page size is 4096 bytes Sep 11 10:32:02.981774 dv-cinder-856460-3-smb devstack@keystone.service[88064]: detected max file descriptor number: 2048 Sep 11 10:32:02.981774 dv-cinder-856460-3-smb devstack@keystone.service[88064]: lock engine: pthread robust mutexes Sep 11 10:32:02.981774 dv-cinder-856460-3-smb devstack@keystone.service[88064]: thunder lock: enabled Sep 11 10:32:02.981774 dv-cinder-856460-3-smb devstack@keystone.service[88064]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 11 10:32:02.981774 dv-cinder-856460-3-smb devstack@keystone.service[88064]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 11 10:32:03.020171 dv-cinder-856460-3-smb devstack@keystone.service[88064]: Python main interpreter initialized at 0x55bf6eaaf9c0 Sep 11 10:32:03.020171 dv-cinder-856460-3-smb devstack@keystone.service[88064]: python threads support enabled Sep 11 10:32:03.020171 dv-cinder-856460-3-smb devstack@keystone.service[88064]: your server socket listen backlog is limited to 100 connections Sep 11 10:32:03.020171 dv-cinder-856460-3-smb devstack@keystone.service[88064]: your mercy for graceful operations on workers is 90 seconds Sep 11 10:32:03.020518 dv-cinder-856460-3-smb devstack@keystone.service[88064]: mapped 403077 bytes (393 KB) for 2 cores Sep 11 10:32:03.020631 dv-cinder-856460-3-smb devstack@keystone.service[88064]: *** Operational MODE: preforking *** Sep 11 10:32:03.020878 dv-cinder-856460-3-smb devstack@keystone.service[88064]: *** uWSGI is running in multiple interpreter mode *** Sep 11 10:32:03.020878 dv-cinder-856460-3-smb devstack@keystone.service[88064]: spawned uWSGI master process (pid: 88064) Sep 11 10:32:03.021067 dv-cinder-856460-3-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 11 10:32:03.023046 dv-cinder-856460-3-smb devstack@keystone.service[88064]: spawned uWSGI worker 1 (pid: 88076, cores: 1) Sep 11 10:32:03.023046 dv-cinder-856460-3-smb devstack@keystone.service[88064]: spawned uWSGI worker 2 (pid: 88077, cores: 1) Sep 11 10:32:03.023046 dv-cinder-856460-3-smb devstack@keystone.service[88064]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 11 10:32:07.325111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 10:32:07.325111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: from cryptography.utils import int_from_bytes Sep 11 10:32:07.325707 dv-cinder-856460-3-smb devstack@keystone.service[88076]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 10:32:07.325707 dv-cinder-856460-3-smb devstack@keystone.service[88076]: from cryptography.utils import int_from_bytes Sep 11 10:32:07.326114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 10:32:07.326114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: from cryptography.utils import int_from_bytes Sep 11 10:32:07.326223 dv-cinder-856460-3-smb devstack@keystone.service[88076]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 10:32:07.326223 dv-cinder-856460-3-smb devstack@keystone.service[88076]: from cryptography.utils import int_from_bytes Sep 11 10:32:07.376311 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 10:32:07.376501 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 10:32:07.376668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 10:32:07.376763 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 10:32:07.376845 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] command line args: [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 10:32:07.376924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] command line args: [] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 10:32:07.377001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 10:32:07.377081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 10:32:07.377158 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ================================================================================ {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 10:32:07.377235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ================================================================================ {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 10:32:07.377374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] admin_token = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.377488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] admin_token = **** {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.377655 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] config_dir = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.377741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] config_dir = [] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.377803 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.377868 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.378022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] config_source = [] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.378108 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] config_source = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.378178 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] debug = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.378243 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] debug = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.378389 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.378569 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.378665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.378840 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.378961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.379133 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.379508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.379780 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.379989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.380084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] list_limit = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.380182 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] log_config_append = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.380540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.380652 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.380920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.381179 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_config_append = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.381297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] log_dir = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.381508 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.381602 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] log_file = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.381681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_dir = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.381862 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_file = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.381997 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.382330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.382452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.382643 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.382748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.382923 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.383024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.383088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.383147 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.383205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.383262 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.383458 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.383546 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.383681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.383766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.383894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.383983 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.384119 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.384204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.384350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.384433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.384734 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.384828 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.384901 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.384960 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.385109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.385187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.385312 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.385389 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.385577 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.385837 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.386027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] publish_errors = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.386112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.386271 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] publish_errors = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.386355 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.386486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.386570 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.386641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.386704 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.386860 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.386944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.387087 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.387173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.387299 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.387383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] standard_threads = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.387524 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] standard_threads = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.387609 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.387747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.387826 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.387957 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.388039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.388105 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] use_journal = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.388164 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.388344 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] use_json = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.388429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] use_journal = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.388499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] use_stderr = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.388684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] use_json = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.388759 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] use_syslog = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.388818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] use_stderr = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.388818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] use_syslog = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.388939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.389108 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 10:32:07.389247 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.389376 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.389545 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.389686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.389814 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.389942 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.390069 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.390202 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.390330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.390465 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.390594 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.390736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.390864 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.390992 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.391125 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.391260 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.391393 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.391526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.391659 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.391786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.391913 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.392072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.392205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.392333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.392473 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.392637 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.392771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.392909 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.393043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.393173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.393300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.393427 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.393555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.393690 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.393819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.393951 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.394086 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.394223 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.394351 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.394538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.394674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.394802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.395039 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.395175 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.395312 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.395446 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.395573 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.395700 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.395832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.395961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.396097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.396238 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.396528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.396781 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.396911 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.397546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.397701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.397837 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.397967 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.398094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.398221 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.398348 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.398493 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.398622 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.399974 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.400066 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.400142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.400214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.400296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.400369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.400445 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.400517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.400626 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.400702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.400784 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.400862 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.400938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.401008 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.401078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.401149 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.401227 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.401300 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.401369 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.401440 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.401510 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.401579 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.401720 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.401795 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.401866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.401935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.402005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.402095 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.402177 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.402255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.402326 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.402408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.402480 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.402550 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.402628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.402699 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.402769 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.402838 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.402908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.402977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.403054 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.403125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.403125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.403237 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.403294 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.403350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.403422 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.403481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.403537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.403630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.403697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.403763 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.403822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.403878 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.403935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.404253 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.404367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.404484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.404590 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.404658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.404723 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.404801 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.404883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.404967 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.405041 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.405119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.405191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.405263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.405335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.405405 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.405478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.405551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.405625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.405696 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.405762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.405831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.405896 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.405974 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.406052 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.406119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.406188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.406253 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.406317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.406395 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.406541 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.406759 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.406992 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.407195 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.407400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.407632 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.407827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.408300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.408816 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.408897 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.408957 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.410156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.410307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.410447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.410578 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.410707 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.410835 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.410973 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.411103 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.411238 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.411374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.411503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.411638 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.411775 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.411918 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.412048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.412220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.412358 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.412487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.412671 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.412843 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.412975 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.413109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.413237 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.413370 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.413553 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.413690 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.413820 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.413958 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.414088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.414226 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.414364 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.414501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.414707 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.414841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.414970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.415100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.415228 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.415365 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.415495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.415623 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.415751 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.415890 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.416019 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.416160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.416290 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.416418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.416582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.416720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.416859 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.416998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.417133 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.417265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.417393 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.417522 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.417682 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.417835 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.external = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.417977 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] auth.external = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.418116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.418249 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.418379 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.418510 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.418642 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.418772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.418912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.password = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.419055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] auth.password = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.419185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.token = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.419315 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] auth.token = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.419444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.419583 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.419722 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.419853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.419982 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.420112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.420241 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.420371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.420507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.420710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.420843 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.420972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.421102 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.421230 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.421380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.421513 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] credential.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.421642 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.421771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.421900 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.422030 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.422168 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.422338 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.422475 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.422606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.422735 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.422864 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.423003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.423133 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.423273 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.423409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.423541 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.423541 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.423794 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.423794 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.424041 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.424170 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.424304 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.424304 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.424586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.424586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.424847 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.424847 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.425100 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.425230 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.425371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.425502 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.425640 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.425770 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.425915 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] federation.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.426044 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.426181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.426310 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.426439 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.426568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.426698 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.426839 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.426979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.427109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.427238 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.427367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.427495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.427631 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.427763 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.427891 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.428027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.428156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.428309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.428455 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.428645 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.428793 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.428925 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.429054 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.429183 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.429387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.429521 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.429650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.429780 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.429910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.430038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.430176 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.430306 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.430306 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.430560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.430690 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.430821 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.430959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.431089 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.431219 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.431348 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.431476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.431605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.431742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.431873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.432003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.432138 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.432267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.432445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.432613 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.432752 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.432882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.433013 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.433142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.433272 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.433409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.433541 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.433678 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.433810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.433940 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.434070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.434217 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.434348 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.434477 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.434606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.434745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.434875 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.435013 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.435144 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.435274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.435403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.435533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.435667 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.435806 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.435937 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.436076 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.436206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.436336 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.436464 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.436619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.436756 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.436885 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.437014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.437144 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.437280 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.437418 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.437549 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.437677 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.437817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.437947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.438083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.438215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.438344 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.438473 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.438602 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.438730 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.438866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.438996 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.439125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.439255 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.439384 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.439384 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.439653 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.439785 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.439914 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.440048 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.440177 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.440307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.440444 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.440602 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.440738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.440868 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.441005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.441141 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.441279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.441410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.441554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.441685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.441685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.441928 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.442065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.442201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.442331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.442501 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.442645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.442777 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.442918 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.443050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.443178 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.443317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.443448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.443577 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.443714 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.443846 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.444487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.444643 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.444783 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.444913 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.445050 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.445190 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.445321 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.445450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.445580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.445719 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.445856 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.445986 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.446116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.446244 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.446372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.446501 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.446638 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.446768 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.446905 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.447039 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.447169 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.447303 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.447440 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.447585 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.447715 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.447843 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.447972 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.448100 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.448237 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.448375 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.448511 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.448698 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.448835 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.448971 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.449118 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.449255 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.449255 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.449524 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.449660 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.449797 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.449941 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.450077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.450213 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.450349 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.450485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.450620 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.450768 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.450906 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.451048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.451184 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.451331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.451468 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.451468 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.451735 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.451735 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.451993 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.452129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.452264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.452264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.452598 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.452745 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.452883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.453020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.453157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.453315 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.453460 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.453598 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.453735 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] resource.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.453872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.454008 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.454160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.454298 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.454435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.454571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.454707 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.454842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.454988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.455142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.455283 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.455421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.455557 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.455692 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.455903 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] role.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.456044 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.456187 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] role.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.456324 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.456459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.456664 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] role.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.456810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.456946 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] role.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.457083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.457231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.457368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.457513 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.457650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.457787 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.457924 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.458060 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.458196 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.458339 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.458477 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.458613 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.458749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.458884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.459030 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.459176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.459314 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.459449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.459639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.459784 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.459927 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.460074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.460213 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.460350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.460350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.460631 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.460772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.460930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.460930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.461192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.461329 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.461465 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.461601 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.461746 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.461893 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.462029 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.462166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.462303 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.462447 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.462584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.462768 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.462916 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.463054 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.463190 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.463335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.463473 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.463610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.463746 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.463882 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.464018 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.464163 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.464301 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.464438 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.464607 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.464762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.464900 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.465047 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.465192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.465333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.465471 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.465608 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.465745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.465889 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.466027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.466163 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.466299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.466435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.466572 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] token.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.466727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.466866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.467002 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.467139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.467275 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.467410 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.467555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.467693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.467830 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.467967 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.468102 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.468239 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.468383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.468531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.468706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.468844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.468981 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.469118 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.469266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.469403 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.469540 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.469676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.469812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.469948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.470093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.470240 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.470386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.470534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.470673 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.470810 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.470956 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.connection = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.471101 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.471240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.471390 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.471528 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.471664 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.connection = **** {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.471802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.471938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.472075 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.472219 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.472631 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.472823 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.472966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.473102 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.473238 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.473392 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.473531 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.473667 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.473804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.473942 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.474078 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.474224 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.474362 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.474498 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.474635 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.474782 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.474920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.474920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.475697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.475697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.475965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.475965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.476223 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.476369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.476589 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.476738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.476876 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.477014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 10:32:07.477163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.477163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.477163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 10:32:07.477163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 10:32:07.493430 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.493675 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.493848 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.494001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.494150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.494294 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.502249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.503125 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.530831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.531061 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.531461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.531699 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.585603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.585758 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.635799 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.635973 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.636066 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.636145 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.799044 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.799236 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.799324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.799401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.799496 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.799574 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.799705 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.799824 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.799924 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.800052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.800186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.800538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.824320 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.824513 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.824642 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.824790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.824872 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.825021 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.825247 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.825323 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.825471 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.825574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.825755 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.825842 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.826007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.826165 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.837100 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.837401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.850053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.850334 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.850469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.850577 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.850658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.850837 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.850948 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.851024 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.851108 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.851184 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.851257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.851401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.851495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.851660 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 10:32:07.868630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.868846 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 10:32:07.869194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.869303 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.869383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 10:32:07.869476 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 10:32:07.869666 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.869762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.869932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.870026 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 10:32:07.870198 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.870293 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.870465 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.870571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.870738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.871006 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.880005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.880442 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.880791 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.881025 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.881129 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.881345 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.882191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.882303 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.889234 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:07.889489 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:07.892152 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:07.892376 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:07.892461 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.892691 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.892805 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.893025 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.893215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.893310 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.893506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.893589 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.893801 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.893939 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.894064 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.894172 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.894373 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.894568 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.894658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.894853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.894935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.895134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.895424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.895703 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.917599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.918488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.919085 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:07.919378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.919978 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:07.920280 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.924058 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:07.924346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.924663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.925039 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:07.925330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.925625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.931886 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:07.932185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.932607 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:07.932903 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.938021 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:07.938321 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.938615 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.938706 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:07.938910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.939014 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.939197 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.939283 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.939480 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.939565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.939763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.939849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.940091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.940221 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.940354 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.940813 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.956159 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.956453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.956715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.957001 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.960372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:07.960850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:07.963778 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.964025 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.964116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.964326 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.968316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:07.968499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:07.971634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:07.971743 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:07.975194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.975313 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.975504 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.975596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.975801 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.975890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.976101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.976188 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.976381 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.976466 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.976700 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.976823 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.992944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:07.993054 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:07.993245 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.993341 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.993523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.993638 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.993793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:07.993888 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.000632 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.000742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.002174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.002323 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.003706 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.003810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.003985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.004073 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.006716 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:08.006823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:08.007006 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.007101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.007300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.007423 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.007593 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.007703 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.007996 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.008087 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.019111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:08.019226 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:08.019402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.019510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.019693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.019800 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.019980 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.020069 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.020379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.020474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.020696 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.020792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.020984 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.021072 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.036850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:08.037125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:08.039864 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:08.040101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:08.042780 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.043079 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.044234 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.044629 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.045735 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:08.046023 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.046112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:08.046386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.046487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.046796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.052825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.053217 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.054862 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:08.055239 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:08.057766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.058154 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.058248 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.058443 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.058565 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.058732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.058863 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.059152 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.066519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:08.066817 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.066989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:08.067109 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.067532 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.067825 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.074043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:08.074334 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.074617 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.074840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 10:32:08.074932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.075134 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.075225 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.075418 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.075518 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.075695 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.075782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.075969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.076064 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.076246 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.076345 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.076525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.076679 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.076839 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.076936 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.077119 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.077215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.077406 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.077504 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.077692 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.077779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.077974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.078244 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.078507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 10:32:08.112569 dv-cinder-856460-3-smb devstack@keystone.service[88076]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bf6eaaf9c0 pid: 88076 (default app) Sep 11 10:32:08.113328 dv-cinder-856460-3-smb devstack@keystone.service[88077]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bf6eaaf9c0 pid: 88077 (default app) Sep 11 10:32:08.116483 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b2e63-fd1f-4d5e-9f6f-2d93709554c5 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:08.116807 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b2e63-fd1f-4d5e-9f6f-2d93709554c5 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:08.117092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b2e63-fd1f-4d5e-9f6f-2d93709554c5 None None] PATH_INFO: `/v3` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:08.121263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Sun Sep 11 10:32:08 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:14.992580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743916f-1eb6-452c-8f51-44571323fc38 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:14.993052 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743916f-1eb6-452c-8f51-44571323fc38 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:14.993052 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743916f-1eb6-452c-8f51-44571323fc38 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:14.997288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:32:15.002498 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9a27b-bf68-4f6b-8f30-b2bb82d4ea6b None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:15.002886 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9a27b-bf68-4f6b-8f30-b2bb82d4ea6b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:15.003049 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9a27b-bf68-4f6b-8f30-b2bb82d4ea6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:15.073443 dv-cinder-856460-3-smb devstack@keystone.service[88076]: INFO dbcounter [None req-92f9a27b-bf68-4f6b-8f30-b2bb82d4ea6b None None] Registered counter for database keystone Sep 11 10:32:15.092037 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG oslo_db.sqlalchemy.engines [None req-92f9a27b-bf68-4f6b-8f30-b2bb82d4ea6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 10:32:15.098400 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writer thread running {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 10:32:15.284784 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG passlib.handlers.bcrypt [None req-92f9a27b-bf68-4f6b-8f30-b2bb82d4ea6b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88076) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 11 10:32:15.285093 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG passlib.handlers.bcrypt [None req-92f9a27b-bf68-4f6b-8f30-b2bb82d4ea6b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88076) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 11 10:32:15.343655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-92f9a27b-bf68-4f6b-8f30-b2bb82d4ea6b None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:15.345281 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-92f9a27b-bf68-4f6b-8f30-b2bb82d4ea6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:15.471984 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 11 10:32:15.917044 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743916f-1eb6-452c-8f51-44571323fc38 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:15.986426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: INFO dbcounter [None req-4743916f-1eb6-452c-8f51-44571323fc38 None None] Registered counter for database keystone Sep 11 10:32:16.007855 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG oslo_db.sqlalchemy.engines [None req-4743916f-1eb6-452c-8f51-44571323fc38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 10:32:16.014006 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writer thread running {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 10:32:16.130081 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743916f-1eb6-452c-8f51-44571323fc38 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:16.134283 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab78b59-6765-47ac-98c9-91d01cf47e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:16.134907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab78b59-6765-47ac-98c9-91d01cf47e74 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:16.135186 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab78b59-6765-47ac-98c9-91d01cf47e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:16.135455 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab78b59-6765-47ac-98c9-91d01cf47e74 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:16.143389 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab78b59-6765-47ac-98c9-91d01cf47e74 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:16.199282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5ab78b59-6765-47ac-98c9-91d01cf47e74 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 11 10:32:16.199626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab78b59-6765-47ac-98c9-91d01cf47e74 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:16.210539 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Sun Sep 11 10:32:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 10:32:16.216617 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9a27b-bf68-4f6b-8f30-b2bb82d4ea6b None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:16.234163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9a27b-bf68-4f6b-8f30-b2bb82d4ea6b None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:16.238568 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5432beb-9079-4200-94dc-a7eb23ef409c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:16.239634 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5432beb-9079-4200-94dc-a7eb23ef409c admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:16.239913 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5432beb-9079-4200-94dc-a7eb23ef409c admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:16.240181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5432beb-9079-4200-94dc-a7eb23ef409c admin admin] PATH_INFO: `/v3/projects/7c1c2ee49dc945b2a0f435c605ac4ed3` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:16.241819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5432beb-9079-4200-94dc-a7eb23ef409c admin admin] RBAC: Authorizing `identity:get_project(project_id=7c1c2ee49dc945b2a0f435c605ac4ed3)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:16.294956 dv-cinder-856460-3-smb devstack@keystone.service[88076]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b5432beb-9079-4200-94dc-a7eb23ef409c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 11 10:32:16.295295 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5432beb-9079-4200-94dc-a7eb23ef409c admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:16.299743 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Sun Sep 11 10:32:16 2022] GET /identity/v3/projects/7c1c2ee49dc945b2a0f435c605ac4ed3 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:18.385326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9cb5d-50e7-4f32-afc5-c0d1d23be1d6 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:18.385926 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9cb5d-50e7-4f32-afc5-c0d1d23be1d6 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:18.385926 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9cb5d-50e7-4f32-afc5-c0d1d23be1d6 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:18.389910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:18.395324 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d0570-789b-4d5f-a7b4-0524896f8946 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:18.395755 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d0570-789b-4d5f-a7b4-0524896f8946 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:18.395876 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d0570-789b-4d5f-a7b4-0524896f8946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:18.415693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-a37d0570-789b-4d5f-a7b4-0524896f8946 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:18.417272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a37d0570-789b-4d5f-a7b4-0524896f8946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:18.424995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 11 10:32:18.687899 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9cb5d-50e7-4f32-afc5-c0d1d23be1d6 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:18.699703 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9cb5d-50e7-4f32-afc5-c0d1d23be1d6 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:18.703786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62f2ef-a4a9-4708-a0f6-93b8f33608d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:18.704378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62f2ef-a4a9-4708-a0f6-93b8f33608d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:18.704694 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62f2ef-a4a9-4708-a0f6-93b8f33608d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:18.704966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62f2ef-a4a9-4708-a0f6-93b8f33608d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:18.712624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62f2ef-a4a9-4708-a0f6-93b8f33608d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:18.714367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62f2ef-a4a9-4708-a0f6-93b8f33608d6 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:18.723149 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Sun Sep 11 10:32:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 10:32:18.729223 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d0570-789b-4d5f-a7b4-0524896f8946 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:18.738262 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d0570-789b-4d5f-a7b4-0524896f8946 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:18.743259 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdce8f2-4658-4683-82db-bb55719ae3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:18.743885 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdce8f2-4658-4683-82db-bb55719ae3dd admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:18.744167 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdce8f2-4658-4683-82db-bb55719ae3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:18.744443 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdce8f2-4658-4683-82db-bb55719ae3dd admin admin] PATH_INFO: `/v3/users/f5c1185c0be14e5a840b375a991df2d8` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:18.745788 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdce8f2-4658-4683-82db-bb55719ae3dd admin admin] RBAC: Authorizing `identity:get_user(user_id=f5c1185c0be14e5a840b375a991df2d8)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:18.747592 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdce8f2-4658-4683-82db-bb55719ae3dd admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:18.749139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Sun Sep 11 10:32:18 2022] GET /identity/v3/users/f5c1185c0be14e5a840b375a991df2d8 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:20.934954 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66026d82-0cfa-4fc2-bc61-fe6533f41b5e None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:20.935483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66026d82-0cfa-4fc2-bc61-fe6533f41b5e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:20.935483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66026d82-0cfa-4fc2-bc61-fe6533f41b5e None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:20.936863 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:20.941987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514854d-91c9-4ec7-9e86-e50ea9fd7db9 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:20.942413 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514854d-91c9-4ec7-9e86-e50ea9fd7db9 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:20.942669 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514854d-91c9-4ec7-9e86-e50ea9fd7db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:20.961969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e514854d-91c9-4ec7-9e86-e50ea9fd7db9 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:20.963196 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e514854d-91c9-4ec7-9e86-e50ea9fd7db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:20.978526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef539d6e-a174-4514-8135-d8fc38b554ab None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:20.978807 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef539d6e-a174-4514-8135-d8fc38b554ab None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:20.979079 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef539d6e-a174-4514-8135-d8fc38b554ab None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:20.980401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:32:20.985530 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced09d6-deb5-4fbc-9e4b-c42a592e03f5 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:20.985812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced09d6-deb5-4fbc-9e4b-c42a592e03f5 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:20.986086 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced09d6-deb5-4fbc-9e4b-c42a592e03f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:21.027168 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG passlib.handlers.bcrypt [None req-2ced09d6-deb5-4fbc-9e4b-c42a592e03f5 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88077) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 11 10:32:21.027641 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG passlib.handlers.bcrypt [None req-2ced09d6-deb5-4fbc-9e4b-c42a592e03f5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88077) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 11 10:32:21.044540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:21.077092 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2ced09d6-deb5-4fbc-9e4b-c42a592e03f5 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:21.078670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2ced09d6-deb5-4fbc-9e4b-c42a592e03f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:21.175654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:32:21.311680 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514854d-91c9-4ec7-9e86-e50ea9fd7db9 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:21.336817 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:21.418089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514854d-91c9-4ec7-9e86-e50ea9fd7db9 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:21.444636 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced09d6-deb5-4fbc-9e4b-c42a592e03f5 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:21.450647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554060bf-4854-4748-aa14-91842332f34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:21.451290 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554060bf-4854-4748-aa14-91842332f34d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:21.451571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554060bf-4854-4748-aa14-91842332f34d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:21.451846 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554060bf-4854-4748-aa14-91842332f34d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:21.463527 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554060bf-4854-4748-aa14-91842332f34d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:21.472588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-554060bf-4854-4748-aa14-91842332f34d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:32:21.472588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:21.472588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:21.472588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:21.472588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:21.472588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:21.472588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:21.472588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:21.472588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:21.472588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:21.472588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:21.472588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:21.472588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:21.472588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:21.472588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:21.472588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:21.473638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:21.473638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:21.473638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:21.473638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:21.473638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:21.473638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:21.473638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:21.473638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:21.473638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:21.473638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:21.473638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:21.473638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:21.473638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:21.473638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:21.473638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:21.473638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:21.474450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:21.474450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:21.474450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:21.474450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:21.474450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:21.474450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:21.474450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:21.474450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:21.474450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:21.474450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:21.474450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:32:21.474450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:32:21.474450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:32:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:32:21.479989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554060bf-4854-4748-aa14-91842332f34d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:21.544173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced09d6-deb5-4fbc-9e4b-c42a592e03f5 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:21.547367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:21.562436 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:21.581841 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554060bf-4854-4748-aa14-91842332f34d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:21.587794 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af261d-7425-4e6e-80a1-224a520ef3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:21.588776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af261d-7425-4e6e-80a1-224a520ef3ee None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:21.589064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af261d-7425-4e6e-80a1-224a520ef3ee None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:21.589338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af261d-7425-4e6e-80a1-224a520ef3ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:21.616201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5111d8-51b2-4454-a176-5e77f075c032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:21.616944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5111d8-51b2-4454-a176-5e77f075c032 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:21.617220 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5111d8-51b2-4454-a176-5e77f075c032 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:21.617486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5111d8-51b2-4454-a176-5e77f075c032 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:21.618150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5111d8-51b2-4454-a176-5e77f075c032 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:21.618449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5111d8-51b2-4454-a176-5e77f075c032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:21.619831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5111d8-51b2-4454-a176-5e77f075c032 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:21.632003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:32:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:32:21.637845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5111d8-51b2-4454-a176-5e77f075c032 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:21.658372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af261d-7425-4e6e-80a1-224a520ef3ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:21.660319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af261d-7425-4e6e-80a1-224a520ef3ee None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:21.737420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5111d8-51b2-4454-a176-5e77f075c032 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:21.758772 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:32:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 10:32:21.764281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af261d-7425-4e6e-80a1-224a520ef3ee None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:21.766872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:21.772467 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54797e36-664d-4833-815b-203a60de5906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:21.773146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54797e36-664d-4833-815b-203a60de5906 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:21.773432 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54797e36-664d-4833-815b-203a60de5906 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:21.773708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54797e36-664d-4833-815b-203a60de5906 None admin] PATH_INFO: `/v3/users/f5c1185c0be14e5a840b375a991df2d8` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:21.774861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54797e36-664d-4833-815b-203a60de5906 None admin] RBAC: Authorizing `identity:get_user(user_id=f5c1185c0be14e5a840b375a991df2d8)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:21.776320 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54797e36-664d-4833-815b-203a60de5906 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:21.777926 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:21 2022] GET /identity/v3/users/f5c1185c0be14e5a840b375a991df2d8 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:32:21.783289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54797e36-664d-4833-815b-203a60de5906 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:21.800085 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:21.862475 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af261d-7425-4e6e-80a1-224a520ef3ee None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:21.884443 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54797e36-664d-4833-815b-203a60de5906 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:21.897613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e14f51-7250-4009-a208-9df3101f4e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:21.898459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e14f51-7250-4009-a208-9df3101f4e55 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:21.898735 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e14f51-7250-4009-a208-9df3101f4e55 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:21.898999 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e14f51-7250-4009-a208-9df3101f4e55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:21.917950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e14f51-7250-4009-a208-9df3101f4e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:21.919432 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e14f51-7250-4009-a208-9df3101f4e55 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:21.919546 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bc242-ace1-4c33-b9d3-fe6117b4431d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:21.920499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bc242-ace1-4c33-b9d3-fe6117b4431d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:21.920813 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bc242-ace1-4c33-b9d3-fe6117b4431d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:21.921097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bc242-ace1-4c33-b9d3-fe6117b4431d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:21.922244 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bc242-ace1-4c33-b9d3-fe6117b4431d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:21.923685 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bc242-ace1-4c33-b9d3-fe6117b4431d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:21.925294 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 10/18] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:32:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:32:21.931206 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bc242-ace1-4c33-b9d3-fe6117b4431d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:21.939499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-90e14f51-7250-4009-a208-9df3101f4e55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:32:21.939499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:21.939499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:21.939499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:21.939499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:21.939499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:21.939499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:21.939499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:21.939499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:21.939499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:21.939499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:21.939499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:21.939499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:32:21.939499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:32:21.939499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:32:21.939499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:32:21.940977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:21.940977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:21.940977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:21.940977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:21.940977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:21.940977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:21.940977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:21.940977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:21.940977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:21.940977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:21.940977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:21.940977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:21.940977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:21.940977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:21.940977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:21.940977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:21.940977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:32:21.941963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:32:21.941963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:32:21.941963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:32:21.941963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 9/19] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:32:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:32:21.946870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e14f51-7250-4009-a208-9df3101f4e55 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:22.002747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:22.014959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:22.033722 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bc242-ace1-4c33-b9d3-fe6117b4431d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:22.048304 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e14f51-7250-4009-a208-9df3101f4e55 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:22.066742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c605d7b-2ef5-4b35-b7e0-4726a311037a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:22.067353 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c605d7b-2ef5-4b35-b7e0-4726a311037a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:22.067644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c605d7b-2ef5-4b35-b7e0-4726a311037a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:22.067923 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c605d7b-2ef5-4b35-b7e0-4726a311037a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:22.068756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c605d7b-2ef5-4b35-b7e0-4726a311037a None admin] RBAC: Adding query filter params (role.id=529cb3511f3a498b9b7169ed5b0f6b8e, scope.domain.id=default, user.id=f5c1185c0be14e5a840b375a991df2d8) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:22.069068 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c605d7b-2ef5-4b35-b7e0-4726a311037a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:22.070504 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c605d7b-2ef5-4b35-b7e0-4726a311037a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:22.077144 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1322 bytes} [Sun Sep 11 10:32:21 2022] GET /identity/v3/role_assignments?user.id=f5c1185c0be14e5a840b375a991df2d8&scope.domain.id=default&role.id=529cb3511f3a498b9b7169ed5b0f6b8e => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:32:22.080934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55797086-a141-4b09-a919-bf84c648a638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:22.081557 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55797086-a141-4b09-a919-bf84c648a638 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:22.081839 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55797086-a141-4b09-a919-bf84c648a638 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:22.082112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55797086-a141-4b09-a919-bf84c648a638 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:22.082777 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55797086-a141-4b09-a919-bf84c648a638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:22.083086 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55797086-a141-4b09-a919-bf84c648a638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:22.085088 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55797086-a141-4b09-a919-bf84c648a638 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:22.105441 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:32:24.470677 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c5d95-2421-4d1a-84ea-5d31a6d212d7 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:24.471211 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c5d95-2421-4d1a-84ea-5d31a6d212d7 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:24.471287 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c5d95-2421-4d1a-84ea-5d31a6d212d7 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:24.473175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:24.482267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea81452-2384-4912-862c-e3711c44d772 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:24.483166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea81452-2384-4912-862c-e3711c44d772 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:24.483659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea81452-2384-4912-862c-e3711c44d772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:24.514470 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-8ea81452-2384-4912-862c-e3711c44d772 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:24.516163 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8ea81452-2384-4912-862c-e3711c44d772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:24.604130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:24.738353 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0a3a2-9792-4bfb-97bf-257ee1a0ac3b None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:24.738612 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0a3a2-9792-4bfb-97bf-257ee1a0ac3b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:24.738843 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0a3a2-9792-4bfb-97bf-257ee1a0ac3b None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:24.740790 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:24.746260 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd58bcd-80bb-4c87-b617-db42fa08425b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:24.746614 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd58bcd-80bb-4c87-b617-db42fa08425b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:24.746897 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd58bcd-80bb-4c87-b617-db42fa08425b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:24.765688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ffd58bcd-80bb-4c87-b617-db42fa08425b None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:24.766992 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ffd58bcd-80bb-4c87-b617-db42fa08425b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:24.813147 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:24.851057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 12/25] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:24.994567 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b466e-b625-4d7f-a267-4930eb16f7f9 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:24.994889 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b466e-b625-4d7f-a267-4930eb16f7f9 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:24.995091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b466e-b625-4d7f-a267-4930eb16f7f9 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:24.996391 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 14/26] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:25.001884 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f301c6-1f0f-4401-9f5d-d50188b6b5a1 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:25.002177 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f301c6-1f0f-4401-9f5d-d50188b6b5a1 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:25.002457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f301c6-1f0f-4401-9f5d-d50188b6b5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:25.009396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b466e-b625-4d7f-a267-4930eb16f7f9 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:25.058600 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d6f301c6-1f0f-4401-9f5d-d50188b6b5a1 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:25.059827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d6f301c6-1f0f-4401-9f5d-d50188b6b5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:25.198616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 13/27] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:25.234217 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b466e-b625-4d7f-a267-4930eb16f7f9 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:25.290250 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07896700-8fcf-4fc2-a1fc-8b154d3b1971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:25.291228 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07896700-8fcf-4fc2-a1fc-8b154d3b1971 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:25.291707 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07896700-8fcf-4fc2-a1fc-8b154d3b1971 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:25.292181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07896700-8fcf-4fc2-a1fc-8b154d3b1971 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:25.295597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f301c6-1f0f-4401-9f5d-d50188b6b5a1 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:25.309925 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07896700-8fcf-4fc2-a1fc-8b154d3b1971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:25.315804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-07896700-8fcf-4fc2-a1fc-8b154d3b1971 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:32:25.315804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:25.315804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:25.315804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:25.315804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:25.315804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:25.315804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:25.315804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:25.315804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:25.315804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:25.315804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:25.315804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:25.315804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:25.315804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:25.315804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:25.315804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:25.316665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:25.316665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:25.316665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:25.316665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:25.316665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:25.316665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:25.316665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:25.316665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:25.316665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:25.316665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:25.316665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:25.316665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:25.316665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:25.316665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:25.316665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:25.316665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:25.317409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:25.317409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:25.317409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:25.317409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:25.317409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:25.317409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:25.317409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:25.317409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:25.317409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:25.317409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:25.317409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:32:25.317409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:32:25.319667 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 15/28] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:32:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:32:25.327630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07896700-8fcf-4fc2-a1fc-8b154d3b1971 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:25.332165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:25.501522 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07896700-8fcf-4fc2-a1fc-8b154d3b1971 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:25.570772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb1ef1-60d4-47e6-9849-dd3bbf2f4d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:25.572305 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb1ef1-60d4-47e6-9849-dd3bbf2f4d24 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:25.573096 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb1ef1-60d4-47e6-9849-dd3bbf2f4d24 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:25.573874 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb1ef1-60d4-47e6-9849-dd3bbf2f4d24 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:25.575170 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb1ef1-60d4-47e6-9849-dd3bbf2f4d24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:25.575690 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb1ef1-60d4-47e6-9849-dd3bbf2f4d24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:25.577314 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb1ef1-60d4-47e6-9849-dd3bbf2f4d24 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:25.594798 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f301c6-1f0f-4401-9f5d-d50188b6b5a1 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:25.597906 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 16/29] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:32:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:25.603887 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb1ef1-60d4-47e6-9849-dd3bbf2f4d24 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:25.608211 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:25.670108 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799eabb-c282-4a94-9295-b11ec4b1848d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:25.670733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799eabb-c282-4a94-9295-b11ec4b1848d None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:25.671017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799eabb-c282-4a94-9295-b11ec4b1848d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:25.671300 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799eabb-c282-4a94-9295-b11ec4b1848d None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:25.671981 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799eabb-c282-4a94-9295-b11ec4b1848d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:25.673533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799eabb-c282-4a94-9295-b11ec4b1848d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:25.702008 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:25.752435 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb1ef1-60d4-47e6-9849-dd3bbf2f4d24 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:25.789855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6151137-6f08-41e9-b780-a1b652d4d36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:25.790870 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6151137-6f08-41e9-b780-a1b652d4d36d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:25.791294 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6151137-6f08-41e9-b780-a1b652d4d36d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:25.791712 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6151137-6f08-41e9-b780-a1b652d4d36d None admin] PATH_INFO: `/v3/users/f5c1185c0be14e5a840b375a991df2d8` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:25.793146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6151137-6f08-41e9-b780-a1b652d4d36d None admin] RBAC: Authorizing `identity:get_user(user_id=f5c1185c0be14e5a840b375a991df2d8)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:25.794746 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6151137-6f08-41e9-b780-a1b652d4d36d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:25.796488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 17/30] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:25 2022] GET /identity/v3/users/f5c1185c0be14e5a840b375a991df2d8 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:25.797529 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6151137-6f08-41e9-b780-a1b652d4d36d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:25.819648 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 14/31] 10.222.0.20 () {60 vars in 1131 bytes} [Sun Sep 11 10:32:25 2022] POST /identity/v3/roles => generated 219 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:32:25.821297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250842d8-1f0d-472c-9ac7-251e5d6f7822 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:25.821626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250842d8-1f0d-472c-9ac7-251e5d6f7822 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:25.822003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250842d8-1f0d-472c-9ac7-251e5d6f7822 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:25.823624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 15/32] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:25.828778 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250842d8-1f0d-472c-9ac7-251e5d6f7822 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:25.980140 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6151137-6f08-41e9-b780-a1b652d4d36d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:26.029490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250842d8-1f0d-472c-9ac7-251e5d6f7822 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:26.056981 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26492c49-159f-4847-bbbf-63a39b321428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:26.057990 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26492c49-159f-4847-bbbf-63a39b321428 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:26.058472 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26492c49-159f-4847-bbbf-63a39b321428 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:26.058947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26492c49-159f-4847-bbbf-63a39b321428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:26.061164 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:26.070332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca72941-9b62-4842-abf3-5516930fe608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:26.070629 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca72941-9b62-4842-abf3-5516930fe608 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:26.070914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca72941-9b62-4842-abf3-5516930fe608 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:26.071190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca72941-9b62-4842-abf3-5516930fe608 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:26.073097 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca72941-9b62-4842-abf3-5516930fe608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:26.074292 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca72941-9b62-4842-abf3-5516930fe608 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:26.075403 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26492c49-159f-4847-bbbf-63a39b321428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:26.077162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26492c49-159f-4847-bbbf-63a39b321428 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:26.077342 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 16/33] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:32:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:26.078480 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288ed91-9ed4-4341-9452-bf75b8ab9ec0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:26.078762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288ed91-9ed4-4341-9452-bf75b8ab9ec0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:26.079035 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288ed91-9ed4-4341-9452-bf75b8ab9ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:26.103027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f288ed91-9ed4-4341-9452-bf75b8ab9ec0 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:26.103756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-26492c49-159f-4847-bbbf-63a39b321428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:32:26.103756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:26.103756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:26.103756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:26.103756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:26.103756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:26.103756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:26.103756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:26.103756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:26.103756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:26.103756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:26.103756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:26.103756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:32:26.103756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:32:26.103756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:32:26.103756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:32:26.104624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:26.104624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:26.104624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:26.104624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:26.104624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:26.104624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:26.104624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:26.104624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:26.104624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:26.104624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:26.104624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:26.104624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:26.104624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:26.104624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:26.104624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:26.104624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:26.104624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:32:26.105409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:32:26.105409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:32:26.105409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:32:26.105571 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f288ed91-9ed4-4341-9452-bf75b8ab9ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:26.111413 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 18/34] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:32:26.112600 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26492c49-159f-4847-bbbf-63a39b321428 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:26.136592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:26.187951 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 17/35] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:26.189767 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288ed91-9ed4-4341-9452-bf75b8ab9ec0 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:26.276148 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26492c49-159f-4847-bbbf-63a39b321428 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:26.338394 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288ed91-9ed4-4341-9452-bf75b8ab9ec0 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:26.339843 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc607d9b-81da-40a7-8185-b2dd72e11a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:26.341666 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc607d9b-81da-40a7-8185-b2dd72e11a7f None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:26.342164 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc607d9b-81da-40a7-8185-b2dd72e11a7f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:26.342638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc607d9b-81da-40a7-8185-b2dd72e11a7f None admin] PATH_INFO: `/v3/domains/default/users/f5c1185c0be14e5a840b375a991df2d8/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:26.344866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc607d9b-81da-40a7-8185-b2dd72e11a7f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f5c1185c0be14e5a840b375a991df2d8, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:26.347080 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc607d9b-81da-40a7-8185-b2dd72e11a7f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:26.376643 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adde0c4-931e-4b15-b922-6f72fda90801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:26.377312 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adde0c4-931e-4b15-b922-6f72fda90801 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:26.377655 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adde0c4-931e-4b15-b922-6f72fda90801 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:26.377983 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adde0c4-931e-4b15-b922-6f72fda90801 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:26.378747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adde0c4-931e-4b15-b922-6f72fda90801 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:26.379061 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adde0c4-931e-4b15-b922-6f72fda90801 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:26.380749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adde0c4-931e-4b15-b922-6f72fda90801 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:26.392580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 18/36] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:26.393869 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba35d1-dcfe-4ce5-8821-40967d68e2f0 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:26.394172 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba35d1-dcfe-4ce5-8821-40967d68e2f0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:26.394445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba35d1-dcfe-4ce5-8821-40967d68e2f0 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:26.395645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 19/37] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:26.400897 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ab181-2a30-4cc3-9adb-b7010cd6439b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:26.401182 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ab181-2a30-4cc3-9adb-b7010cd6439b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:26.401459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ab181-2a30-4cc3-9adb-b7010cd6439b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:26.402681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 20/38] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:26.403427 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ab181-2a30-4cc3-9adb-b7010cd6439b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:26.430314 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:26.476906 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 19/39] 10.222.0.20 () {58 vars in 1361 bytes} [Sun Sep 11 10:32:26 2022] PUT /identity/v3/domains/default/users/f5c1185c0be14e5a840b375a991df2d8/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:32:26.478624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f00766-f31b-4944-992c-bac3f9b411bd None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:26.478924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f00766-f31b-4944-992c-bac3f9b411bd None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:26.479210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f00766-f31b-4944-992c-bac3f9b411bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:26.506308 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-57f00766-f31b-4944-992c-bac3f9b411bd None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:26.507906 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-57f00766-f31b-4944-992c-bac3f9b411bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:26.522000 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ab181-2a30-4cc3-9adb-b7010cd6439b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:26.558437 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:26.563021 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c966795-a5eb-4e88-b217-b187a482ea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:26.563656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c966795-a5eb-4e88-b217-b187a482ea12 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:26.563928 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c966795-a5eb-4e88-b217-b187a482ea12 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:26.564204 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c966795-a5eb-4e88-b217-b187a482ea12 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:26.564908 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c966795-a5eb-4e88-b217-b187a482ea12 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:26.566399 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c966795-a5eb-4e88-b217-b187a482ea12 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:26.590050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 20/40] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:26.591678 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85c69f-8202-4a06-b66d-eacbb8fd3648 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:26.591973 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85c69f-8202-4a06-b66d-eacbb8fd3648 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:26.592256 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85c69f-8202-4a06-b66d-eacbb8fd3648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:26.621081 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 21/41] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 10:32:26 2022] POST /identity/v3/projects => generated 301 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:32:26.622699 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c966795-a5eb-4e88-b217-b187a482ea12 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:26.624076 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-fc85c69f-8202-4a06-b66d-eacbb8fd3648 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:26.625539 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fc85c69f-8202-4a06-b66d-eacbb8fd3648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:26.725401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 21/42] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:26.776455 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:26.818889 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c966795-a5eb-4e88-b217-b187a482ea12 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:26.861774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b83513-ee53-4cbf-9f13-4abb046631cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:26.862308 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b83513-ee53-4cbf-9f13-4abb046631cc None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:26.862589 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b83513-ee53-4cbf-9f13-4abb046631cc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:26.862863 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b83513-ee53-4cbf-9f13-4abb046631cc None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:26.863537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b83513-ee53-4cbf-9f13-4abb046631cc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:26.865416 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b83513-ee53-4cbf-9f13-4abb046631cc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:26.884299 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 22/43] 10.222.0.20 () {60 vars in 1131 bytes} [Sun Sep 11 10:32:26 2022] POST /identity/v3/roles => generated 225 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:32:26.900344 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85c69f-8202-4a06-b66d-eacbb8fd3648 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:27.044248 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85c69f-8202-4a06-b66d-eacbb8fd3648 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:27.123891 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b83513-ee53-4cbf-9f13-4abb046631cc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:27.164496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:27.192158 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3067cde-46f6-4d2f-85a4-2a6051b19710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:27.192875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3067cde-46f6-4d2f-85a4-2a6051b19710 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:27.193702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3067cde-46f6-4d2f-85a4-2a6051b19710 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:27.193966 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3067cde-46f6-4d2f-85a4-2a6051b19710 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:27.195364 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3067cde-46f6-4d2f-85a4-2a6051b19710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:27.197031 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3067cde-46f6-4d2f-85a4-2a6051b19710 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:27.201232 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 22/44] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:32:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:27.206611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3067cde-46f6-4d2f-85a4-2a6051b19710 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:27.257793 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b83513-ee53-4cbf-9f13-4abb046631cc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:27.297958 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59902cb-fcdc-476d-b287-8ee6d2f3af2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:27.298578 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59902cb-fcdc-476d-b287-8ee6d2f3af2b None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:27.298863 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59902cb-fcdc-476d-b287-8ee6d2f3af2b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:27.299140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59902cb-fcdc-476d-b287-8ee6d2f3af2b None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:27.299825 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59902cb-fcdc-476d-b287-8ee6d2f3af2b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:27.301241 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59902cb-fcdc-476d-b287-8ee6d2f3af2b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:27.305586 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:27.315426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3067cde-46f6-4d2f-85a4-2a6051b19710 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:27.319153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 23/45] 10.222.0.20 () {60 vars in 1131 bytes} [Sun Sep 11 10:32:27 2022] POST /identity/v3/roles => generated 223 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:32:27.360916 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae542177-1f75-4c1f-87ca-585252885938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:27.361550 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae542177-1f75-4c1f-87ca-585252885938 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:27.361838 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae542177-1f75-4c1f-87ca-585252885938 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:27.362119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae542177-1f75-4c1f-87ca-585252885938 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:27.362791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae542177-1f75-4c1f-87ca-585252885938 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:27.364262 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae542177-1f75-4c1f-87ca-585252885938 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:27.404666 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 10:32:27 2022] POST /identity/v3/projects => generated 312 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:32:28.731483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e975a22-b359-4cfe-b130-7dfe7ca6874e None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:28.731905 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e975a22-b359-4cfe-b130-7dfe7ca6874e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:28.732039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e975a22-b359-4cfe-b130-7dfe7ca6874e None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:28.733408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 24/47] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:28.738781 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e51256-8399-43b9-b19f-baf64e1286a1 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:28.739145 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e51256-8399-43b9-b19f-baf64e1286a1 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:28.739349 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e51256-8399-43b9-b19f-baf64e1286a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:28.758113 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e0e51256-8399-43b9-b19f-baf64e1286a1 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:28.759301 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e0e51256-8399-43b9-b19f-baf64e1286a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:28.779586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:28.826694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 24/48] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:29.092644 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e975a22-b359-4cfe-b130-7dfe7ca6874e None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:29.192857 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e975a22-b359-4cfe-b130-7dfe7ca6874e None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:29.226442 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7149a-1f77-4bb1-8805-6de08254fb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:29.227076 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7149a-1f77-4bb1-8805-6de08254fb02 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:29.227358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7149a-1f77-4bb1-8805-6de08254fb02 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:29.227632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7149a-1f77-4bb1-8805-6de08254fb02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:29.238918 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7149a-1f77-4bb1-8805-6de08254fb02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:29.244975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-b4b7149a-1f77-4bb1-8805-6de08254fb02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:32:29.244975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:29.244975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:29.244975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:29.244975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:29.244975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:29.244975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:29.244975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:29.244975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:29.244975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:29.244975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:29.244975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:29.244975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:29.244975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:29.244975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:29.244975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:29.245792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:29.245792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:29.245792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:29.245792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:29.245792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:29.245792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:29.245792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:29.245792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:29.245792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:29.245792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:29.245792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:29.245792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:29.245792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:29.245792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:29.245792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:29.245792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:29.246555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:29.246555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:29.246555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:29.246555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:29.246555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:29.246555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:29.246555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:29.246555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:29.246555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:29.246555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:29.246555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:32:29.246555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:32:29.246555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 25/49] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:32:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:32:29.251988 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e51256-8399-43b9-b19f-baf64e1286a1 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:29.349237 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e51256-8399-43b9-b19f-baf64e1286a1 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:29.381512 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8418c-52f8-4845-801a-4106993d60ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:29.382121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8418c-52f8-4845-801a-4106993d60ea None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:29.382399 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8418c-52f8-4845-801a-4106993d60ea None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:29.382670 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8418c-52f8-4845-801a-4106993d60ea None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:29.383334 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8418c-52f8-4845-801a-4106993d60ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:29.383639 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8418c-52f8-4845-801a-4106993d60ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:29.385061 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8418c-52f8-4845-801a-4106993d60ea None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:29.393169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 25/50] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:32:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:29.399562 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7149a-1f77-4bb1-8805-6de08254fb02 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:29.456795 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:29.501900 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7149a-1f77-4bb1-8805-6de08254fb02 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:29.534706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90300b-7e21-4a13-9d1f-9014f00be734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:29.535341 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90300b-7e21-4a13-9d1f-9014f00be734 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:29.535625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90300b-7e21-4a13-9d1f-9014f00be734 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:29.535902 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90300b-7e21-4a13-9d1f-9014f00be734 None admin] PATH_INFO: `/v3/users/f5c1185c0be14e5a840b375a991df2d8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:29.537325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90300b-7e21-4a13-9d1f-9014f00be734 None admin] RBAC: Authorizing `identity:get_user(user_id=f5c1185c0be14e5a840b375a991df2d8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:29.538780 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90300b-7e21-4a13-9d1f-9014f00be734 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:29.540361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 26/51] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:29 2022] GET /identity/v3/users/f5c1185c0be14e5a840b375a991df2d8 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:29.545981 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8418c-52f8-4845-801a-4106993d60ea None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:29.561643 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c379ff-00be-4c68-a102-cbd327ebca68 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:29.561932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c379ff-00be-4c68-a102-cbd327ebca68 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:29.562215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c379ff-00be-4c68-a102-cbd327ebca68 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:29.563530 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 27/52] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:32:29.565538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:29.569076 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472d6a9-2762-448b-b039-b67a08d07449 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:29.569363 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472d6a9-2762-448b-b039-b67a08d07449 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:29.569640 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472d6a9-2762-448b-b039-b67a08d07449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:29.588162 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-8472d6a9-2762-448b-b039-b67a08d07449 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:29.589406 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8472d6a9-2762-448b-b039-b67a08d07449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:29.647887 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8418c-52f8-4845-801a-4106993d60ea None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:29.659441 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 28/53] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:29.680818 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81334c-3428-4bfb-9948-745849964603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:29.681448 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81334c-3428-4bfb-9948-745849964603 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:29.681734 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81334c-3428-4bfb-9948-745849964603 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:29.682009 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81334c-3428-4bfb-9948-745849964603 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:29.683116 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81334c-3428-4bfb-9948-745849964603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:29.684570 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81334c-3428-4bfb-9948-745849964603 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:29.686136 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 26/54] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:32:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:29.691796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472d6a9-2762-448b-b039-b67a08d07449 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:29.747984 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:29.790467 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472d6a9-2762-448b-b039-b67a08d07449 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:29.927963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4ad63-5315-40c3-ad9c-a10b0264a8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:29.928602 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4ad63-5315-40c3-ad9c-a10b0264a8b0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:29.928810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4ad63-5315-40c3-ad9c-a10b0264a8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:29.929084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4ad63-5315-40c3-ad9c-a10b0264a8b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:29.929804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81334c-3428-4bfb-9948-745849964603 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:29.930222 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4ad63-5315-40c3-ad9c-a10b0264a8b0 None admin] RBAC: Adding query filter params (role.id=529cb3511f3a498b9b7169ed5b0f6b8e, scope.domain.id=default, user.id=f5c1185c0be14e5a840b375a991df2d8) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:29.930222 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4ad63-5315-40c3-ad9c-a10b0264a8b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:29.931518 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4ad63-5315-40c3-ad9c-a10b0264a8b0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:29.940713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 29/55] 10.222.0.20 () {56 vars in 1322 bytes} [Sun Sep 11 10:32:29 2022] GET /identity/v3/role_assignments?user.id=f5c1185c0be14e5a840b375a991df2d8&scope.domain.id=default&role.id=529cb3511f3a498b9b7169ed5b0f6b8e => generated 530 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:32:30.021855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:30.037560 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81334c-3428-4bfb-9948-745849964603 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:30.072291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c9fae-2b6a-41de-8c50-2deca03a01d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:30.072962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c9fae-2b6a-41de-8c50-2deca03a01d6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:30.073251 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c9fae-2b6a-41de-8c50-2deca03a01d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:30.073529 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c9fae-2b6a-41de-8c50-2deca03a01d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:30.074720 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c9fae-2b6a-41de-8c50-2deca03a01d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:30.076213 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c9fae-2b6a-41de-8c50-2deca03a01d6 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:30.077908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 27/56] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:32:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:32:30.084447 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4ad63-5315-40c3-ad9c-a10b0264a8b0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:30.187699 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4ad63-5315-40c3-ad9c-a10b0264a8b0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:30.204461 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:30.221300 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c688d15-38b2-47ae-965f-d0db95822caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:30.221904 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c688d15-38b2-47ae-965f-d0db95822caf None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:30.222452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c688d15-38b2-47ae-965f-d0db95822caf None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:30.222723 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c688d15-38b2-47ae-965f-d0db95822caf None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:30.223820 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c688d15-38b2-47ae-965f-d0db95822caf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:30.225309 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c688d15-38b2-47ae-965f-d0db95822caf None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:30.249454 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 30/57] 10.222.0.20 () {60 vars in 1140 bytes} [Sun Sep 11 10:32:30 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:32:32.379564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3525c-b93f-4257-9dd2-c9b3380d0547 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:32.380076 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3525c-b93f-4257-9dd2-c9b3380d0547 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:32.380160 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3525c-b93f-4257-9dd2-c9b3380d0547 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:32.381998 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 28/58] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:32.387235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea945b-5f9d-4335-b2a3-f250408e0e61 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:32.387650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea945b-5f9d-4335-b2a3-f250408e0e61 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:32.387798 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea945b-5f9d-4335-b2a3-f250408e0e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:32.406153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-cbea945b-5f9d-4335-b2a3-f250408e0e61 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:32.407353 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cbea945b-5f9d-4335-b2a3-f250408e0e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:32.469894 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 31/59] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:32.737683 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3525c-b93f-4257-9dd2-c9b3380d0547 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:32.837502 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3525c-b93f-4257-9dd2-c9b3380d0547 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:32.870263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3b1c2-b144-4443-bcdc-c6733c3e9823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:32.870889 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3b1c2-b144-4443-bcdc-c6733c3e9823 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:32.871173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3b1c2-b144-4443-bcdc-c6733c3e9823 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:32.871455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3b1c2-b144-4443-bcdc-c6733c3e9823 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:32.872589 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3b1c2-b144-4443-bcdc-c6733c3e9823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:32.874041 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3b1c2-b144-4443-bcdc-c6733c3e9823 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:32.875610 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 29/60] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:32:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:32.881672 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea945b-5f9d-4335-b2a3-f250408e0e61 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:32.973353 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:32.976808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea945b-5f9d-4335-b2a3-f250408e0e61 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:33.010202 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d51cb0-9617-4afa-9082-38db0dd8a7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:33.010807 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d51cb0-9617-4afa-9082-38db0dd8a7c9 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:33.011091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d51cb0-9617-4afa-9082-38db0dd8a7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:33.011368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d51cb0-9617-4afa-9082-38db0dd8a7c9 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:33.012028 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d51cb0-9617-4afa-9082-38db0dd8a7c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:33.013502 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d51cb0-9617-4afa-9082-38db0dd8a7c9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:33.039351 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 32/61] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 10:32:32 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:32:36.369697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70ecb9-95ab-4165-9f1e-d5a1fb7b55ca None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:36.369697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70ecb9-95ab-4165-9f1e-d5a1fb7b55ca None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:36.369697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70ecb9-95ab-4165-9f1e-d5a1fb7b55ca None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:36.369697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 30/62] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:36.378579 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ecdc2-1416-4159-9f1e-1d58d7d6e2c2 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:36.379521 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ecdc2-1416-4159-9f1e-1d58d7d6e2c2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:36.380001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ecdc2-1416-4159-9f1e-1d58d7d6e2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:36.405916 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e13ecdc2-1416-4159-9f1e-1d58d7d6e2c2 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:36.407716 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e13ecdc2-1416-4159-9f1e-1d58d7d6e2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:36.498835 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 33/63] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:36.531030 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eb358-c2d5-4a3f-8516-bcfb8e7e0e59 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:36.531648 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eb358-c2d5-4a3f-8516-bcfb8e7e0e59 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:36.532128 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eb358-c2d5-4a3f-8516-bcfb8e7e0e59 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:36.533741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 31/64] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:36.538131 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f05d31-4116-4764-befe-86bf47d17e46 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:36.538418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f05d31-4116-4764-befe-86bf47d17e46 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:36.538880 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f05d31-4116-4764-befe-86bf47d17e46 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:36.539351 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77745e02-c8af-4b62-beb4-534bd97652ad None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:36.539763 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77745e02-c8af-4b62-beb4-534bd97652ad None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:36.540145 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77745e02-c8af-4b62-beb4-534bd97652ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:36.540870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 34/65] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:36.546152 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796aa59-e987-4dac-bad7-abd6c4c523ce None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:36.546635 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796aa59-e987-4dac-bad7-abd6c4c523ce None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:36.547092 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796aa59-e987-4dac-bad7-abd6c4c523ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:36.563179 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-77745e02-c8af-4b62-beb4-534bd97652ad None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:36.564723 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-77745e02-c8af-4b62-beb4-534bd97652ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:36.580296 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2796aa59-e987-4dac-bad7-abd6c4c523ce None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:36.581476 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2796aa59-e987-4dac-bad7-abd6c4c523ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:36.583859 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:36.654490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 35/66] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:36.675343 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 32/67] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:32:36.817279 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796aa59-e987-4dac-bad7-abd6c4c523ce None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:36.842684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:36.951561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796aa59-e987-4dac-bad7-abd6c4c523ce None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:36.981341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a9906-e30b-4c6e-b5c4-eff95df30616 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:36.981640 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a9906-e30b-4c6e-b5c4-eff95df30616 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:36.981890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a9906-e30b-4c6e-b5c4-eff95df30616 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:36.983901 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 33/68] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:36.989271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e3544-733e-41bb-bae1-19c9c3301d6c None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:36.989751 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e3544-733e-41bb-bae1-19c9c3301d6c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:36.990029 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e3544-733e-41bb-bae1-19c9c3301d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:37.005890 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482707d2-bda3-4772-895f-c73ca9eea88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:37.006546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482707d2-bda3-4772-895f-c73ca9eea88a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:37.006835 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482707d2-bda3-4772-895f-c73ca9eea88a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:37.007113 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482707d2-bda3-4772-895f-c73ca9eea88a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:37.012584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-218e3544-733e-41bb-bae1-19c9c3301d6c None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:37.014016 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-218e3544-733e-41bb-bae1-19c9c3301d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:37.026610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482707d2-bda3-4772-895f-c73ca9eea88a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:37.032632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-482707d2-bda3-4772-895f-c73ca9eea88a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:32:37.032632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:37.032632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:37.032632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:37.032632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:37.032632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:37.032632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:37.032632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:37.032632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:37.032632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:37.032632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:37.032632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:37.032632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:37.032632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:37.032632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:37.032632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:37.033493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:37.033493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:37.033493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:37.033493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:37.033493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:37.033493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:37.033493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:37.033493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:37.033493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:37.033493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:37.033493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:37.033493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:37.033493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:37.033493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:37.033493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:37.033493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:37.034274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:37.034274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:37.034274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:37.034274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:37.034274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:37.034274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:37.034274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:37.034274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:37.034274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:37.034274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:37.034274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:32:37.034274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:32:37.035110 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 36/69] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:32:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:32:37.036125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482707d2-bda3-4772-895f-c73ca9eea88a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:37.095588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 34/70] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:32:37.096270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e3544-733e-41bb-bae1-19c9c3301d6c None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:37.119837 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:37.146141 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482707d2-bda3-4772-895f-c73ca9eea88a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:37.181762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f771263-773a-497d-acee-922fdfe7a862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:37.182386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f771263-773a-497d-acee-922fdfe7a862 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:37.182671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f771263-773a-497d-acee-922fdfe7a862 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:37.182932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f771263-773a-497d-acee-922fdfe7a862 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:37.184011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:37.193606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f771263-773a-497d-acee-922fdfe7a862 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:37.198417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-0f771263-773a-497d-acee-922fdfe7a862 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:32:37.198417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:37.198417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:37.198417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:37.198417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:37.198417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:37.198417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:37.198417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:37.198417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:37.198417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:37.198417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:37.198417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:37.198417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:37.198417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:37.198417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:37.198417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:37.199247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:37.199247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:37.199247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:37.199247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:37.199247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:37.199247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:37.199247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:37.199247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:37.199247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:37.199247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:37.199247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:37.199247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:37.199247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:37.199247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:37.199247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:37.199247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:37.199989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:37.199989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:37.199989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:37.199989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:37.199989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:37.199989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:37.199989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:37.199989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:37.199989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:37.199989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:37.199989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:32:37.199989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:32:37.199989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 37/71] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:32:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:32:37.200650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f771263-773a-497d-acee-922fdfe7a862 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:37.211365 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e3544-733e-41bb-bae1-19c9c3301d6c None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:37.247638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9cc1f-7c51-4cc8-989b-8f2e3c13bc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:37.248578 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9cc1f-7c51-4cc8-989b-8f2e3c13bc7e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:37.248875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9cc1f-7c51-4cc8-989b-8f2e3c13bc7e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:37.249156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9cc1f-7c51-4cc8-989b-8f2e3c13bc7e None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:37.249826 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9cc1f-7c51-4cc8-989b-8f2e3c13bc7e None admin] RBAC: Adding query filter params (name=member) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:37.250135 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9cc1f-7c51-4cc8-989b-8f2e3c13bc7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:37.251794 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9cc1f-7c51-4cc8-989b-8f2e3c13bc7e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:37.259878 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 35/72] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:32:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:37.260894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bdaed-51f3-4164-bda7-9f9061f5cb85 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:37.261181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bdaed-51f3-4164-bda7-9f9061f5cb85 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:37.261458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bdaed-51f3-4164-bda7-9f9061f5cb85 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:37.262843 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 36/73] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:37.267368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bdaed-51f3-4164-bda7-9f9061f5cb85 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:37.312772 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f771263-773a-497d-acee-922fdfe7a862 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:37.348643 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396bca8-e522-4897-9956-867b4345bfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:37.349330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396bca8-e522-4897-9956-867b4345bfe1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:37.349610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396bca8-e522-4897-9956-867b4345bfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:37.349882 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396bca8-e522-4897-9956-867b4345bfe1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:37.353002 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:37.362367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396bca8-e522-4897-9956-867b4345bfe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:37.368431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-b396bca8-e522-4897-9956-867b4345bfe1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:32:37.368431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:37.368431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:37.368431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:37.368431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:37.368431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:37.368431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:37.368431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:37.368431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:37.368431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:37.368431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:37.368431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:37.368431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:37.368431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:37.368431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:37.368431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:37.369324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:37.369324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:37.369324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:37.369324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:37.369324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:37.369324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:37.369324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:37.369324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:37.369324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:37.369324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:37.369324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:37.369324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:37.369324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:37.369324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:37.369324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:37.369324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:37.370070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:37.370070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:37.370070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:37.370070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:37.370070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:37.370070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:37.370070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:37.370070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:37.370070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:37.370070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:37.370070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:32:37.370070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:32:37.370070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 38/74] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:32:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:32:37.370683 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396bca8-e522-4897-9956-867b4345bfe1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:37.373921 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bdaed-51f3-4164-bda7-9f9061f5cb85 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:37.416211 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e59770-a41f-4c74-be34-5ce0dead92f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:37.416870 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e59770-a41f-4c74-be34-5ce0dead92f8 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:37.417158 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e59770-a41f-4c74-be34-5ce0dead92f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:37.417441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e59770-a41f-4c74-be34-5ce0dead92f8 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:37.418121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e59770-a41f-4c74-be34-5ce0dead92f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:37.418428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e59770-a41f-4c74-be34-5ce0dead92f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:37.420606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e59770-a41f-4c74-be34-5ce0dead92f8 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:37.431066 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:32:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:37.432259 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7f896-c008-410c-91e1-2f24a0e291ae None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:37.432557 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7f896-c008-410c-91e1-2f24a0e291ae None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:37.432852 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7f896-c008-410c-91e1-2f24a0e291ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:37.444763 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:37.450959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-8cf7f896-c008-410c-91e1-2f24a0e291ae None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:37.452161 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8cf7f896-c008-410c-91e1-2f24a0e291ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:37.476498 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396bca8-e522-4897-9956-867b4345bfe1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:37.509781 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f46ac-adbd-4baf-8b39-d3ab4454197a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:37.510417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f46ac-adbd-4baf-8b39-d3ab4454197a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:37.510703 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f46ac-adbd-4baf-8b39-d3ab4454197a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:37.510976 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f46ac-adbd-4baf-8b39-d3ab4454197a None admin] PATH_INFO: `/v3/users/315b7d0f6889432f934c56e1f4aded84` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:37.516624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 38/76] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:37.517623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7f896-c008-410c-91e1-2f24a0e291ae None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:37.534097 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f46ac-adbd-4baf-8b39-d3ab4454197a None admin] RBAC: Authorizing `identity:get_user(user_id=315b7d0f6889432f934c56e1f4aded84)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:37.535549 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f46ac-adbd-4baf-8b39-d3ab4454197a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:37.537425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 39/77] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:37 2022] GET /identity/v3/users/315b7d0f6889432f934c56e1f4aded84 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:37.542421 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f46ac-adbd-4baf-8b39-d3ab4454197a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:37.595628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:37.625338 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7f896-c008-410c-91e1-2f24a0e291ae None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:37.639221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f46ac-adbd-4baf-8b39-d3ab4454197a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:37.661104 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9a729-63be-487f-b78f-51d0e0302a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:37.661763 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9a729-63be-487f-b78f-51d0e0302a4d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:37.662042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9a729-63be-487f-b78f-51d0e0302a4d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:37.662317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9a729-63be-487f-b78f-51d0e0302a4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:37.665219 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:37.673725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9a729-63be-487f-b78f-51d0e0302a4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:37.674174 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cde3be-95ae-49f0-b3b5-7c7d16581c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:37.674787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cde3be-95ae-49f0-b3b5-7c7d16581c1e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:37.675071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cde3be-95ae-49f0-b3b5-7c7d16581c1e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:37.675347 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cde3be-95ae-49f0-b3b5-7c7d16581c1e None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:37.676019 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cde3be-95ae-49f0-b3b5-7c7d16581c1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:37.676328 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cde3be-95ae-49f0-b3b5-7c7d16581c1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:37.677781 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cde3be-95ae-49f0-b3b5-7c7d16581c1e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:37.678776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-45d9a729-63be-487f-b78f-51d0e0302a4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:32:37.678776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:37.678776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:37.678776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:37.678776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:37.678776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:37.678776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:37.678776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:37.678776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:37.678776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:37.678776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:37.678776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:37.678776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:37.678776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:37.678776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:37.678776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:37.679603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:37.679603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:37.679603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:37.679603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:37.679603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:37.679603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:37.679603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:37.679603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:37.679603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:37.679603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:37.679603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:37.679603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:37.679603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:37.679603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:37.679603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:37.679603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:37.680362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:37.680362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:37.680362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:37.680362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:37.680362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:37.680362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:37.680362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:37.680362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:37.680362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:37.680362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:37.680362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:32:37.680362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:32:37.680362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 39/78] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:32:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:32:37.681677 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9a729-63be-487f-b78f-51d0e0302a4d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:37.691793 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 40/79] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:32:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:37.700600 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cde3be-95ae-49f0-b3b5-7c7d16581c1e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:37.800472 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9a729-63be-487f-b78f-51d0e0302a4d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:37.808091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cde3be-95ae-49f0-b3b5-7c7d16581c1e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:37.824622 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:37.833989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ff354-358b-4552-a621-a9322e899cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:37.834634 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ff354-358b-4552-a621-a9322e899cc2 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:37.834917 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ff354-358b-4552-a621-a9322e899cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:37.835196 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ff354-358b-4552-a621-a9322e899cc2 None admin] PATH_INFO: `/v3/users/f5c1185c0be14e5a840b375a991df2d8` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:37.836371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ff354-358b-4552-a621-a9322e899cc2 None admin] RBAC: Authorizing `identity:get_user(user_id=f5c1185c0be14e5a840b375a991df2d8)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:37.837908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ff354-358b-4552-a621-a9322e899cc2 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:37.843870 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 40/80] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:37 2022] GET /identity/v3/users/f5c1185c0be14e5a840b375a991df2d8 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:37.843870 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ff354-358b-4552-a621-a9322e899cc2 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:37.844060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147c6ad-d627-4371-8544-db061dae1e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:37.844318 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147c6ad-d627-4371-8544-db061dae1e48 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:37.844526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147c6ad-d627-4371-8544-db061dae1e48 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:37.844832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147c6ad-d627-4371-8544-db061dae1e48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:37.901156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:37.915596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147c6ad-d627-4371-8544-db061dae1e48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:37.917101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147c6ad-d627-4371-8544-db061dae1e48 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:37.938362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ff354-358b-4552-a621-a9322e899cc2 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:37.975823 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38390256-ecbb-4af6-9cb6-27eb4dcee220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:37.976433 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38390256-ecbb-4af6-9cb6-27eb4dcee220 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:37.976743 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38390256-ecbb-4af6-9cb6-27eb4dcee220 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:37.977021 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38390256-ecbb-4af6-9cb6-27eb4dcee220 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:37.977687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38390256-ecbb-4af6-9cb6-27eb4dcee220 None admin] RBAC: Adding query filter params (name=member) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:37.977992 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38390256-ecbb-4af6-9cb6-27eb4dcee220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:37.979403 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38390256-ecbb-4af6-9cb6-27eb4dcee220 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:37.987168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 41/81] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:32:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:37.987942 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38390256-ecbb-4af6-9cb6-27eb4dcee220 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:38.021884 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 41/82] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:32:38.022928 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147c6ad-d627-4371-8544-db061dae1e48 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:38.040139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:38.089970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38390256-ecbb-4af6-9cb6-27eb4dcee220 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:38.115285 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:38.119688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147c6ad-d627-4371-8544-db061dae1e48 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:38.124685 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402e7c6-fb91-400a-b15d-02f1ce3700db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:38.125313 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402e7c6-fb91-400a-b15d-02f1ce3700db None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:38.125593 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402e7c6-fb91-400a-b15d-02f1ce3700db None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:38.125867 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402e7c6-fb91-400a-b15d-02f1ce3700db None admin] PATH_INFO: `/v3/users/315b7d0f6889432f934c56e1f4aded84` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:38.127010 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402e7c6-fb91-400a-b15d-02f1ce3700db None admin] RBAC: Authorizing `identity:get_user(user_id=315b7d0f6889432f934c56e1f4aded84)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:38.128484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402e7c6-fb91-400a-b15d-02f1ce3700db None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:38.130083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 42/83] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:37 2022] GET /identity/v3/users/315b7d0f6889432f934c56e1f4aded84 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:38.134826 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402e7c6-fb91-400a-b15d-02f1ce3700db None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:38.154608 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a5cd3-af4e-4daf-b683-f9c22476ddb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:38.155251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a5cd3-af4e-4daf-b683-f9c22476ddb2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:38.155545 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a5cd3-af4e-4daf-b683-f9c22476ddb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:38.155819 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a5cd3-af4e-4daf-b683-f9c22476ddb2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:38.156970 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a5cd3-af4e-4daf-b683-f9c22476ddb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:38.158422 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a5cd3-af4e-4daf-b683-f9c22476ddb2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:38.159992 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 42/84] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:32:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:38.160779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a5cd3-af4e-4daf-b683-f9c22476ddb2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:38.229918 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402e7c6-fb91-400a-b15d-02f1ce3700db None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:38.243688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:38.260021 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a5cd3-af4e-4daf-b683-f9c22476ddb2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:38.262772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2ac87-202d-4c95-bcfa-1442abd4132d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:38.263382 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2ac87-202d-4c95-bcfa-1442abd4132d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:38.263666 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2ac87-202d-4c95-bcfa-1442abd4132d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:38.263947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2ac87-202d-4c95-bcfa-1442abd4132d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:38.293179 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e423c6-86d9-4b87-8fad-0e3158b42c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:38.293806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e423c6-86d9-4b87-8fad-0e3158b42c03 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:38.294085 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e423c6-86d9-4b87-8fad-0e3158b42c03 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:38.294356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e423c6-86d9-4b87-8fad-0e3158b42c03 None admin] PATH_INFO: `/v3/users/315b7d0f6889432f934c56e1f4aded84` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:38.295475 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e423c6-86d9-4b87-8fad-0e3158b42c03 None admin] RBAC: Authorizing `identity:get_user(user_id=315b7d0f6889432f934c56e1f4aded84)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:38.296956 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e423c6-86d9-4b87-8fad-0e3158b42c03 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:38.298537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 43/85] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:38 2022] GET /identity/v3/users/315b7d0f6889432f934c56e1f4aded84 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:38.301418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e423c6-86d9-4b87-8fad-0e3158b42c03 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:38.326293 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:38.334188 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2ac87-202d-4c95-bcfa-1442abd4132d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:38.335665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2ac87-202d-4c95-bcfa-1442abd4132d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:38.402190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e423c6-86d9-4b87-8fad-0e3158b42c03 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:38.431501 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 43/86] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:32:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:32:38.432421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2ac87-202d-4c95-bcfa-1442abd4132d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:38.436009 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf0c36-ef1b-4c79-a83e-3d81c802ba77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:38.436605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf0c36-ef1b-4c79-a83e-3d81c802ba77 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:38.436892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf0c36-ef1b-4c79-a83e-3d81c802ba77 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:38.437175 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf0c36-ef1b-4c79-a83e-3d81c802ba77 None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:38.438358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf0c36-ef1b-4c79-a83e-3d81c802ba77 None admin] RBAC: Authorizing `identity:get_project(project_id=a0bc949d68f2445ca2585ec234ea2c73)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:38.439807 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf0c36-ef1b-4c79-a83e-3d81c802ba77 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:38.441474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 44/87] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:32:38 2022] GET /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:38.443241 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf0c36-ef1b-4c79-a83e-3d81c802ba77 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:38.465229 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:38.525124 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:38.532519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2ac87-202d-4c95-bcfa-1442abd4132d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:38.542573 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf0c36-ef1b-4c79-a83e-3d81c802ba77 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:38.566621 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57932f92-c440-47d3-a007-d6cf3ce5bf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:38.567236 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57932f92-c440-47d3-a007-d6cf3ce5bf02 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:38.567556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57932f92-c440-47d3-a007-d6cf3ce5bf02 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:38.567840 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57932f92-c440-47d3-a007-d6cf3ce5bf02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:38.575197 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826680e-ba21-47d3-9a4a-8f14f97ecaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:38.575797 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826680e-ba21-47d3-9a4a-8f14f97ecaa7 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:38.576080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826680e-ba21-47d3-9a4a-8f14f97ecaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:38.576357 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826680e-ba21-47d3-9a4a-8f14f97ecaa7 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:38.577045 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826680e-ba21-47d3-9a4a-8f14f97ecaa7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:38.578474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826680e-ba21-47d3-9a4a-8f14f97ecaa7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:38.599989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 45/88] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 10:32:38 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:32:38.600842 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826680e-ba21-47d3-9a4a-8f14f97ecaa7 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:38.643627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57932f92-c440-47d3-a007-d6cf3ce5bf02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:38.645273 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57932f92-c440-47d3-a007-d6cf3ce5bf02 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:38.687462 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:38.723539 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826680e-ba21-47d3-9a4a-8f14f97ecaa7 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:38.753437 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:38.762091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 44/89] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:32:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:32:38.762955 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57932f92-c440-47d3-a007-d6cf3ce5bf02 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:38.772494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b02b0-f04a-4bf3-8d9d-1b0386520e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:38.773017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b02b0-f04a-4bf3-8d9d-1b0386520e32 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:38.773304 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b02b0-f04a-4bf3-8d9d-1b0386520e32 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:38.773579 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b02b0-f04a-4bf3-8d9d-1b0386520e32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:38.856772 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b02b0-f04a-4bf3-8d9d-1b0386520e32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:38.857617 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b02b0-f04a-4bf3-8d9d-1b0386520e32 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:38.878915 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57932f92-c440-47d3-a007-d6cf3ce5bf02 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:38.927051 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567a5cc-7a8b-4528-9455-9c059acbdcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:38.927702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567a5cc-7a8b-4528-9455-9c059acbdcec None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:38.927986 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567a5cc-7a8b-4528-9455-9c059acbdcec None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:38.928264 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567a5cc-7a8b-4528-9455-9c059acbdcec None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:38.930293 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567a5cc-7a8b-4528-9455-9c059acbdcec None admin] RBAC: Authorizing `identity:get_project(project_id=a0bc949d68f2445ca2585ec234ea2c73)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:38.931805 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567a5cc-7a8b-4528-9455-9c059acbdcec None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:38.933562 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 45/90] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:32:38 2022] GET /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:38.934838 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567a5cc-7a8b-4528-9455-9c059acbdcec None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:38.955254 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:38.984410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 46/91] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:32:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:32:38.989546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b02b0-f04a-4bf3-8d9d-1b0386520e32 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:39.014092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:39.067059 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567a5cc-7a8b-4528-9455-9c059acbdcec None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:39.095827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b02b0-f04a-4bf3-8d9d-1b0386520e32 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:39.115653 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc3313-aca8-42a1-bb60-497529c25737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:39.116658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc3313-aca8-42a1-bb60-497529c25737 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:39.117131 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc3313-aca8-42a1-bb60-497529c25737 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:39.118071 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc3313-aca8-42a1-bb60-497529c25737 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:39.119270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc3313-aca8-42a1-bb60-497529c25737 None admin] RBAC: Adding query filter params (role.id=344db47133bb4fb2843696759f71b2c7, scope.project.id=a0bc949d68f2445ca2585ec234ea2c73, user.id=315b7d0f6889432f934c56e1f4aded84) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:39.119793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc3313-aca8-42a1-bb60-497529c25737 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:39.122369 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc3313-aca8-42a1-bb60-497529c25737 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:39.130991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 46/92] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:32:38 2022] GET /identity/v3/role_assignments?user.id=315b7d0f6889432f934c56e1f4aded84&scope.project.id=a0bc949d68f2445ca2585ec234ea2c73&role.id=344db47133bb4fb2843696759f71b2c7 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:39.132026 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc3313-aca8-42a1-bb60-497529c25737 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:39.132128 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a364d-7077-413a-ac83-b793fde957b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:39.132846 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a364d-7077-413a-ac83-b793fde957b5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:39.133143 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a364d-7077-413a-ac83-b793fde957b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:39.133417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a364d-7077-413a-ac83-b793fde957b5 None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:39.134591 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a364d-7077-413a-ac83-b793fde957b5 None admin] RBAC: Authorizing `identity:get_project(project_id=a0bc949d68f2445ca2585ec234ea2c73)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:39.136093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a364d-7077-413a-ac83-b793fde957b5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:39.138256 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 47/93] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:32:38 2022] GET /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:39.143316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a364d-7077-413a-ac83-b793fde957b5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:39.193662 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:39.255286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a364d-7077-413a-ac83-b793fde957b5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:39.291042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc3313-aca8-42a1-bb60-497529c25737 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:39.292895 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abcdae-4f8a-4493-af4b-918102219160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:39.293593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abcdae-4f8a-4493-af4b-918102219160 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:39.294915 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abcdae-4f8a-4493-af4b-918102219160 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:39.294915 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abcdae-4f8a-4493-af4b-918102219160 None admin] PATH_INFO: `/v3/projects/703306e79b234fb4a5f9169f09560dee` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:39.295956 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31abcdae-4f8a-4493-af4b-918102219160 None admin] RBAC: Authorizing `identity:get_project(project_id=703306e79b234fb4a5f9169f09560dee)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:39.297542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31abcdae-4f8a-4493-af4b-918102219160 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:39.299358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 48/94] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:32:39 2022] GET /identity/v3/projects/703306e79b234fb4a5f9169f09560dee => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:39.300294 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abcdae-4f8a-4493-af4b-918102219160 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:39.336641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:39.357705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36851f77-9f27-43eb-95dd-5ddfbb7093ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:39.358338 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36851f77-9f27-43eb-95dd-5ddfbb7093ce None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:39.358624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36851f77-9f27-43eb-95dd-5ddfbb7093ce None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:39.358905 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36851f77-9f27-43eb-95dd-5ddfbb7093ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:39.359655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36851f77-9f27-43eb-95dd-5ddfbb7093ce None admin] RBAC: Adding query filter params (role.id=529cb3511f3a498b9b7169ed5b0f6b8e, scope.project.id=a0bc949d68f2445ca2585ec234ea2c73, user.id=f5c1185c0be14e5a840b375a991df2d8) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:39.359971 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36851f77-9f27-43eb-95dd-5ddfbb7093ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:39.361474 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36851f77-9f27-43eb-95dd-5ddfbb7093ce None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:39.376273 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 47/95] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:32:39 2022] GET /identity/v3/role_assignments?user.id=f5c1185c0be14e5a840b375a991df2d8&scope.project.id=a0bc949d68f2445ca2585ec234ea2c73&role.id=529cb3511f3a498b9b7169ed5b0f6b8e => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:39.377205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36851f77-9f27-43eb-95dd-5ddfbb7093ce None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:39.476336 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abcdae-4f8a-4493-af4b-918102219160 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:39.493766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:39.519439 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f1346-2973-49e0-9db0-5c5947ea7c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:39.521243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f1346-2973-49e0-9db0-5c5947ea7c8c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:39.521709 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f1346-2973-49e0-9db0-5c5947ea7c8c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:39.522158 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f1346-2973-49e0-9db0-5c5947ea7c8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:39.523104 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f1346-2973-49e0-9db0-5c5947ea7c8c None admin] RBAC: Adding query filter params (role.id=30f1e6f9ddb649d2804d9128b17348f6, scope.project.id=a0bc949d68f2445ca2585ec234ea2c73, user.id=315b7d0f6889432f934c56e1f4aded84) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:39.523951 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f1346-2973-49e0-9db0-5c5947ea7c8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:39.525659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f1346-2973-49e0-9db0-5c5947ea7c8c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:39.532728 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 49/96] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:32:39 2022] GET /identity/v3/role_assignments?user.id=315b7d0f6889432f934c56e1f4aded84&scope.project.id=a0bc949d68f2445ca2585ec234ea2c73&role.id=30f1e6f9ddb649d2804d9128b17348f6 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:39.597459 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36851f77-9f27-43eb-95dd-5ddfbb7093ce None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:39.651397 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cb7d4-a182-40db-ba88-e27a12841c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:39.652046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cb7d4-a182-40db-ba88-e27a12841c29 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:39.652334 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cb7d4-a182-40db-ba88-e27a12841c29 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:39.652636 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cb7d4-a182-40db-ba88-e27a12841c29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:39.653422 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cb7d4-a182-40db-ba88-e27a12841c29 None admin] RBAC: Adding query filter params (role.id=344db47133bb4fb2843696759f71b2c7, scope.project.id=703306e79b234fb4a5f9169f09560dee, user.id=315b7d0f6889432f934c56e1f4aded84) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:39.653812 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cb7d4-a182-40db-ba88-e27a12841c29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:39.655366 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cb7d4-a182-40db-ba88-e27a12841c29 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:39.663467 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 48/97] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:32:39 2022] GET /identity/v3/role_assignments?user.id=315b7d0f6889432f934c56e1f4aded84&scope.project.id=703306e79b234fb4a5f9169f09560dee&role.id=344db47133bb4fb2843696759f71b2c7 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:41.365971 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f348c-cf6c-44d5-a9b8-604d5255c927 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:41.367090 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f348c-cf6c-44d5-a9b8-604d5255c927 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:41.367582 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f348c-cf6c-44d5-a9b8-604d5255c927 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:41.369178 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 50/98] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:41.382602 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0852916-e922-49ca-b3ce-b27f797d6dd6 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:41.383057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0852916-e922-49ca-b3ce-b27f797d6dd6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:41.383153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0852916-e922-49ca-b3ce-b27f797d6dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:41.404472 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-f0852916-e922-49ca-b3ce-b27f797d6dd6 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:41.405707 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f0852916-e922-49ca-b3ce-b27f797d6dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:41.474406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:41.498043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 49/99] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:41.659156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d20a14-52e8-441c-a186-8d6e2b1f6b87 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:41.659460 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d20a14-52e8-441c-a186-8d6e2b1f6b87 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:41.659636 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d20a14-52e8-441c-a186-8d6e2b1f6b87 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:41.661207 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 51/100] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:41.671536 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab645e3-25f2-4c05-8330-9a1e4ac80108 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:41.671832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab645e3-25f2-4c05-8330-9a1e4ac80108 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:41.672120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab645e3-25f2-4c05-8330-9a1e4ac80108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:41.701584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-8ab645e3-25f2-4c05-8330-9a1e4ac80108 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:41.702798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8ab645e3-25f2-4c05-8330-9a1e4ac80108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:41.796584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 50/101] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:42.072183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d20a14-52e8-441c-a186-8d6e2b1f6b87 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:42.168195 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab645e3-25f2-4c05-8330-9a1e4ac80108 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:42.196222 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d20a14-52e8-441c-a186-8d6e2b1f6b87 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:42.251749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2bf23-b3ab-413b-b045-fd10c19cd286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:42.252754 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2bf23-b3ab-413b-b045-fd10c19cd286 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:42.253308 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2bf23-b3ab-413b-b045-fd10c19cd286 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:42.253769 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2bf23-b3ab-413b-b045-fd10c19cd286 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:42.255107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2bf23-b3ab-413b-b045-fd10c19cd286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:42.256849 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2bf23-b3ab-413b-b045-fd10c19cd286 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:42.265029 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 52/102] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:32:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:42.270045 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2bf23-b3ab-413b-b045-fd10c19cd286 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:42.352973 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:42.365092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab645e3-25f2-4c05-8330-9a1e4ac80108 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:42.392668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:42.434903 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97be57a-8707-41dc-824d-f3f289fd0bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:42.435570 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97be57a-8707-41dc-824d-f3f289fd0bc8 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:42.435855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97be57a-8707-41dc-824d-f3f289fd0bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:42.436131 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97be57a-8707-41dc-824d-f3f289fd0bc8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:42.453027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2bf23-b3ab-413b-b045-fd10c19cd286 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:42.464083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97be57a-8707-41dc-824d-f3f289fd0bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:42.469119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-f97be57a-8707-41dc-824d-f3f289fd0bc8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 10:32:42.469119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:42.469119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:42.469119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:42.469119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:42.469119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:42.469119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:42.469119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:42.469119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:42.469119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:42.469119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:42.469119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:42.469119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:42.469119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:42.469119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:42.469119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:42.469943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:42.469943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:42.469943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:42.469943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:42.469943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:42.469943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:42.469943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:42.469943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:42.469943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:42.469943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:42.469943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:42.469943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:42.469943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:42.469943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:42.469943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:42.469943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:42.471083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:42.471083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:42.471083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:42.471083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:42.471083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:42.471083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:42.471083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:42.471083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:42.471083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:42.471083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:42.471083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 10:32:42.471083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:32:42.471083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 51/103] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:32:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:32:42.477932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e577e8-6d01-48b2-b791-6b7c7e6f6116 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:42.478227 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e577e8-6d01-48b2-b791-6b7c7e6f6116 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:42.478513 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e577e8-6d01-48b2-b791-6b7c7e6f6116 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:42.480052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 52/104] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:42.480640 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e577e8-6d01-48b2-b791-6b7c7e6f6116 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:42.518183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aadd59-240b-4673-bd74-36188b822324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:42.518797 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aadd59-240b-4673-bd74-36188b822324 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:42.519081 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aadd59-240b-4673-bd74-36188b822324 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:42.519358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aadd59-240b-4673-bd74-36188b822324 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:42.520013 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aadd59-240b-4673-bd74-36188b822324 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:42.522002 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aadd59-240b-4673-bd74-36188b822324 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:42.578833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 53/105] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 10:32:42 2022] POST /identity/v3/projects => generated 302 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:32:42.580109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5dada-dd78-4061-9923-f6e56cfe038f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:42.580400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5dada-dd78-4061-9923-f6e56cfe038f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:42.580714 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5dada-dd78-4061-9923-f6e56cfe038f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:42.624270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-5ca5dada-dd78-4061-9923-f6e56cfe038f None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:42.626329 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5ca5dada-dd78-4061-9923-f6e56cfe038f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:42.658235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e577e8-6d01-48b2-b791-6b7c7e6f6116 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:42.742374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1dcef-42cb-4c0b-b110-2d5f70c57d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:42.743003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1dcef-42cb-4c0b-b110-2d5f70c57d50 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:42.743285 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1dcef-42cb-4c0b-b110-2d5f70c57d50 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:42.743563 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1dcef-42cb-4c0b-b110-2d5f70c57d50 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:42.744248 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1dcef-42cb-4c0b-b110-2d5f70c57d50 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:42.744568 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1dcef-42cb-4c0b-b110-2d5f70c57d50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:42.745978 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1dcef-42cb-4c0b-b110-2d5f70c57d50 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:42.775405 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 53/106] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:32:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:42.779229 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 54/107] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:42.785896 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1dcef-42cb-4c0b-b110-2d5f70c57d50 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:42.844961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:42.903681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237d7c6-57dd-4b41-906c-9a3973b315c5 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:42.903975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237d7c6-57dd-4b41-906c-9a3973b315c5 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:42.904137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237d7c6-57dd-4b41-906c-9a3973b315c5 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:42.905974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 55/108] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:42.911712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dc4d8-761f-47d8-8be3-a8c33329f5e0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:42.912094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dc4d8-761f-47d8-8be3-a8c33329f5e0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:42.912369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dc4d8-761f-47d8-8be3-a8c33329f5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:42.944509 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-043dc4d8-761f-47d8-8be3-a8c33329f5e0 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:42.945746 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-043dc4d8-761f-47d8-8be3-a8c33329f5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:42.968977 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1dcef-42cb-4c0b-b110-2d5f70c57d50 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:42.990824 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:43.030869 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9b850-1bfa-4681-9961-3d4ab7cb48b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:43.031531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9b850-1bfa-4681-9961-3d4ab7cb48b4 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:43.032001 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9b850-1bfa-4681-9961-3d4ab7cb48b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:43.032283 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9b850-1bfa-4681-9961-3d4ab7cb48b4 None admin] PATH_INFO: `/v3/users/50eff045224d46d4a91c5eef278a418a` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:43.054262 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9b850-1bfa-4681-9961-3d4ab7cb48b4 None admin] RBAC: Authorizing `identity:get_user(user_id=50eff045224d46d4a91c5eef278a418a)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:43.056504 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9b850-1bfa-4681-9961-3d4ab7cb48b4 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:43.058726 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 54/109] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:42 2022] GET /identity/v3/users/50eff045224d46d4a91c5eef278a418a => generated 289 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:43.060346 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e63b64-7f08-429d-83b7-29ba8cc86fc6 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:43.060469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 56/110] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:32:43.060655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e63b64-7f08-429d-83b7-29ba8cc86fc6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:43.060873 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e63b64-7f08-429d-83b7-29ba8cc86fc6 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:43.062159 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 55/111] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:43.064782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dc4d8-761f-47d8-8be3-a8c33329f5e0 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:43.069419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef2f45-5da1-4d85-8f21-bfe706672cf6 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:43.069724 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef2f45-5da1-4d85-8f21-bfe706672cf6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:43.069972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef2f45-5da1-4d85-8f21-bfe706672cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:43.090873 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-7bef2f45-5da1-4d85-8f21-bfe706672cf6 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:43.092161 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7bef2f45-5da1-4d85-8f21-bfe706672cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:43.174164 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 56/112] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:32:43.179525 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f70fa-f7f9-4930-be97-4e357667a183 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:43.179816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f70fa-f7f9-4930-be97-4e357667a183 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:43.180246 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f70fa-f7f9-4930-be97-4e357667a183 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:43.182307 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 57/113] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:43.188490 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7858a87-9b45-447a-80f5-8f3bc48122d7 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:43.189064 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7858a87-9b45-447a-80f5-8f3bc48122d7 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:43.189346 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7858a87-9b45-447a-80f5-8f3bc48122d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:43.231032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-a7858a87-9b45-447a-80f5-8f3bc48122d7 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:43.235952 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a7858a87-9b45-447a-80f5-8f3bc48122d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:43.255625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dc4d8-761f-47d8-8be3-a8c33329f5e0 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:43.273300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:43.319902 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e3e54-d97d-482d-b003-2fcc84d4e501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:43.320913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e3e54-d97d-482d-b003-2fcc84d4e501 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:43.321398 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e3e54-d97d-482d-b003-2fcc84d4e501 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:43.321861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e3e54-d97d-482d-b003-2fcc84d4e501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:43.360998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:43.362436 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 58/114] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:32:43.363483 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7858a87-9b45-447a-80f5-8f3bc48122d7 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:43.441223 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e3e54-d97d-482d-b003-2fcc84d4e501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:43.443486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e3e54-d97d-482d-b003-2fcc84d4e501 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:43.538464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7858a87-9b45-447a-80f5-8f3bc48122d7 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:43.576032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050285c3-3530-4dc0-b108-52cfa76ae767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:43.576830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050285c3-3530-4dc0-b108-52cfa76ae767 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:43.577119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050285c3-3530-4dc0-b108-52cfa76ae767 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:43.577398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050285c3-3530-4dc0-b108-52cfa76ae767 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:43.590979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050285c3-3530-4dc0-b108-52cfa76ae767 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:43.597447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-050285c3-3530-4dc0-b108-52cfa76ae767 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:32:43.597447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:43.597447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:43.597447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:43.597447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:43.597447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:43.597447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:43.597447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:43.597447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:43.597447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:43.597447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:43.597447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:43.597447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:43.597447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:43.597447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:43.597447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:43.598278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:43.598278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:43.598278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:43.598278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:43.598278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:43.598278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:43.598278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:43.598278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:43.598278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:43.598278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:43.598278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:43.598278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:43.598278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:43.598278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:43.598278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:43.598278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:43.599694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:43.599694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:43.599694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:43.599694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:43.599694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:43.599694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:43.599694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:43.599694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:43.599694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:43.599694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:43.599694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:32:43.599694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:32:43.599694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 59/115] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:32:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:32:43.600311 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050285c3-3530-4dc0-b108-52cfa76ae767 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:43.601090 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 57/116] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:32:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:32:43.602547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e3e54-d97d-482d-b003-2fcc84d4e501 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:43.624634 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:43.681381 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:43.718320 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050285c3-3530-4dc0-b108-52cfa76ae767 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:43.732151 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e3e54-d97d-482d-b003-2fcc84d4e501 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:43.754248 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870276f-1bf1-4d83-834f-bad7135d6b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:43.755404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870276f-1bf1-4d83-834f-bad7135d6b40 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:43.755687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870276f-1bf1-4d83-834f-bad7135d6b40 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:43.755962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870276f-1bf1-4d83-834f-bad7135d6b40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:43.766484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870276f-1bf1-4d83-834f-bad7135d6b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:43.767877 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87cd95-6d91-460e-ba01-3373c23091c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:43.768633 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87cd95-6d91-460e-ba01-3373c23091c4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:43.768920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87cd95-6d91-460e-ba01-3373c23091c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:43.769197 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87cd95-6d91-460e-ba01-3373c23091c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:43.771458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-6870276f-1bf1-4d83-834f-bad7135d6b40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:32:43.771458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:43.771458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:43.771458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:43.771458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:43.771458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:43.771458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:43.771458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:43.771458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:43.771458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:43.771458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:43.771458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:43.771458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:43.771458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:43.771458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:43.771458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:43.772272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:43.772272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:43.772272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:43.772272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:43.772272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:43.772272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:43.772272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:43.772272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:43.772272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:43.772272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:43.772272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:43.772272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:43.772272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:43.772272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:43.772272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:43.772272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:43.773146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:43.773146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:43.773146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:43.773146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:43.773146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:43.773146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:43.773146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:43.773146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:43.773146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:43.773146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:43.773146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:32:43.773146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:32:43.773146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 60/117] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:32:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:32:43.773760 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870276f-1bf1-4d83-834f-bad7135d6b40 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:43.785525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87cd95-6d91-460e-ba01-3373c23091c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:43.790493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ec87cd95-6d91-460e-ba01-3373c23091c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:32:43.790493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:43.790493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:43.790493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:43.790493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:43.790493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:43.790493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:43.790493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:43.790493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:43.790493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:43.790493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:43.790493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:43.790493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:43.790493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:43.790493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:43.790493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:43.791340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:43.791340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:43.791340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:43.791340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:43.791340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:43.791340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:43.791340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:43.791340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:43.791340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:43.791340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:43.791340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:43.791340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:43.791340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:43.791340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:43.791340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:43.791340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:43.792111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:43.792111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:43.792111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:43.792111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:43.792111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:43.792111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:43.792111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:43.792111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:43.792111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:43.792111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:43.792111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:32:43.792111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:32:43.792111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 58/118] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:32:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:32:43.792773 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87cd95-6d91-460e-ba01-3373c23091c4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:43.857651 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:43.884302 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870276f-1bf1-4d83-834f-bad7135d6b40 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:43.904174 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87cd95-6d91-460e-ba01-3373c23091c4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:43.921004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:43.922974 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbc91b-6929-4730-8035-82cbd3656143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:43.923604 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbc91b-6929-4730-8035-82cbd3656143 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:43.923820 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbc91b-6929-4730-8035-82cbd3656143 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:43.924096 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbc91b-6929-4730-8035-82cbd3656143 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:43.924818 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbc91b-6929-4730-8035-82cbd3656143 None admin] RBAC: Adding query filter params (name=member) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:43.925125 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbc91b-6929-4730-8035-82cbd3656143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:43.926556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbc91b-6929-4730-8035-82cbd3656143 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:43.939503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 61/119] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:32:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:43.941862 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbc91b-6929-4730-8035-82cbd3656143 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:43.949272 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef45387-58c5-4954-8710-b63a60cbffe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:43.949912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef45387-58c5-4954-8710-b63a60cbffe2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:43.950193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef45387-58c5-4954-8710-b63a60cbffe2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:43.950465 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef45387-58c5-4954-8710-b63a60cbffe2 None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:43.951607 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef45387-58c5-4954-8710-b63a60cbffe2 None admin] RBAC: Authorizing `identity:get_project(project_id=a0bc949d68f2445ca2585ec234ea2c73)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:43.953103 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef45387-58c5-4954-8710-b63a60cbffe2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:43.954888 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 59/120] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:32:43 2022] GET /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:43.960794 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef45387-58c5-4954-8710-b63a60cbffe2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:44.055851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbc91b-6929-4730-8035-82cbd3656143 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:44.064926 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef45387-58c5-4954-8710-b63a60cbffe2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:44.089721 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae012a4e-54ad-47c8-a937-413df4122ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:44.090428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae012a4e-54ad-47c8-a937-413df4122ed5 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:44.090638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae012a4e-54ad-47c8-a937-413df4122ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:44.090914 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae012a4e-54ad-47c8-a937-413df4122ed5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:44.093794 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:44.102224 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b326f-c51f-4a12-96cf-d232f0971ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:44.103038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae012a4e-54ad-47c8-a937-413df4122ed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:44.103166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b326f-c51f-4a12-96cf-d232f0971ca4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:44.103325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b326f-c51f-4a12-96cf-d232f0971ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:44.103585 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b326f-c51f-4a12-96cf-d232f0971ca4 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:44.104250 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b326f-c51f-4a12-96cf-d232f0971ca4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:44.104574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b326f-c51f-4a12-96cf-d232f0971ca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:44.105977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b326f-c51f-4a12-96cf-d232f0971ca4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:44.108323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-ae012a4e-54ad-47c8-a937-413df4122ed5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:32:44.108323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:44.108323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:44.108323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:44.108323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:44.108323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:44.108323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:44.108323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:44.108323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:44.108323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:44.108323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:44.108323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:44.108323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:44.108323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:44.108323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:44.108323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:44.109186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:44.109186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:44.109186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:44.109186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:44.109186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:44.109186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:44.109186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:44.109186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:44.109186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:44.109186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:44.109186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:44.109186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:44.109186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:44.109186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:44.109186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:44.109186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:44.109962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:44.109962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:44.109962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:44.109962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:44.109962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:44.109962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:44.109962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:44.109962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:44.109962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:44.109962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:44.109962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:32:44.109962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:32:44.115032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 62/121] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:32:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:32:44.115141 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 60/122] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:32:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:44.115748 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae012a4e-54ad-47c8-a937-413df4122ed5 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:44.115909 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b326f-c51f-4a12-96cf-d232f0971ca4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:44.166014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:44.221253 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b326f-c51f-4a12-96cf-d232f0971ca4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:44.224837 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae012a4e-54ad-47c8-a937-413df4122ed5 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:44.256352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91367a2e-9dcc-4510-a706-758edcfea023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:44.257077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91367a2e-9dcc-4510-a706-758edcfea023 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:44.257471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91367a2e-9dcc-4510-a706-758edcfea023 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:44.257742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91367a2e-9dcc-4510-a706-758edcfea023 None admin] PATH_INFO: `/v3/users/315b7d0f6889432f934c56e1f4aded84` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:44.258736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91367a2e-9dcc-4510-a706-758edcfea023 None admin] RBAC: Authorizing `identity:get_user(user_id=315b7d0f6889432f934c56e1f4aded84)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:44.259993 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2abb01-a525-4ad3-9c1d-609a9a814d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:44.260193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91367a2e-9dcc-4510-a706-758edcfea023 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:44.260919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2abb01-a525-4ad3-9c1d-609a9a814d03 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:44.261336 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2abb01-a525-4ad3-9c1d-609a9a814d03 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:44.261740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2abb01-a525-4ad3-9c1d-609a9a814d03 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:44.262144 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 61/123] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:44 2022] GET /identity/v3/users/315b7d0f6889432f934c56e1f4aded84 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:44.262716 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2abb01-a525-4ad3-9c1d-609a9a814d03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:44.262919 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91367a2e-9dcc-4510-a706-758edcfea023 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:44.263323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2abb01-a525-4ad3-9c1d-609a9a814d03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:44.264755 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2abb01-a525-4ad3-9c1d-609a9a814d03 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:44.273970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 63/124] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:32:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:44.275001 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2abb01-a525-4ad3-9c1d-609a9a814d03 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:44.334912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:44.380276 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91367a2e-9dcc-4510-a706-758edcfea023 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:44.380727 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2abb01-a525-4ad3-9c1d-609a9a814d03 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:44.395045 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:44.416722 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e6b66-2459-444e-b7a9-0311764a12f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:44.417329 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e6b66-2459-444e-b7a9-0311764a12f5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:44.417497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f92a69-b712-44dd-9f02-0eafcd19ac9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:44.417605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e6b66-2459-444e-b7a9-0311764a12f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:44.417874 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e6b66-2459-444e-b7a9-0311764a12f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:44.418099 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f92a69-b712-44dd-9f02-0eafcd19ac9b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:44.418385 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f92a69-b712-44dd-9f02-0eafcd19ac9b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:44.418602 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e6b66-2459-444e-b7a9-0311764a12f5 None admin] RBAC: Adding query filter params (role.id=4b4be11b3bbb487f996ab28b7f1bda4c, scope.project.id=a0bc949d68f2445ca2585ec234ea2c73, user.id=50eff045224d46d4a91c5eef278a418a) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:44.418692 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f92a69-b712-44dd-9f02-0eafcd19ac9b None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:44.418905 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e6b66-2459-444e-b7a9-0311764a12f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:44.419410 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f92a69-b712-44dd-9f02-0eafcd19ac9b None admin] RBAC: Adding query filter params (name=member) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:44.419718 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f92a69-b712-44dd-9f02-0eafcd19ac9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:44.420333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e6b66-2459-444e-b7a9-0311764a12f5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:44.421119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f92a69-b712-44dd-9f02-0eafcd19ac9b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:44.437254 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 62/125] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:32:44 2022] GET /identity/v3/role_assignments?user.id=50eff045224d46d4a91c5eef278a418a&scope.project.id=a0bc949d68f2445ca2585ec234ea2c73&role.id=4b4be11b3bbb487f996ab28b7f1bda4c => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:44.437254 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e6b66-2459-444e-b7a9-0311764a12f5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:44.444725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 64/126] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:32:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:44.445680 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f92a69-b712-44dd-9f02-0eafcd19ac9b None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:44.549402 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e6b66-2459-444e-b7a9-0311764a12f5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:44.584487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f92a69-b712-44dd-9f02-0eafcd19ac9b None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:44.595721 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33852b12-467d-4606-8dde-98c7dd3d4395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:44.596392 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33852b12-467d-4606-8dde-98c7dd3d4395 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:44.596751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33852b12-467d-4606-8dde-98c7dd3d4395 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:44.597285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33852b12-467d-4606-8dde-98c7dd3d4395 None admin] PATH_INFO: `/v3/users/f5c1185c0be14e5a840b375a991df2d8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:44.598602 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33852b12-467d-4606-8dde-98c7dd3d4395 None admin] RBAC: Authorizing `identity:get_user(user_id=f5c1185c0be14e5a840b375a991df2d8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:44.600885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33852b12-467d-4606-8dde-98c7dd3d4395 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:44.603399 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 63/127] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:44 2022] GET /identity/v3/users/f5c1185c0be14e5a840b375a991df2d8 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:44.604285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33852b12-467d-4606-8dde-98c7dd3d4395 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:44.609818 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:44.627102 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37360217-453c-4baa-942e-706c68ab2a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:44.628154 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37360217-453c-4baa-942e-706c68ab2a07 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:44.628681 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37360217-453c-4baa-942e-706c68ab2a07 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:44.629032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37360217-453c-4baa-942e-706c68ab2a07 None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:44.630243 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37360217-453c-4baa-942e-706c68ab2a07 None admin] RBAC: Authorizing `identity:get_project(project_id=a0bc949d68f2445ca2585ec234ea2c73)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:44.631740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37360217-453c-4baa-942e-706c68ab2a07 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:44.633545 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 65/128] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:32:44 2022] GET /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:44.634150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37360217-453c-4baa-942e-706c68ab2a07 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:44.659809 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:44.745130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33852b12-467d-4606-8dde-98c7dd3d4395 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:44.761575 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37360217-453c-4baa-942e-706c68ab2a07 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:44.792333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33568b-1860-4f24-acee-ff8b4222e728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:44.793360 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33568b-1860-4f24-acee-ff8b4222e728 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:44.793834 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33568b-1860-4f24-acee-ff8b4222e728 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:44.794296 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33568b-1860-4f24-acee-ff8b4222e728 None admin] PATH_INFO: `/v3/users/315b7d0f6889432f934c56e1f4aded84` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:44.795627 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33568b-1860-4f24-acee-ff8b4222e728 None admin] RBAC: Authorizing `identity:get_user(user_id=315b7d0f6889432f934c56e1f4aded84)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:44.797382 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33568b-1860-4f24-acee-ff8b4222e728 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:44.797641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb2815-403e-4492-9f04-668e294498a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:44.798288 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb2815-403e-4492-9f04-668e294498a1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:44.798572 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb2815-403e-4492-9f04-668e294498a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:44.798850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb2815-403e-4492-9f04-668e294498a1 None admin] PATH_INFO: `/v3/users/315b7d0f6889432f934c56e1f4aded84` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:44.800022 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 64/129] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:44 2022] GET /identity/v3/users/315b7d0f6889432f934c56e1f4aded84 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:44.805229 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb2815-403e-4492-9f04-668e294498a1 None admin] RBAC: Authorizing `identity:get_user(user_id=315b7d0f6889432f934c56e1f4aded84)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:44.805229 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb2815-403e-4492-9f04-668e294498a1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:44.805229 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 66/130] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:44 2022] GET /identity/v3/users/315b7d0f6889432f934c56e1f4aded84 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:44.805229 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb2815-403e-4492-9f04-668e294498a1 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:44.806544 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33568b-1860-4f24-acee-ff8b4222e728 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:44.885457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:44.932349 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33568b-1860-4f24-acee-ff8b4222e728 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:44.937921 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb2815-403e-4492-9f04-668e294498a1 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:44.949237 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:44.974870 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307cfe0-0ff9-44a1-aea1-96a995cd14ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:44.975570 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307cfe0-0ff9-44a1-aea1-96a995cd14ad None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:44.975931 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307cfe0-0ff9-44a1-aea1-96a995cd14ad None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:44.976212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307cfe0-0ff9-44a1-aea1-96a995cd14ad None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:44.976798 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fbdb9-e25a-4344-9817-2ab9180c0c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:44.977371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307cfe0-0ff9-44a1-aea1-96a995cd14ad None admin] RBAC: Authorizing `identity:get_project(project_id=a0bc949d68f2445ca2585ec234ea2c73)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:44.977989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fbdb9-e25a-4344-9817-2ab9180c0c7e None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:44.978463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fbdb9-e25a-4344-9817-2ab9180c0c7e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:44.978832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307cfe0-0ff9-44a1-aea1-96a995cd14ad None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:44.979150 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fbdb9-e25a-4344-9817-2ab9180c0c7e None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73/users/315b7d0f6889432f934c56e1f4aded84/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:44.985066 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 67/131] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:32:44 2022] GET /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:44.985066 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307cfe0-0ff9-44a1-aea1-96a995cd14ad None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:44.986617 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8fbdb9-e25a-4344-9817-2ab9180c0c7e None admin] RBAC: Authorizing `identity:create_grant(project_id=a0bc949d68f2445ca2585ec234ea2c73, user_id=315b7d0f6889432f934c56e1f4aded84, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:44.988284 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8fbdb9-e25a-4344-9817-2ab9180c0c7e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:45.006288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 65/132] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:32:44 2022] PUT /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73/users/315b7d0f6889432f934c56e1f4aded84/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:32:45.007445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fbdb9-e25a-4344-9817-2ab9180c0c7e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:45.126167 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307cfe0-0ff9-44a1-aea1-96a995cd14ad None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:45.154753 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:45.170300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7235db-cae9-49e5-a8c9-cddc44a6e2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:45.171382 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7235db-cae9-49e5-a8c9-cddc44a6e2e5 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:45.171891 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7235db-cae9-49e5-a8c9-cddc44a6e2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:45.172367 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7235db-cae9-49e5-a8c9-cddc44a6e2e5 None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:45.173921 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7235db-cae9-49e5-a8c9-cddc44a6e2e5 None admin] RBAC: Authorizing `identity:get_project(project_id=a0bc949d68f2445ca2585ec234ea2c73)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:45.175632 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7235db-cae9-49e5-a8c9-cddc44a6e2e5 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:45.177716 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 68/133] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:32:44 2022] GET /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:45.178841 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7235db-cae9-49e5-a8c9-cddc44a6e2e5 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:45.221705 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fbdb9-e25a-4344-9817-2ab9180c0c7e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:45.276258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05c17e-659d-49c6-ac1a-c0e561dd2d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:45.276931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05c17e-659d-49c6-ac1a-c0e561dd2d93 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:45.277216 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05c17e-659d-49c6-ac1a-c0e561dd2d93 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:45.277493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05c17e-659d-49c6-ac1a-c0e561dd2d93 None admin] PATH_INFO: `/v3/projects/703306e79b234fb4a5f9169f09560dee` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:45.278657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05c17e-659d-49c6-ac1a-c0e561dd2d93 None admin] RBAC: Authorizing `identity:get_project(project_id=703306e79b234fb4a5f9169f09560dee)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:45.280124 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05c17e-659d-49c6-ac1a-c0e561dd2d93 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:45.282258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 66/134] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:32:45 2022] GET /identity/v3/projects/703306e79b234fb4a5f9169f09560dee => generated 312 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:45.283138 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05c17e-659d-49c6-ac1a-c0e561dd2d93 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:45.312731 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7235db-cae9-49e5-a8c9-cddc44a6e2e5 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:45.337843 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:45.357533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42b8df-9b7f-46bb-bd6b-52e70be09371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:45.358520 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42b8df-9b7f-46bb-bd6b-52e70be09371 None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:45.358809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42b8df-9b7f-46bb-bd6b-52e70be09371 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:45.359361 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42b8df-9b7f-46bb-bd6b-52e70be09371 None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73/users/f5c1185c0be14e5a840b375a991df2d8/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:45.361802 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42b8df-9b7f-46bb-bd6b-52e70be09371 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0bc949d68f2445ca2585ec234ea2c73, user_id=f5c1185c0be14e5a840b375a991df2d8, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:45.363541 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42b8df-9b7f-46bb-bd6b-52e70be09371 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:45.383204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 69/135] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:32:45 2022] PUT /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73/users/f5c1185c0be14e5a840b375a991df2d8/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:32:45.384610 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110aa43-4467-4f62-b93a-52fe08bd9176 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:45.385076 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110aa43-4467-4f62-b93a-52fe08bd9176 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:45.385361 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110aa43-4467-4f62-b93a-52fe08bd9176 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:45.387348 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 70/136] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:45.392625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110aa43-4467-4f62-b93a-52fe08bd9176 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:45.413763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05c17e-659d-49c6-ac1a-c0e561dd2d93 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:45.464968 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2663e-d9c8-465d-9b44-eb1c73c38463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:45.465650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2663e-d9c8-465d-9b44-eb1c73c38463 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:45.465934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2663e-d9c8-465d-9b44-eb1c73c38463 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:45.466213 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2663e-d9c8-465d-9b44-eb1c73c38463 None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73/users/315b7d0f6889432f934c56e1f4aded84/roles/30f1e6f9ddb649d2804d9128b17348f6` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:45.468461 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2663e-d9c8-465d-9b44-eb1c73c38463 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0bc949d68f2445ca2585ec234ea2c73, user_id=315b7d0f6889432f934c56e1f4aded84, role_id=30f1e6f9ddb649d2804d9128b17348f6)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:45.469378 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:45.470040 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2663e-d9c8-465d-9b44-eb1c73c38463 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:45.498195 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 67/137] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:32:45 2022] PUT /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73/users/315b7d0f6889432f934c56e1f4aded84/roles/30f1e6f9ddb649d2804d9128b17348f6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:32:45.501720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11e7d8-2cf9-4798-89fe-a7d08fd63501 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:45.502013 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11e7d8-2cf9-4798-89fe-a7d08fd63501 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:45.502295 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11e7d8-2cf9-4798-89fe-a7d08fd63501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:45.543795 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4f11e7d8-2cf9-4798-89fe-a7d08fd63501 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:45.548220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4f11e7d8-2cf9-4798-89fe-a7d08fd63501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:45.597379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110aa43-4467-4f62-b93a-52fe08bd9176 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:45.673343 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f1449-66a6-4f2f-9b6d-82446ba428bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:45.673945 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f1449-66a6-4f2f-9b6d-82446ba428bb None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:45.674232 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f1449-66a6-4f2f-9b6d-82446ba428bb None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:45.674516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f1449-66a6-4f2f-9b6d-82446ba428bb None admin] PATH_INFO: `/v3/projects/703306e79b234fb4a5f9169f09560dee/users/315b7d0f6889432f934c56e1f4aded84/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:45.678303 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f1449-66a6-4f2f-9b6d-82446ba428bb None admin] RBAC: Authorizing `identity:create_grant(project_id=703306e79b234fb4a5f9169f09560dee, user_id=315b7d0f6889432f934c56e1f4aded84, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:45.681230 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f1449-66a6-4f2f-9b6d-82446ba428bb None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:45.702522 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 68/138] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:45.704830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 71/139] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:32:45 2022] PUT /identity/v3/projects/703306e79b234fb4a5f9169f09560dee/users/315b7d0f6889432f934c56e1f4aded84/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:32:46.166199 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11e7d8-2cf9-4798-89fe-a7d08fd63501 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:46.204421 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:46.280401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11e7d8-2cf9-4798-89fe-a7d08fd63501 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:46.314716 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9f3b2-6490-4f20-bf2e-8d54d05eec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:46.315451 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9f3b2-6490-4f20-bf2e-8d54d05eec29 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:46.315742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9f3b2-6490-4f20-bf2e-8d54d05eec29 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:46.316019 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9f3b2-6490-4f20-bf2e-8d54d05eec29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:46.317177 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9f3b2-6490-4f20-bf2e-8d54d05eec29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:46.318622 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9f3b2-6490-4f20-bf2e-8d54d05eec29 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:46.320195 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 69/140] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:32:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:46.325761 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f1449-66a6-4f2f-9b6d-82446ba428bb None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:46.453529 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f1449-66a6-4f2f-9b6d-82446ba428bb None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:46.470476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:46.497143 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1f68e-d84c-4236-a9bb-c307fff04267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:46.498078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1f68e-d84c-4236-a9bb-c307fff04267 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:46.498547 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1f68e-d84c-4236-a9bb-c307fff04267 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:46.499045 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1f68e-d84c-4236-a9bb-c307fff04267 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:46.499896 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1f68e-d84c-4236-a9bb-c307fff04267 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:46.501928 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1f68e-d84c-4236-a9bb-c307fff04267 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:46.536688 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 72/141] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 10:32:46 2022] POST /identity/v3/users => generated 283 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:32:47.404712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa51f76-9b7b-43d8-b098-df65094eb34b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:47.405209 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa51f76-9b7b-43d8-b098-df65094eb34b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:47.405313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa51f76-9b7b-43d8-b098-df65094eb34b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:47.406625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 70/142] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:47.412067 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d8516-fa7d-4c8d-bef2-789201a9820a None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:47.412473 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d8516-fa7d-4c8d-bef2-789201a9820a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:47.412659 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d8516-fa7d-4c8d-bef2-789201a9820a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:47.437583 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-496d8516-fa7d-4c8d-bef2-789201a9820a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:47.438825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-496d8516-fa7d-4c8d-bef2-789201a9820a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:47.511566 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 73/143] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:47.946379 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa51f76-9b7b-43d8-b098-df65094eb34b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:47.999403 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed34626-816a-41c1-8f31-d71f0f4eb41f None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:47.999715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed34626-816a-41c1-8f31-d71f0f4eb41f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:47.999875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed34626-816a-41c1-8f31-d71f0f4eb41f None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:48.001409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 74/144] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:48.007019 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970813e-0dd8-4c5a-af5f-ca6140b42f94 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:48.007304 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970813e-0dd8-4c5a-af5f-ca6140b42f94 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:48.007586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970813e-0dd8-4c5a-af5f-ca6140b42f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:48.034597 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-0970813e-0dd8-4c5a-af5f-ca6140b42f94 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:48.036321 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0970813e-0dd8-4c5a-af5f-ca6140b42f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:48.124215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:48.135585 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa51f76-9b7b-43d8-b098-df65094eb34b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:48.183064 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 75/145] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:32:48.211251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232e093-86d8-4057-9670-0189112ae35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:48.211896 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232e093-86d8-4057-9670-0189112ae35a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:48.212181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232e093-86d8-4057-9670-0189112ae35a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:48.212459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232e093-86d8-4057-9670-0189112ae35a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:48.230902 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232e093-86d8-4057-9670-0189112ae35a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:48.235861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-3232e093-86d8-4057-9670-0189112ae35a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 10:32:48.235861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:48.235861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:48.235861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:48.235861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:48.235861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:48.235861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:48.235861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:48.235861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:48.235861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:48.235861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:48.235861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:48.235861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:48.235861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:48.235861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:48.235861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:48.236706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:48.236706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:48.236706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:48.236706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:48.236706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:48.236706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:48.236706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:48.236706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:48.236706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:48.236706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:48.236706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:48.236706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:48.236706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:48.236706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:48.236706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:48.236706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:48.237537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:48.237537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:48.237537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:48.237537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:48.237537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:48.237537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:48.237537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:48.237537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:48.237537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:48.237537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:48.237537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 10:32:48.237537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:32:48.237537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 71/146] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:32:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:32:48.243075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970813e-0dd8-4c5a-af5f-ca6140b42f94 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:48.285692 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:48.390389 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970813e-0dd8-4c5a-af5f-ca6140b42f94 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:48.436995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fd01c-a4ac-42e0-bacc-d8d1f6c4f925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:48.437612 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fd01c-a4ac-42e0-bacc-d8d1f6c4f925 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:48.437888 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fd01c-a4ac-42e0-bacc-d8d1f6c4f925 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:48.438162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fd01c-a4ac-42e0-bacc-d8d1f6c4f925 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:48.438850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fd01c-a4ac-42e0-bacc-d8d1f6c4f925 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:48.439155 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fd01c-a4ac-42e0-bacc-d8d1f6c4f925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:48.440578 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fd01c-a4ac-42e0-bacc-d8d1f6c4f925 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:48.454280 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 76/147] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:32:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:48.460183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232e093-86d8-4057-9670-0189112ae35a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:48.621667 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232e093-86d8-4057-9670-0189112ae35a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:48.672742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac88c91-8680-4a98-a576-8f05f1e9b8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:48.673390 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac88c91-8680-4a98-a576-8f05f1e9b8db None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:48.673678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac88c91-8680-4a98-a576-8f05f1e9b8db None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:48.673963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac88c91-8680-4a98-a576-8f05f1e9b8db None admin] PATH_INFO: `/v3/users/50eff045224d46d4a91c5eef278a418a` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:48.676223 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac88c91-8680-4a98-a576-8f05f1e9b8db None admin] RBAC: Authorizing `identity:get_user(user_id=50eff045224d46d4a91c5eef278a418a)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:48.677783 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac88c91-8680-4a98-a576-8f05f1e9b8db None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:48.679990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 72/148] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:48 2022] GET /identity/v3/users/50eff045224d46d4a91c5eef278a418a => generated 289 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:48.685458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fd01c-a4ac-42e0-bacc-d8d1f6c4f925 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:48.751012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65256b-a206-4d86-9042-d56862cdb42e None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:48.751551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65256b-a206-4d86-9042-d56862cdb42e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:48.751980 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65256b-a206-4d86-9042-d56862cdb42e None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:48.753658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 73/149] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:48.762279 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb08a0-4525-4608-a2f8-613e0a90dfc0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:48.762795 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb08a0-4525-4608-a2f8-613e0a90dfc0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:48.763220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb08a0-4525-4608-a2f8-613e0a90dfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:48.801809 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-36eb08a0-4525-4608-a2f8-613e0a90dfc0 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:48.803242 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-36eb08a0-4525-4608-a2f8-613e0a90dfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:48.838499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:48.849091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:48.852901 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fd01c-a4ac-42e0-bacc-d8d1f6c4f925 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:48.917374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b41e8-75cd-42a8-8e46-9b1d6f0f19e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:48.917947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b41e8-75cd-42a8-8e46-9b1d6f0f19e4 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:48.918231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b41e8-75cd-42a8-8e46-9b1d6f0f19e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:48.918511 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b41e8-75cd-42a8-8e46-9b1d6f0f19e4 None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:48.919733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b41e8-75cd-42a8-8e46-9b1d6f0f19e4 None admin] RBAC: Authorizing `identity:get_project(project_id=a0bc949d68f2445ca2585ec234ea2c73)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:48.921245 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b41e8-75cd-42a8-8e46-9b1d6f0f19e4 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:48.923227 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 77/150] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:32:48 2022] GET /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:48.924004 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b41e8-75cd-42a8-8e46-9b1d6f0f19e4 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:48.945417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 74/151] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:32:48.947003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241972c-ef5b-4ce9-96b6-7ec28072fbb2 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:48.947509 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241972c-ef5b-4ce9-96b6-7ec28072fbb2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:48.948064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241972c-ef5b-4ce9-96b6-7ec28072fbb2 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:48.949574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 75/152] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:48.950598 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241972c-ef5b-4ce9-96b6-7ec28072fbb2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:49.032830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b41e8-75cd-42a8-8e46-9b1d6f0f19e4 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:49.086794 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575ea32-21d0-431a-84b8-46253d4a52ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:49.087722 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575ea32-21d0-431a-84b8-46253d4a52ce None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:49.088131 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575ea32-21d0-431a-84b8-46253d4a52ce None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:49.088523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575ea32-21d0-431a-84b8-46253d4a52ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:49.111479 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575ea32-21d0-431a-84b8-46253d4a52ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:49.122082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-2575ea32-21d0-431a-84b8-46253d4a52ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:32:49.122082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:49.122082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:49.122082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:49.122082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:49.122082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:49.122082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:49.122082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:49.122082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:49.122082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:49.122082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:49.122082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:49.122082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:49.122082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:49.122082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:49.122082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:49.123235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:49.123235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:49.123235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:49.123235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:49.123235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:49.123235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:49.123235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:49.123235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:49.123235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:49.123235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:49.123235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:49.123235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:49.123235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:49.123235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:49.123235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:49.123235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:49.124138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:49.124138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:49.124138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:49.124138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:49.124138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:49.124138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:49.124138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:49.124138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:49.124138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:49.124138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:49.124138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:32:49.124138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:32:49.126589 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 78/153] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:32:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:32:49.127958 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b91a2-589b-4576-b3c2-bb8d1180748a None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:49.128422 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b91a2-589b-4576-b3c2-bb8d1180748a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:49.128899 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b91a2-589b-4576-b3c2-bb8d1180748a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:49.147220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241972c-ef5b-4ce9-96b6-7ec28072fbb2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:49.159049 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-fb8b91a2-589b-4576-b3c2-bb8d1180748a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:49.159401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fb8b91a2-589b-4576-b3c2-bb8d1180748a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:49.178529 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:49.230276 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90c551-11f1-4954-8948-4b6b9462376d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:49.231195 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90c551-11f1-4954-8948-4b6b9462376d None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:49.231617 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90c551-11f1-4954-8948-4b6b9462376d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:49.232053 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90c551-11f1-4954-8948-4b6b9462376d None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73/users/50eff045224d46d4a91c5eef278a418a/roles/4b4be11b3bbb487f996ab28b7f1bda4c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:49.237819 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90c551-11f1-4954-8948-4b6b9462376d None admin] RBAC: Authorizing `identity:create_grant(project_id=a0bc949d68f2445ca2585ec234ea2c73, user_id=50eff045224d46d4a91c5eef278a418a, role_id=4b4be11b3bbb487f996ab28b7f1bda4c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:49.239810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90c551-11f1-4954-8948-4b6b9462376d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:49.259137 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 79/154] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:49.260308 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b91a2-589b-4576-b3c2-bb8d1180748a None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:49.267690 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 76/155] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:32:48 2022] PUT /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73/users/50eff045224d46d4a91c5eef278a418a/roles/4b4be11b3bbb487f996ab28b7f1bda4c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:32:49.269218 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5715-b6e6-45aa-b336-7fa8c26f4d6f None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:49.269674 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5715-b6e6-45aa-b336-7fa8c26f4d6f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:49.270102 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5715-b6e6-45aa-b336-7fa8c26f4d6f None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:49.272099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 77/156] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:49.280359 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fb812-0457-425b-b2e3-2fcfe4b257a9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:49.280936 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fb812-0457-425b-b2e3-2fcfe4b257a9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:49.281381 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fb812-0457-425b-b2e3-2fcfe4b257a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:49.317711 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d83fb812-0457-425b-b2e3-2fcfe4b257a9 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:49.319255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d83fb812-0457-425b-b2e3-2fcfe4b257a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:49.346467 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:49.369508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b91a2-589b-4576-b3c2-bb8d1180748a None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:49.406983 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829c2a6-b0d9-4ed9-b203-65d2db84291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:49.407607 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829c2a6-b0d9-4ed9-b203-65d2db84291f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:49.407889 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829c2a6-b0d9-4ed9-b203-65d2db84291f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:49.408161 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829c2a6-b0d9-4ed9-b203-65d2db84291f None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:49.408865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829c2a6-b0d9-4ed9-b203-65d2db84291f None admin] RBAC: Adding query filter params (name=member) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:49.409171 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829c2a6-b0d9-4ed9-b203-65d2db84291f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:49.410559 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829c2a6-b0d9-4ed9-b203-65d2db84291f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:49.419627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 80/157] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:32:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:49.427384 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829c2a6-b0d9-4ed9-b203-65d2db84291f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:49.448140 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:49.477126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 78/158] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:32:49.527033 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fb812-0457-425b-b2e3-2fcfe4b257a9 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:49.607368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829c2a6-b0d9-4ed9-b203-65d2db84291f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:49.688063 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fb812-0457-425b-b2e3-2fcfe4b257a9 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:49.694099 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba8fc1-776c-452b-8506-421b337c4079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:49.694751 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba8fc1-776c-452b-8506-421b337c4079 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:49.695028 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba8fc1-776c-452b-8506-421b337c4079 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:49.695304 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba8fc1-776c-452b-8506-421b337c4079 None admin] PATH_INFO: `/v3/users/315b7d0f6889432f934c56e1f4aded84` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:49.698279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba8fc1-776c-452b-8506-421b337c4079 None admin] RBAC: Authorizing `identity:get_user(user_id=315b7d0f6889432f934c56e1f4aded84)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:49.702754 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba8fc1-776c-452b-8506-421b337c4079 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:49.704416 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 81/159] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:49 2022] GET /identity/v3/users/315b7d0f6889432f934c56e1f4aded84 => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:32:49.717151 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba8fc1-776c-452b-8506-421b337c4079 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:49.769612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff077c8-3900-4b18-add8-a668eefa96d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:49.770341 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff077c8-3900-4b18-add8-a668eefa96d3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:49.770624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff077c8-3900-4b18-add8-a668eefa96d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:49.770895 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff077c8-3900-4b18-add8-a668eefa96d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:49.797449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff077c8-3900-4b18-add8-a668eefa96d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:49.802967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-5ff077c8-3900-4b18-add8-a668eefa96d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:32:49.802967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:49.802967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:49.802967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:49.802967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:49.802967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:49.802967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:49.802967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:49.802967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:49.802967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:49.802967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:49.802967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:49.802967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:49.802967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:49.802967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:49.802967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:49.803912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:49.803912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:49.803912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:49.803912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:49.803912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:49.803912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:49.803912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:49.803912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:49.803912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:49.803912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:49.803912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:49.803912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:49.803912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:49.803912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:49.803912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:49.803912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:49.804787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:49.804787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:49.804787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:49.804787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:49.804787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:49.804787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:49.804787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:49.804787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:49.804787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:49.804787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:49.804787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:32:49.804787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:32:49.804787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 79/160] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:32:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:32:49.834940 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff077c8-3900-4b18-add8-a668eefa96d3 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:49.848069 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:49.861469 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:49.883586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba8fc1-776c-452b-8506-421b337c4079 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:49.920643 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f56cb-3d36-4ee5-a60e-a609c0f36792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:49.920643 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f56cb-3d36-4ee5-a60e-a609c0f36792 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:49.920643 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f56cb-3d36-4ee5-a60e-a609c0f36792 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:49.920643 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f56cb-3d36-4ee5-a60e-a609c0f36792 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:49.992681 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f56cb-3d36-4ee5-a60e-a609c0f36792 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:49.993908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f56cb-3d36-4ee5-a60e-a609c0f36792 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:50.036927 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff077c8-3900-4b18-add8-a668eefa96d3 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:50.092377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874ba53-be99-441b-bf92-c83556c12d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:50.093373 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874ba53-be99-441b-bf92-c83556c12d41 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:50.093887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874ba53-be99-441b-bf92-c83556c12d41 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:50.094359 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874ba53-be99-441b-bf92-c83556c12d41 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:50.095240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874ba53-be99-441b-bf92-c83556c12d41 None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:50.095738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874ba53-be99-441b-bf92-c83556c12d41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:50.097671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874ba53-be99-441b-bf92-c83556c12d41 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:50.110991 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 80/161] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:32:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:32:50.112182 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874ba53-be99-441b-bf92-c83556c12d41 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:50.119487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:50.162454 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 82/162] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:32:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:32:50.163323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f56cb-3d36-4ee5-a60e-a609c0f36792 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:50.245003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:50.330565 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874ba53-be99-441b-bf92-c83556c12d41 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:50.365550 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f56cb-3d36-4ee5-a60e-a609c0f36792 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:50.401901 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fea12-5f62-4151-ae94-064f70279941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:50.402550 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fea12-5f62-4151-ae94-064f70279941 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:50.402832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fea12-5f62-4151-ae94-064f70279941 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:50.403104 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fea12-5f62-4151-ae94-064f70279941 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:50.421939 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fea12-5f62-4151-ae94-064f70279941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:50.428570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-438fea12-5f62-4151-ae94-064f70279941 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:32:50.428570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:50.428570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:50.428570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:50.428570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:50.428570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:50.428570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:50.428570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:50.428570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:50.428570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:50.428570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:50.428570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:50.428570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:50.428570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:50.428570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:50.428570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:50.429448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:50.429448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:50.429448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:50.429448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:50.429448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:50.429448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:50.429448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:50.429448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:50.429448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:50.429448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:50.429448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:50.429448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:50.429448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:50.429448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:50.429448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:50.429448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:50.430219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:50.430219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:50.430219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:50.430219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:50.430219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:50.430219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:50.430219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:50.430219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:50.430219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:50.430219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:50.430219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:32:50.430219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:32:50.430219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 81/163] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:32:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:32:50.435276 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fea12-5f62-4151-ae94-064f70279941 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:50.437212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c63505-f3d9-4ad4-8964-15286230c3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:50.437870 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c63505-f3d9-4ad4-8964-15286230c3c4 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:50.438157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c63505-f3d9-4ad4-8964-15286230c3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:50.438435 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c63505-f3d9-4ad4-8964-15286230c3c4 None admin] PATH_INFO: `/v3/users/315b7d0f6889432f934c56e1f4aded84` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:50.439892 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c63505-f3d9-4ad4-8964-15286230c3c4 None admin] RBAC: Authorizing `identity:get_user(user_id=315b7d0f6889432f934c56e1f4aded84)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:50.441441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c63505-f3d9-4ad4-8964-15286230c3c4 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:50.443749 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 83/164] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:50 2022] GET /identity/v3/users/315b7d0f6889432f934c56e1f4aded84 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:50.444341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c63505-f3d9-4ad4-8964-15286230c3c4 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:50.532981 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:50.615064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fea12-5f62-4151-ae94-064f70279941 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:50.632247 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c63505-f3d9-4ad4-8964-15286230c3c4 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:50.672896 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:50.679780 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aaeb56-1cd1-45c6-8291-52c124ed61b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:50.680433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaeb56-1cd1-45c6-8291-52c124ed61b8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:50.680748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaeb56-1cd1-45c6-8291-52c124ed61b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:50.681027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaeb56-1cd1-45c6-8291-52c124ed61b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:50.701737 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccd81b-fad6-49b8-bed4-6e2ec0e3ca04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:50.702446 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccd81b-fad6-49b8-bed4-6e2ec0e3ca04 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:50.702732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccd81b-fad6-49b8-bed4-6e2ec0e3ca04 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:50.703008 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccd81b-fad6-49b8-bed4-6e2ec0e3ca04 None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:50.704007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aaeb56-1cd1-45c6-8291-52c124ed61b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:50.709517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-d0aaeb56-1cd1-45c6-8291-52c124ed61b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:32:50.709517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:50.709517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:50.709517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:50.709517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:50.709517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:50.709517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:50.709517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:50.709517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:50.709517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:50.709517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:50.709517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:50.709517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:50.709517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:50.709517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:50.709517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:50.710367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:50.710367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:50.710367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:50.710367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:50.710367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:50.710367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:50.710367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:50.710367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:50.710367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:50.710367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:50.710367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:50.710367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:50.710367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:50.710367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:50.710367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:50.710367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:50.711137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:50.711137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:50.711137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:50.711137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:50.711137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:50.711137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:50.711137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:50.711137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:50.711137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:50.711137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:50.711137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:32:50.711137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:32:50.711137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 82/165] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:32:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:32:50.711786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aaeb56-1cd1-45c6-8291-52c124ed61b8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:50.712621 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccd81b-fad6-49b8-bed4-6e2ec0e3ca04 None admin] RBAC: Authorizing `identity:get_project(project_id=a0bc949d68f2445ca2585ec234ea2c73)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:50.714145 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccd81b-fad6-49b8-bed4-6e2ec0e3ca04 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:50.716288 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 84/166] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:32:50 2022] GET /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:50.717131 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccd81b-fad6-49b8-bed4-6e2ec0e3ca04 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:50.898961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccd81b-fad6-49b8-bed4-6e2ec0e3ca04 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:50.911755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aaeb56-1cd1-45c6-8291-52c124ed61b8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:50.927307 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:50.963182 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e751f-6178-42ce-a780-3521ba67f4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:50.963798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e751f-6178-42ce-a780-3521ba67f4e5 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:50.964078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e751f-6178-42ce-a780-3521ba67f4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:50.964352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e751f-6178-42ce-a780-3521ba67f4e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:50.972289 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc7081-dd07-40fa-870f-16afe94d854f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:50.972930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc7081-dd07-40fa-870f-16afe94d854f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:50.973727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc7081-dd07-40fa-870f-16afe94d854f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:50.974003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc7081-dd07-40fa-870f-16afe94d854f None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:50.978964 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc7081-dd07-40fa-870f-16afe94d854f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:50.979286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc7081-dd07-40fa-870f-16afe94d854f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:50.980718 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc7081-dd07-40fa-870f-16afe94d854f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:50.993676 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 83/167] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:32:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:50.994494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc7081-dd07-40fa-870f-16afe94d854f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:51.056141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e751f-6178-42ce-a780-3521ba67f4e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:51.057784 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e751f-6178-42ce-a780-3521ba67f4e5 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:51.079698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:51.159353 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc7081-dd07-40fa-870f-16afe94d854f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:51.170309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 85/168] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:32:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:32:51.171609 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e751f-6178-42ce-a780-3521ba67f4e5 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:51.200974 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:51.222841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06be708-f6e0-49f0-9b69-f6c54b52f33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:51.224093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06be708-f6e0-49f0-9b69-f6c54b52f33b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:51.224390 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06be708-f6e0-49f0-9b69-f6c54b52f33b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:51.224643 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06be708-f6e0-49f0-9b69-f6c54b52f33b None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:51.225375 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06be708-f6e0-49f0-9b69-f6c54b52f33b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:51.225677 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06be708-f6e0-49f0-9b69-f6c54b52f33b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:51.227069 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06be708-f6e0-49f0-9b69-f6c54b52f33b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:51.235726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 84/169] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:32:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:51.236566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06be708-f6e0-49f0-9b69-f6c54b52f33b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:51.281996 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e751f-6178-42ce-a780-3521ba67f4e5 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:51.320811 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2a443-6ca6-4179-b7ea-b1bea5d8803a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:51.321769 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2a443-6ca6-4179-b7ea-b1bea5d8803a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:51.322271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2a443-6ca6-4179-b7ea-b1bea5d8803a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:51.322737 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2a443-6ca6-4179-b7ea-b1bea5d8803a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:51.323755 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2a443-6ca6-4179-b7ea-b1bea5d8803a None admin] RBAC: Adding query filter params (role.id=344db47133bb4fb2843696759f71b2c7, scope.project.id=a0bc949d68f2445ca2585ec234ea2c73, user.id=315b7d0f6889432f934c56e1f4aded84) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:51.324324 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2a443-6ca6-4179-b7ea-b1bea5d8803a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:51.325991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2a443-6ca6-4179-b7ea-b1bea5d8803a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:51.332398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 86/170] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:32:51 2022] GET /identity/v3/role_assignments?user.id=315b7d0f6889432f934c56e1f4aded84&scope.project.id=a0bc949d68f2445ca2585ec234ea2c73&role.id=344db47133bb4fb2843696759f71b2c7 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:51.334171 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2a443-6ca6-4179-b7ea-b1bea5d8803a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:51.407384 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06be708-f6e0-49f0-9b69-f6c54b52f33b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:51.435894 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:51.444950 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:51.489328 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2a443-6ca6-4179-b7ea-b1bea5d8803a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:51.489982 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb24b54-e56f-4d62-8ede-37fa0e308b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:51.490668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb24b54-e56f-4d62-8ede-37fa0e308b19 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:51.490952 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb24b54-e56f-4d62-8ede-37fa0e308b19 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:51.491231 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb24b54-e56f-4d62-8ede-37fa0e308b19 None admin] PATH_INFO: `/v3/users/315b7d0f6889432f934c56e1f4aded84` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:51.497545 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb24b54-e56f-4d62-8ede-37fa0e308b19 None admin] RBAC: Authorizing `identity:get_user(user_id=315b7d0f6889432f934c56e1f4aded84)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:51.499067 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb24b54-e56f-4d62-8ede-37fa0e308b19 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:51.500871 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 85/171] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:51 2022] GET /identity/v3/users/315b7d0f6889432f934c56e1f4aded84 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:51.501676 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb24b54-e56f-4d62-8ede-37fa0e308b19 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:51.621333 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92119bb2-c418-4493-ac22-9c3ddba6acf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:51.622092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119bb2-c418-4493-ac22-9c3ddba6acf7 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:51.622277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119bb2-c418-4493-ac22-9c3ddba6acf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:51.622542 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119bb2-c418-4493-ac22-9c3ddba6acf7 None admin] PATH_INFO: `/v3/projects/703306e79b234fb4a5f9169f09560dee` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:51.625277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92119bb2-c418-4493-ac22-9c3ddba6acf7 None admin] RBAC: Authorizing `identity:get_project(project_id=703306e79b234fb4a5f9169f09560dee)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:51.626765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92119bb2-c418-4493-ac22-9c3ddba6acf7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:51.628504 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 87/172] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:32:51 2022] GET /identity/v3/projects/703306e79b234fb4a5f9169f09560dee => generated 312 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:51.629414 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92119bb2-c418-4493-ac22-9c3ddba6acf7 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:51.680010 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb24b54-e56f-4d62-8ede-37fa0e308b19 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:51.747453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff8629-6d63-4d02-96da-389cf8db1b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:51.748092 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff8629-6d63-4d02-96da-389cf8db1b6d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:51.748371 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff8629-6d63-4d02-96da-389cf8db1b6d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:51.748673 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff8629-6d63-4d02-96da-389cf8db1b6d None admin] PATH_INFO: `/v3/users/f5c1185c0be14e5a840b375a991df2d8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:51.749828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff8629-6d63-4d02-96da-389cf8db1b6d None admin] RBAC: Authorizing `identity:get_user(user_id=f5c1185c0be14e5a840b375a991df2d8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:51.751494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff8629-6d63-4d02-96da-389cf8db1b6d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:51.753380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 86/173] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:51 2022] GET /identity/v3/users/f5c1185c0be14e5a840b375a991df2d8 => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:51.755116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff8629-6d63-4d02-96da-389cf8db1b6d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:51.812214 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92119bb2-c418-4493-ac22-9c3ddba6acf7 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:51.822116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:51.860430 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f35a74-23e8-4c28-a4e9-62982136f573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:51.861231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f35a74-23e8-4c28-a4e9-62982136f573 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:51.861564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f35a74-23e8-4c28-a4e9-62982136f573 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:51.861898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f35a74-23e8-4c28-a4e9-62982136f573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:51.880078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:51.903294 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff8629-6d63-4d02-96da-389cf8db1b6d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:51.945777 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668c9f2-8a08-454a-b9eb-e08da28302b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:51.946412 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668c9f2-8a08-454a-b9eb-e08da28302b4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:51.946684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668c9f2-8a08-454a-b9eb-e08da28302b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:51.947001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668c9f2-8a08-454a-b9eb-e08da28302b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:51.947789 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668c9f2-8a08-454a-b9eb-e08da28302b4 None admin] RBAC: Adding query filter params (role.id=344db47133bb4fb2843696759f71b2c7, scope.project.id=703306e79b234fb4a5f9169f09560dee, user.id=315b7d0f6889432f934c56e1f4aded84) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:51.948036 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668c9f2-8a08-454a-b9eb-e08da28302b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:51.949520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668c9f2-8a08-454a-b9eb-e08da28302b4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:51.957670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 87/174] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:32:51 2022] GET /identity/v3/role_assignments?user.id=315b7d0f6889432f934c56e1f4aded84&scope.project.id=703306e79b234fb4a5f9169f09560dee&role.id=344db47133bb4fb2843696759f71b2c7 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:51.964600 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4360d-9ede-4973-9922-3cbf860311f3 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:51.964600 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4360d-9ede-4973-9922-3cbf860311f3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:51.964600 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4360d-9ede-4973-9922-3cbf860311f3 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:51.964600 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 88/175] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:51.964600 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc258e96-7119-4f73-ac95-d1a924d1262c None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:51.964600 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc258e96-7119-4f73-ac95-d1a924d1262c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:51.965261 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc258e96-7119-4f73-ac95-d1a924d1262c None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:51.965261 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 89/176] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:51.966059 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc258e96-7119-4f73-ac95-d1a924d1262c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:51.977288 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f35a74-23e8-4c28-a4e9-62982136f573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:51.980069 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f35a74-23e8-4c28-a4e9-62982136f573 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:52.095364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc258e96-7119-4f73-ac95-d1a924d1262c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:52.136917 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:52.162094 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 88/177] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:32:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:32:52.168182 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bc191-4d86-4575-9de7-11e2232b54eb None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:52.168463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d942f24-4dde-4fe4-b790-4174b0d0c007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:52.168599 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bc191-4d86-4575-9de7-11e2232b54eb None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:52.168781 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bc191-4d86-4575-9de7-11e2232b54eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:52.169201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d942f24-4dde-4fe4-b790-4174b0d0c007 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:52.169487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d942f24-4dde-4fe4-b790-4174b0d0c007 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:52.169762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d942f24-4dde-4fe4-b790-4174b0d0c007 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:52.188992 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-d00bc191-4d86-4575-9de7-11e2232b54eb None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:52.190260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d00bc191-4d86-4575-9de7-11e2232b54eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:52.246666 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:52.258472 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d942f24-4dde-4fe4-b790-4174b0d0c007 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:52.259934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d942f24-4dde-4fe4-b790-4174b0d0c007 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:52.276240 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 89/178] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:52.277594 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a153e7-26f3-49dc-8aef-92784962c60e None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:52.277880 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a153e7-26f3-49dc-8aef-92784962c60e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:52.278161 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a153e7-26f3-49dc-8aef-92784962c60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:52.299138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-67a153e7-26f3-49dc-8aef-92784962c60e None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:52.300515 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-67a153e7-26f3-49dc-8aef-92784962c60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:52.402386 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 90/179] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:52.403572 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a153e7-26f3-49dc-8aef-92784962c60e None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:52.405365 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 90/180] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:32:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:32:52.411687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae185608-48c5-4aa5-b946-933bcc87ffbf None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:52.411969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae185608-48c5-4aa5-b946-933bcc87ffbf None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:52.412242 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae185608-48c5-4aa5-b946-933bcc87ffbf None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:52.414492 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 91/181] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:52.414697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae185608-48c5-4aa5-b946-933bcc87ffbf None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:52.435278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:52.531859 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae185608-48c5-4aa5-b946-933bcc87ffbf None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:52.570750 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad0658-3e0f-4639-9599-d243d9af1cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:52.571380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad0658-3e0f-4639-9599-d243d9af1cd0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:52.571662 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad0658-3e0f-4639-9599-d243d9af1cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:52.571936 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad0658-3e0f-4639-9599-d243d9af1cd0 None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:52.573088 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad0658-3e0f-4639-9599-d243d9af1cd0 None admin] RBAC: Authorizing `identity:get_project(project_id=a0bc949d68f2445ca2585ec234ea2c73)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:52.574536 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad0658-3e0f-4639-9599-d243d9af1cd0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:52.576915 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 92/182] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:32:52 2022] GET /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:32:52.581952 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfba9e-f673-45bd-a4db-9ccd96ad41da None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:52.582235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfba9e-f673-45bd-a4db-9ccd96ad41da None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:52.582568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfba9e-f673-45bd-a4db-9ccd96ad41da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:52.603236 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a153e7-26f3-49dc-8aef-92784962c60e None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:52.604076 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-10bfba9e-f673-45bd-a4db-9ccd96ad41da None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:52.605401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-10bfba9e-f673-45bd-a4db-9ccd96ad41da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:52.618157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:52.674674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b90bc-85a7-433e-b0d8-1203d9ab5d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:52.675309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b90bc-85a7-433e-b0d8-1203d9ab5d80 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:52.675649 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b90bc-85a7-433e-b0d8-1203d9ab5d80 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:52.675933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b90bc-85a7-433e-b0d8-1203d9ab5d80 None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:52.678946 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b90bc-85a7-433e-b0d8-1203d9ab5d80 None admin] RBAC: Authorizing `identity:get_project(project_id=a0bc949d68f2445ca2585ec234ea2c73)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:52.680423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b90bc-85a7-433e-b0d8-1203d9ab5d80 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:52.682421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 91/183] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:32:52 2022] GET /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:52.683205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b90bc-85a7-433e-b0d8-1203d9ab5d80 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:52.684765 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 93/184] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:52.687921 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfba9e-f673-45bd-a4db-9ccd96ad41da None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:52.712948 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:52.802028 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b90bc-85a7-433e-b0d8-1203d9ab5d80 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:52.823021 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfba9e-f673-45bd-a4db-9ccd96ad41da None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:52.843281 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd7120-0070-4f55-8505-27cf81070865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:52.844319 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7120-0070-4f55-8505-27cf81070865 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:52.844850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7120-0070-4f55-8505-27cf81070865 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:52.845320 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7120-0070-4f55-8505-27cf81070865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:52.846275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd7120-0070-4f55-8505-27cf81070865 None admin] RBAC: Adding query filter params (role.id=529cb3511f3a498b9b7169ed5b0f6b8e, scope.project.id=a0bc949d68f2445ca2585ec234ea2c73, user.id=f5c1185c0be14e5a840b375a991df2d8) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:52.846783 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd7120-0070-4f55-8505-27cf81070865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:52.849326 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd7120-0070-4f55-8505-27cf81070865 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:52.855869 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 92/185] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:32:52 2022] GET /identity/v3/role_assignments?user.id=f5c1185c0be14e5a840b375a991df2d8&scope.project.id=a0bc949d68f2445ca2585ec234ea2c73&role.id=529cb3511f3a498b9b7169ed5b0f6b8e => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:52.861658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd7120-0070-4f55-8505-27cf81070865 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:52.878180 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190d13c-3731-40a4-9b05-6574a2960bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:52.878812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190d13c-3731-40a4-9b05-6574a2960bc4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:52.879093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190d13c-3731-40a4-9b05-6574a2960bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:52.879412 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190d13c-3731-40a4-9b05-6574a2960bc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:52.880249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190d13c-3731-40a4-9b05-6574a2960bc4 None admin] RBAC: Adding query filter params (role.id=30f1e6f9ddb649d2804d9128b17348f6, scope.project.id=a0bc949d68f2445ca2585ec234ea2c73, user.id=315b7d0f6889432f934c56e1f4aded84) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:52.880602 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190d13c-3731-40a4-9b05-6574a2960bc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:52.882097 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190d13c-3731-40a4-9b05-6574a2960bc4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:52.890771 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 94/186] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:32:52 2022] GET /identity/v3/role_assignments?user.id=315b7d0f6889432f934c56e1f4aded84&scope.project.id=a0bc949d68f2445ca2585ec234ea2c73&role.id=30f1e6f9ddb649d2804d9128b17348f6 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:32:52.891677 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190d13c-3731-40a4-9b05-6574a2960bc4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:52.971363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:53.051922 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:53.090271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd7120-0070-4f55-8505-27cf81070865 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:53.093237 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190d13c-3731-40a4-9b05-6574a2960bc4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:53.136450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c59f9-0e96-43cd-9db5-6bab1c90afe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:53.137200 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c59f9-0e96-43cd-9db5-6bab1c90afe9 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:53.137412 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c59f9-0e96-43cd-9db5-6bab1c90afe9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:53.137691 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c59f9-0e96-43cd-9db5-6bab1c90afe9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:53.137796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041aaab-e577-4747-8e1d-0c9e3edc70ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:53.138423 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041aaab-e577-4747-8e1d-0c9e3edc70ec None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:53.138710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041aaab-e577-4747-8e1d-0c9e3edc70ec None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:53.138985 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041aaab-e577-4747-8e1d-0c9e3edc70ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:53.139519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c59f9-0e96-43cd-9db5-6bab1c90afe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:53.141021 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c59f9-0e96-43cd-9db5-6bab1c90afe9 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:53.142633 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 93/187] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:32:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:53.143404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c59f9-0e96-43cd-9db5-6bab1c90afe9 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:53.157147 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041aaab-e577-4747-8e1d-0c9e3edc70ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:53.163397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-1041aaab-e577-4747-8e1d-0c9e3edc70ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:32:53.163397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:53.163397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:53.163397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:53.163397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:53.163397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:53.163397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:53.163397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:53.163397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:53.163397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:53.163397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:53.163397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:53.163397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:53.163397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:53.163397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:53.163397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:53.164285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:53.164285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:53.164285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:53.164285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:53.164285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:53.164285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:53.164285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:53.164285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:53.164285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:53.164285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:53.164285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:53.164285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:53.164285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:53.164285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:53.164285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:53.164285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:53.165157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:53.165157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:53.165157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:53.165157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:53.165157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:53.165157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:53.165157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:53.165157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:53.165157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:53.165157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:53.165157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:32:53.165157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:32:53.165157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 95/188] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:32:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:32:53.165804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0b11b-0f63-4e2b-901e-340649cd1fb3 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:53.166637 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0b11b-0f63-4e2b-901e-340649cd1fb3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:53.166637 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0b11b-0f63-4e2b-901e-340649cd1fb3 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:53.167669 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 96/189] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:53.168192 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0b11b-0f63-4e2b-901e-340649cd1fb3 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:53.252115 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c59f9-0e96-43cd-9db5-6bab1c90afe9 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:53.259553 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:53.286736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0b11b-0f63-4e2b-901e-340649cd1fb3 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:53.286953 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f0b41-df65-4b12-baf8-abec3892a441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:53.287592 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f0b41-df65-4b12-baf8-abec3892a441 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:53.287874 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f0b41-df65-4b12-baf8-abec3892a441 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:53.288148 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f0b41-df65-4b12-baf8-abec3892a441 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:53.298062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f0b41-df65-4b12-baf8-abec3892a441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:53.302985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-d05f0b41-df65-4b12-baf8-abec3892a441 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:32:53.302985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:53.302985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:53.302985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:53.302985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:53.302985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:53.302985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:53.302985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:53.302985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:53.302985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:53.302985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:53.302985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:53.302985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:53.302985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:53.302985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:53.302985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:53.303884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:53.303884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:53.303884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:53.303884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:53.303884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:53.303884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:53.303884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:53.303884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:53.303884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:53.303884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:53.303884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:53.303884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:53.303884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:53.303884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:53.303884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:53.303884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:53.304714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:53.304714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:53.304714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:53.304714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:53.304714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:53.304714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:53.304714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:53.304714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:53.304714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:53.304714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:53.304714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:32:53.304714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:32:53.304714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 94/190] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:32:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:32:53.305352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa00d72-ee7c-4cc9-aa7b-59ea26c46fc0 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:53.305548 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa00d72-ee7c-4cc9-aa7b-59ea26c46fc0 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:53.305768 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa00d72-ee7c-4cc9-aa7b-59ea26c46fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:53.322356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37d5fc-d990-409a-9c4c-ff8c31a95a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:53.322951 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d5fc-d990-409a-9c4c-ff8c31a95a1c None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:53.323226 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d5fc-d990-409a-9c4c-ff8c31a95a1c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:53.323485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-6aa00d72-ee7c-4cc9-aa7b-59ea26c46fc0 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:53.323578 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d5fc-d990-409a-9c4c-ff8c31a95a1c None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:53.324120 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37d5fc-d990-409a-9c4c-ff8c31a95a1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:53.324714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6aa00d72-ee7c-4cc9-aa7b-59ea26c46fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:53.325552 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37d5fc-d990-409a-9c4c-ff8c31a95a1c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:53.335686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:53.356700 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 97/191] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 10:32:53 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:32:53.356700 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37d5fc-d990-409a-9c4c-ff8c31a95a1c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:53.422906 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 95/192] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:53.423913 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa00d72-ee7c-4cc9-aa7b-59ea26c46fc0 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:53.486465 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37d5fc-d990-409a-9c4c-ff8c31a95a1c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:53.526690 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca68dd-2cae-4607-91b0-9c2ab8f328b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:53.527434 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca68dd-2cae-4607-91b0-9c2ab8f328b0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:53.527721 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca68dd-2cae-4607-91b0-9c2ab8f328b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:53.527988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca68dd-2cae-4607-91b0-9c2ab8f328b0 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:53.529964 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca68dd-2cae-4607-91b0-9c2ab8f328b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:53.529964 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca68dd-2cae-4607-91b0-9c2ab8f328b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:53.530431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca68dd-2cae-4607-91b0-9c2ab8f328b0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:53.538851 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 98/193] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:32:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:53.545536 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca68dd-2cae-4607-91b0-9c2ab8f328b0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:53.566566 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:53.573493 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa00d72-ee7c-4cc9-aa7b-59ea26c46fc0 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:53.611661 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299c2f9-3492-4c38-abd2-f262f5cf4eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:53.612523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299c2f9-3492-4c38-abd2-f262f5cf4eef None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:53.612834 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299c2f9-3492-4c38-abd2-f262f5cf4eef None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:53.613109 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299c2f9-3492-4c38-abd2-f262f5cf4eef None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:53.614321 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299c2f9-3492-4c38-abd2-f262f5cf4eef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:53.614622 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299c2f9-3492-4c38-abd2-f262f5cf4eef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:53.616211 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299c2f9-3492-4c38-abd2-f262f5cf4eef None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:53.622177 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:53.625924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 96/194] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:32:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:53.631891 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299c2f9-3492-4c38-abd2-f262f5cf4eef None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:53.669918 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca68dd-2cae-4607-91b0-9c2ab8f328b0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:53.723720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888f0ea-7f97-4588-953a-699c9de5d874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:53.724421 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888f0ea-7f97-4588-953a-699c9de5d874 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:53.724712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888f0ea-7f97-4588-953a-699c9de5d874 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:53.724988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888f0ea-7f97-4588-953a-699c9de5d874 None admin] PATH_INFO: `/v3/users/bd5aada209d64467a868c9feaea97da1` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:53.743489 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888f0ea-7f97-4588-953a-699c9de5d874 None admin] RBAC: Authorizing `identity:get_user(user_id=bd5aada209d64467a868c9feaea97da1)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:53.745425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888f0ea-7f97-4588-953a-699c9de5d874 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:53.747679 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 99/195] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:53 2022] GET /identity/v3/users/bd5aada209d64467a868c9feaea97da1 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:53.752685 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299c2f9-3492-4c38-abd2-f262f5cf4eef None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:53.753406 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888f0ea-7f97-4588-953a-699c9de5d874 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:53.793423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0842c-2a1b-4546-a579-8f85d5e4c28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:53.793628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0842c-2a1b-4546-a579-8f85d5e4c28c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:53.793837 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0842c-2a1b-4546-a579-8f85d5e4c28c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:53.794110 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0842c-2a1b-4546-a579-8f85d5e4c28c None admin] PATH_INFO: `/v3/users/bd5aada209d64467a868c9feaea97da1` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:53.795260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0842c-2a1b-4546-a579-8f85d5e4c28c None admin] RBAC: Authorizing `identity:get_user(user_id=bd5aada209d64467a868c9feaea97da1)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:53.796741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0842c-2a1b-4546-a579-8f85d5e4c28c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:53.798500 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 97/196] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:53 2022] GET /identity/v3/users/bd5aada209d64467a868c9feaea97da1 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:53.799920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0842c-2a1b-4546-a579-8f85d5e4c28c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:53.829721 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:53.878064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888f0ea-7f97-4588-953a-699c9de5d874 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:53.893319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:53.916061 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0842c-2a1b-4546-a579-8f85d5e4c28c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:53.919010 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1fe24-c75a-4e03-9140-eca57ef48884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:53.919651 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1fe24-c75a-4e03-9140-eca57ef48884 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:53.919933 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1fe24-c75a-4e03-9140-eca57ef48884 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:53.920205 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1fe24-c75a-4e03-9140-eca57ef48884 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:53.931386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1fe24-c75a-4e03-9140-eca57ef48884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:53.937710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-eba1fe24-c75a-4e03-9140-eca57ef48884 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 10:32:53.937710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:53.937710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:53.937710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:53.937710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:53.937710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:53.937710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:53.937710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:53.937710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:53.937710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:53.937710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:53.937710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:53.937710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:53.937710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:53.937710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:53.937710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:53.938596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:53.938596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:53.938596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:53.938596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:53.938596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:53.938596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:53.938596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:53.938596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:53.938596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:53.938596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:53.938596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:53.938596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:53.938596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:53.938596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:53.938596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:53.938596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:53.939560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:53.939560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:53.939560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:53.939560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:53.939560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:53.939560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:53.939560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:53.939560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:53.939560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:53.939560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:53.939560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 10:32:53.939560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:32:53.939560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 100/197] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:32:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:32:53.940423 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1fe24-c75a-4e03-9140-eca57ef48884 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:53.961583 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207be19-18e0-4f90-a078-0982ee4442e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:53.962737 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207be19-18e0-4f90-a078-0982ee4442e7 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:53.963571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207be19-18e0-4f90-a078-0982ee4442e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:53.964024 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207be19-18e0-4f90-a078-0982ee4442e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:54.059835 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207be19-18e0-4f90-a078-0982ee4442e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:54.061371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207be19-18e0-4f90-a078-0982ee4442e7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:54.062690 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1fe24-c75a-4e03-9140-eca57ef48884 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:54.090668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:54.102305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245ea34-621b-459f-a070-100246a463d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:54.103212 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245ea34-621b-459f-a070-100246a463d9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:54.103689 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245ea34-621b-459f-a070-100246a463d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:54.104155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245ea34-621b-459f-a070-100246a463d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:54.151642 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:54.172206 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 98/198] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:32:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:32:54.173218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207be19-18e0-4f90-a078-0982ee4442e7 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:54.186641 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245ea34-621b-459f-a070-100246a463d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:54.188435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245ea34-621b-459f-a070-100246a463d9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:54.293913 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207be19-18e0-4f90-a078-0982ee4442e7 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:54.311640 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 101/199] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:32:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:32:54.312619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245ea34-621b-459f-a070-100246a463d9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:54.328948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:54.340697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7ec3d-375f-4029-bb67-c7fd9ca74c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:54.341544 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7ec3d-375f-4029-bb67-c7fd9ca74c13 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:54.341970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7ec3d-375f-4029-bb67-c7fd9ca74c13 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:54.342388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7ec3d-375f-4029-bb67-c7fd9ca74c13 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:54.343309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7ec3d-375f-4029-bb67-c7fd9ca74c13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:54.343775 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7ec3d-375f-4029-bb67-c7fd9ca74c13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:54.345339 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7ec3d-375f-4029-bb67-c7fd9ca74c13 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:54.355068 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 99/200] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:32:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:54.356212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7ec3d-375f-4029-bb67-c7fd9ca74c13 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:54.397242 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:54.432775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245ea34-621b-459f-a070-100246a463d9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:54.470030 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8c7e0-3f3e-40b8-85a8-51c7177eb47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:54.470665 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8c7e0-3f3e-40b8-85a8-51c7177eb47e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:54.470950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8c7e0-3f3e-40b8-85a8-51c7177eb47e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:54.471221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8c7e0-3f3e-40b8-85a8-51c7177eb47e None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:54.472789 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8c7e0-3f3e-40b8-85a8-51c7177eb47e None admin] RBAC: Authorizing `identity:get_project(project_id=0e22a81d096b490087b34c4bcaa8c9fa)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:54.474853 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8c7e0-3f3e-40b8-85a8-51c7177eb47e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:54.476657 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7ec3d-375f-4029-bb67-c7fd9ca74c13 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:54.476930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 102/201] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:32:54 2022] GET /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:54.477776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8c7e0-3f3e-40b8-85a8-51c7177eb47e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:54.519503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f195b-bfef-4a6b-91e6-ffb6a675ea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:54.521075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f195b-bfef-4a6b-91e6-ffb6a675ea43 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:54.521562 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f195b-bfef-4a6b-91e6-ffb6a675ea43 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:54.522037 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f195b-bfef-4a6b-91e6-ffb6a675ea43 None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:54.523418 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f195b-bfef-4a6b-91e6-ffb6a675ea43 None admin] RBAC: Authorizing `identity:get_project(project_id=0e22a81d096b490087b34c4bcaa8c9fa)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:54.525294 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f195b-bfef-4a6b-91e6-ffb6a675ea43 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:54.527647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 100/202] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:32:54 2022] GET /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:54.528743 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f195b-bfef-4a6b-91e6-ffb6a675ea43 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:54.588672 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8c7e0-3f3e-40b8-85a8-51c7177eb47e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:54.593955 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:54.626939 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17e35a-3ae2-4257-ab79-d4d78b469f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:54.627566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17e35a-3ae2-4257-ab79-d4d78b469f46 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:54.627843 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17e35a-3ae2-4257-ab79-d4d78b469f46 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:54.628117 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17e35a-3ae2-4257-ab79-d4d78b469f46 None admin] PATH_INFO: `/v3/users/50eff045224d46d4a91c5eef278a418a` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:54.629488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17e35a-3ae2-4257-ab79-d4d78b469f46 None admin] RBAC: Authorizing `identity:get_user(user_id=50eff045224d46d4a91c5eef278a418a)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:54.631313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17e35a-3ae2-4257-ab79-d4d78b469f46 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:54.633688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 103/203] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:54 2022] GET /identity/v3/users/50eff045224d46d4a91c5eef278a418a => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:54.634541 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17e35a-3ae2-4257-ab79-d4d78b469f46 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:54.646366 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:54.648855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f195b-bfef-4a6b-91e6-ffb6a675ea43 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:54.687428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f805c-4a49-43e0-bbc0-e00f32aae0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:54.688372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f805c-4a49-43e0-bbc0-e00f32aae0c3 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:54.688997 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f805c-4a49-43e0-bbc0-e00f32aae0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:54.689567 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f805c-4a49-43e0-bbc0-e00f32aae0c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:54.690491 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f805c-4a49-43e0-bbc0-e00f32aae0c3 None admin] RBAC: Adding query filter params (role.id=529cb3511f3a498b9b7169ed5b0f6b8e, scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa, user.id=bd5aada209d64467a868c9feaea97da1) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:54.691110 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f805c-4a49-43e0-bbc0-e00f32aae0c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:54.693409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f805c-4a49-43e0-bbc0-e00f32aae0c3 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:54.699486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 101/204] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:32:54 2022] GET /identity/v3/role_assignments?user.id=bd5aada209d64467a868c9feaea97da1&scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa&role.id=529cb3511f3a498b9b7169ed5b0f6b8e => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:54.700541 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f805c-4a49-43e0-bbc0-e00f32aae0c3 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:54.751605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17e35a-3ae2-4257-ab79-d4d78b469f46 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:54.791754 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734bb8ab-daae-4696-a17f-4cb3278c6b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:54.792380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734bb8ab-daae-4696-a17f-4cb3278c6b3f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:54.792692 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734bb8ab-daae-4696-a17f-4cb3278c6b3f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:54.792965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734bb8ab-daae-4696-a17f-4cb3278c6b3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:54.793715 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734bb8ab-daae-4696-a17f-4cb3278c6b3f None admin] RBAC: Adding query filter params (role.id=30f1e6f9ddb649d2804d9128b17348f6, scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa, user.id=bd5aada209d64467a868c9feaea97da1) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:54.794026 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734bb8ab-daae-4696-a17f-4cb3278c6b3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:54.795537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734bb8ab-daae-4696-a17f-4cb3278c6b3f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:54.805376 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 104/205] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:32:54 2022] GET /identity/v3/role_assignments?user.id=bd5aada209d64467a868c9feaea97da1&scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa&role.id=30f1e6f9ddb649d2804d9128b17348f6 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:54.841945 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f805c-4a49-43e0-bbc0-e00f32aae0c3 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:54.865157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:54.881824 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c4223-740b-414c-9a79-8cf2124b6b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:54.882452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c4223-740b-414c-9a79-8cf2124b6b32 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:54.882733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c4223-740b-414c-9a79-8cf2124b6b32 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:54.883007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c4223-740b-414c-9a79-8cf2124b6b32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:54.970728 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c4223-740b-414c-9a79-8cf2124b6b32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:54.972401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c4223-740b-414c-9a79-8cf2124b6b32 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:55.088032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 102/206] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:32:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:32:55.093774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734bb8ab-daae-4696-a17f-4cb3278c6b3f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:55.166193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:55.202985 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734bb8ab-daae-4696-a17f-4cb3278c6b3f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:55.246668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d9e0d-1c89-4477-94d7-16321897f5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:55.247220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d9e0d-1c89-4477-94d7-16321897f5fe None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:55.247499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d9e0d-1c89-4477-94d7-16321897f5fe None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:55.247770 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d9e0d-1c89-4477-94d7-16321897f5fe None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:55.248939 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d9e0d-1c89-4477-94d7-16321897f5fe None admin] RBAC: Authorizing `identity:get_project(project_id=a0bc949d68f2445ca2585ec234ea2c73)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:55.250386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d9e0d-1c89-4477-94d7-16321897f5fe None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:55.252325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 105/207] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:32:55 2022] GET /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:55.261880 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c4223-740b-414c-9a79-8cf2124b6b32 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:55.300053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:55.423990 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c4223-740b-414c-9a79-8cf2124b6b32 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:55.478146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a6a9c-8ee5-43b0-879b-01a1acdf93f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:55.478763 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a6a9c-8ee5-43b0-879b-01a1acdf93f6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:55.479042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a6a9c-8ee5-43b0-879b-01a1acdf93f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:55.479312 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a6a9c-8ee5-43b0-879b-01a1acdf93f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:55.480044 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a6a9c-8ee5-43b0-879b-01a1acdf93f6 None admin] RBAC: Adding query filter params (role.id=4b4be11b3bbb487f996ab28b7f1bda4c, scope.project.id=a0bc949d68f2445ca2585ec234ea2c73, user.id=50eff045224d46d4a91c5eef278a418a) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:55.480348 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a6a9c-8ee5-43b0-879b-01a1acdf93f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:55.481812 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a6a9c-8ee5-43b0-879b-01a1acdf93f6 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:55.493842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 103/208] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:32:55 2022] GET /identity/v3/role_assignments?user.id=50eff045224d46d4a91c5eef278a418a&scope.project.id=a0bc949d68f2445ca2585ec234ea2c73&role.id=4b4be11b3bbb487f996ab28b7f1bda4c => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:55.836948 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b1004-8b0e-4085-87c6-369d95283fd4 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:55.837470 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b1004-8b0e-4085-87c6-369d95283fd4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:55.837470 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b1004-8b0e-4085-87c6-369d95283fd4 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:55.839097 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 106/209] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:55.844059 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03283bbe-518c-4095-9648-e480b3394863 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:55.844475 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03283bbe-518c-4095-9648-e480b3394863 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:55.844711 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03283bbe-518c-4095-9648-e480b3394863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:55.869798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-03283bbe-518c-4095-9648-e480b3394863 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:55.871044 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-03283bbe-518c-4095-9648-e480b3394863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:55.946014 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 104/210] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:56.085578 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892f610-d791-4bfa-8551-0341991456e7 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:56.085914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892f610-d791-4bfa-8551-0341991456e7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:56.086122 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892f610-d791-4bfa-8551-0341991456e7 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:56.087786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 107/211] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:56.093281 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbb37a-ac76-4081-a2ed-da50bceefade None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:56.093640 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbb37a-ac76-4081-a2ed-da50bceefade None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:56.093880 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbb37a-ac76-4081-a2ed-da50bceefade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:56.118333 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-bcfbb37a-ac76-4081-a2ed-da50bceefade None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:56.119558 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-bcfbb37a-ac76-4081-a2ed-da50bceefade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:56.131124 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:56.199038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 105/212] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:56.246058 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892f610-d791-4bfa-8551-0341991456e7 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:56.354023 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892f610-d791-4bfa-8551-0341991456e7 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:56.390729 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76827166-5e2b-41ab-be03-91b51504c373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:56.391767 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76827166-5e2b-41ab-be03-91b51504c373 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:56.392297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76827166-5e2b-41ab-be03-91b51504c373 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:56.392794 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76827166-5e2b-41ab-be03-91b51504c373 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:56.394174 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76827166-5e2b-41ab-be03-91b51504c373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:56.396412 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76827166-5e2b-41ab-be03-91b51504c373 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:56.398284 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 108/213] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:32:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:56.404714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbb37a-ac76-4081-a2ed-da50bceefade None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:56.517278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76827166-5e2b-41ab-be03-91b51504c373 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:56.522660 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbb37a-ac76-4081-a2ed-da50bceefade None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:56.535888 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:56.574256 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13c8dd-9dad-4b66-94e0-75241a4e8f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:56.574875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13c8dd-9dad-4b66-94e0-75241a4e8f34 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:56.575155 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13c8dd-9dad-4b66-94e0-75241a4e8f34 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:56.575431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13c8dd-9dad-4b66-94e0-75241a4e8f34 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:56.576107 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13c8dd-9dad-4b66-94e0-75241a4e8f34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:56.584396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13c8dd-9dad-4b66-94e0-75241a4e8f34 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:56.602198 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:56.614774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 106/214] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 10:32:56 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:32:56.808572 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76827166-5e2b-41ab-be03-91b51504c373 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:56.882915 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627e4d0-eef8-4f08-8b4d-0c6520aee848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:56.883643 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627e4d0-eef8-4f08-8b4d-0c6520aee848 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:56.888570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627e4d0-eef8-4f08-8b4d-0c6520aee848 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:56.888570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627e4d0-eef8-4f08-8b4d-0c6520aee848 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:56.901231 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627e4d0-eef8-4f08-8b4d-0c6520aee848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:56.906542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-2627e4d0-eef8-4f08-8b4d-0c6520aee848 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:32:56.906542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:56.906542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:56.906542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:56.906542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:56.906542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:56.906542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:56.906542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:56.906542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:56.906542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:56.906542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:56.906542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:56.906542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:56.906542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:56.906542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:56.906542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:56.907419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:56.907419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:56.907419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:56.907419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:56.907419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:56.907419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:56.907419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:56.907419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:56.907419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:56.907419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:56.907419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:56.907419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:56.907419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:56.907419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:56.907419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:56.907419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:56.909779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:56.909779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:56.909779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:56.909779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:56.909779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:56.909779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:56.909779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:56.909779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:56.909779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:56.909779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:56.909779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:32:56.909779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:32:56.909779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 109/215] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:32:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:32:56.916839 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13c8dd-9dad-4b66-94e0-75241a4e8f34 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:57.069948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13c8dd-9dad-4b66-94e0-75241a4e8f34 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:57.122327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51674096-0c42-439b-9fd0-2d641fa270b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:57.122969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51674096-0c42-439b-9fd0-2d641fa270b0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:57.123252 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51674096-0c42-439b-9fd0-2d641fa270b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:57.123530 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51674096-0c42-439b-9fd0-2d641fa270b0 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:57.124242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51674096-0c42-439b-9fd0-2d641fa270b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:57.124586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51674096-0c42-439b-9fd0-2d641fa270b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:57.126018 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51674096-0c42-439b-9fd0-2d641fa270b0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:57.139044 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 107/216] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:32:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:57.146015 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627e4d0-eef8-4f08-8b4d-0c6520aee848 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:57.229605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:57.234337 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d870a89-511f-43ee-ae8a-75590202670f None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:57.234624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d870a89-511f-43ee-ae8a-75590202670f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:57.234906 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d870a89-511f-43ee-ae8a-75590202670f None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:57.236465 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 108/217] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:57.242564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f3243-095d-459a-8ade-c9e427c12a03 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:57.242857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f3243-095d-459a-8ade-c9e427c12a03 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:57.243118 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f3243-095d-459a-8ade-c9e427c12a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:57.262225 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-185f3243-095d-459a-8ade-c9e427c12a03 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:57.263410 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-185f3243-095d-459a-8ade-c9e427c12a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:57.269139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627e4d0-eef8-4f08-8b4d-0c6520aee848 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:57.312185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b96d0-c2c7-420d-b759-cfce58f64a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:57.312858 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b96d0-c2c7-420d-b759-cfce58f64a59 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:57.313139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b96d0-c2c7-420d-b759-cfce58f64a59 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:57.313498 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b96d0-c2c7-420d-b759-cfce58f64a59 None admin] PATH_INFO: `/v3/users/fffaaaa8a28b414d96467d7df9f7bdca` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:57.333987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b96d0-c2c7-420d-b759-cfce58f64a59 None admin] RBAC: Authorizing `identity:get_user(user_id=fffaaaa8a28b414d96467d7df9f7bdca)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:57.335464 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b96d0-c2c7-420d-b759-cfce58f64a59 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:57.337509 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 110/218] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:57 2022] GET /identity/v3/users/fffaaaa8a28b414d96467d7df9f7bdca => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:57.339608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:57.345552 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b96d0-c2c7-420d-b759-cfce58f64a59 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:57.355871 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 109/219] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:32:57.460889 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b96d0-c2c7-420d-b759-cfce58f64a59 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:57.491071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:57.501414 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebaab46-e276-4401-97bb-925902dd3344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:57.502049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaab46-e276-4401-97bb-925902dd3344 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:57.502331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaab46-e276-4401-97bb-925902dd3344 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:57.502603 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaab46-e276-4401-97bb-925902dd3344 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:57.575071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebaab46-e276-4401-97bb-925902dd3344 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:57.576566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebaab46-e276-4401-97bb-925902dd3344 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:57.611627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d407d-c9fe-4681-89e7-8689d50b9898 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:57.611924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d407d-c9fe-4681-89e7-8689d50b9898 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:57.612177 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d407d-c9fe-4681-89e7-8689d50b9898 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:57.615265 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 110/220] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:32:57.622115 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147defef-f4f5-4586-ae91-d5814be7dc12 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:57.622858 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147defef-f4f5-4586-ae91-d5814be7dc12 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:57.623239 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147defef-f4f5-4586-ae91-d5814be7dc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:57.643956 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-147defef-f4f5-4586-ae91-d5814be7dc12 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:57.645699 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-147defef-f4f5-4586-ae91-d5814be7dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:57.730085 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 111/221] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:32:57.741495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 111/222] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:32:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:32:57.749647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147defef-f4f5-4586-ae91-d5814be7dc12 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:57.760221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebaab46-e276-4401-97bb-925902dd3344 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:57.808934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:57.891858 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147defef-f4f5-4586-ae91-d5814be7dc12 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:57.916052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:57.935543 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105d601-14b5-4db4-9478-ff38fc9f051d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:57.936293 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105d601-14b5-4db4-9478-ff38fc9f051d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:57.936476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105d601-14b5-4db4-9478-ff38fc9f051d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:57.936739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105d601-14b5-4db4-9478-ff38fc9f051d None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:57.937985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105d601-14b5-4db4-9478-ff38fc9f051d None admin] RBAC: Authorizing `identity:get_project(project_id=0e22a81d096b490087b34c4bcaa8c9fa)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:57.939423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105d601-14b5-4db4-9478-ff38fc9f051d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:57.941089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 112/223] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:32:57 2022] GET /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:57.948892 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105d601-14b5-4db4-9478-ff38fc9f051d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:57.967752 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebaab46-e276-4401-97bb-925902dd3344 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:58.053249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d81920-625b-47f3-b6cc-47b421373533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:58.053892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d81920-625b-47f3-b6cc-47b421373533 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:58.054171 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d81920-625b-47f3-b6cc-47b421373533 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:58.054444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d81920-625b-47f3-b6cc-47b421373533 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:58.070560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d81920-625b-47f3-b6cc-47b421373533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:58.075401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-53d81920-625b-47f3-b6cc-47b421373533 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:32:58.075401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:58.075401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:58.075401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:58.075401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:58.075401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:58.075401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:58.075401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:58.075401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:58.075401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:58.075401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:58.075401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:58.075401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:58.075401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:58.075401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:58.075401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:58.076302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:58.076302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:58.076302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:58.076302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:58.076302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:58.076302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:58.076302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:58.076302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:58.076302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:58.076302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:58.076302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:58.076302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:58.076302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:58.076302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:58.076302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:58.076302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:58.077507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:58.077507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:58.077507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:58.077507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:58.077507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:58.077507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:58.077507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:58.077507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:58.077507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:58.077507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:58.077507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:32:58.077507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:32:58.077507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 112/224] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:32:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:32:58.078149 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d81920-625b-47f3-b6cc-47b421373533 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:58.092733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105d601-14b5-4db4-9478-ff38fc9f051d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:58.142835 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bb25d-4232-43d5-a906-43213852dd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:58.144165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bb25d-4232-43d5-a906-43213852dd7c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:58.144676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bb25d-4232-43d5-a906-43213852dd7c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:58.145684 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bb25d-4232-43d5-a906-43213852dd7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:58.147129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2bb25d-4232-43d5-a906-43213852dd7c None admin] RBAC: Adding query filter params (role.id=344db47133bb4fb2843696759f71b2c7, scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa, user.id=fffaaaa8a28b414d96467d7df9f7bdca) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:58.147641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2bb25d-4232-43d5-a906-43213852dd7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:58.149837 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2bb25d-4232-43d5-a906-43213852dd7c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:58.157767 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 113/225] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:32:57 2022] GET /identity/v3/role_assignments?user.id=fffaaaa8a28b414d96467d7df9f7bdca&scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa&role.id=344db47133bb4fb2843696759f71b2c7 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:58.159364 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bb25d-4232-43d5-a906-43213852dd7c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:58.186075 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:58.206875 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d81920-625b-47f3-b6cc-47b421373533 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:58.241704 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:58.263591 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c25d1d-6322-4e4e-bab9-16b686ade6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:58.264601 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c25d1d-6322-4e4e-bab9-16b686ade6fc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:58.265108 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c25d1d-6322-4e4e-bab9-16b686ade6fc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:58.265552 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c25d1d-6322-4e4e-bab9-16b686ade6fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:58.290468 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c25d1d-6322-4e4e-bab9-16b686ade6fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:32:58.302062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-23c25d1d-6322-4e4e-bab9-16b686ade6fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:32:58.302062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:32:58.302062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:32:58.302062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:32:58.302062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:32:58.302062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:32:58.302062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:32:58.302062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:32:58.302062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:32:58.302062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:32:58.302062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:32:58.302062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:32:58.302062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:32:58.302062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:32:58.302062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:32:58.302062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:32:58.303014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:32:58.303014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:32:58.303014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:32:58.303014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:32:58.303014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:32:58.303014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:32:58.303014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:32:58.303014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:32:58.303014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:32:58.303014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:32:58.303014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:32:58.303014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:32:58.303014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:32:58.303014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:32:58.303014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:32:58.303014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:32:58.303802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:32:58.303802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:32:58.303802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:32:58.303802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:32:58.303802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:32:58.303802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:32:58.303802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:32:58.303802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:32:58.303802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:32:58.303802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:32:58.303802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:32:58.303802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:32:58.303802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 113/226] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:32:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:32:58.309100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c25d1d-6322-4e4e-bab9-16b686ade6fc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:58.336322 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bb25d-4232-43d5-a906-43213852dd7c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:58.393584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634ec62-2826-4a93-9f72-29c989db292e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:58.394518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ec62-2826-4a93-9f72-29c989db292e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:58.395495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ec62-2826-4a93-9f72-29c989db292e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:58.395978 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ec62-2826-4a93-9f72-29c989db292e None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:58.397410 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634ec62-2826-4a93-9f72-29c989db292e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:58.397920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634ec62-2826-4a93-9f72-29c989db292e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:58.399502 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634ec62-2826-4a93-9f72-29c989db292e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:58.411858 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 114/227] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:32:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:58.417663 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634ec62-2826-4a93-9f72-29c989db292e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:58.485275 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c25d1d-6322-4e4e-bab9-16b686ade6fc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:58.543627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634ec62-2826-4a93-9f72-29c989db292e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:58.561326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab8d59-0b61-4425-ab0e-99ae152eab12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:58.561949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab8d59-0b61-4425-ab0e-99ae152eab12 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:58.562225 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab8d59-0b61-4425-ab0e-99ae152eab12 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:58.562492 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab8d59-0b61-4425-ab0e-99ae152eab12 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:58.563173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab8d59-0b61-4425-ab0e-99ae152eab12 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:32:58.563622 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab8d59-0b61-4425-ab0e-99ae152eab12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:58.564872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab8d59-0b61-4425-ab0e-99ae152eab12 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:58.578696 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:58.582495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 114/228] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:32:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:32:58.583931 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d13bff-9c1b-44b2-99ea-32083b6d19db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:58.584860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d13bff-9c1b-44b2-99ea-32083b6d19db None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:58.585365 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d13bff-9c1b-44b2-99ea-32083b6d19db None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:58.585834 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d13bff-9c1b-44b2-99ea-32083b6d19db None admin] PATH_INFO: `/v3/users/bd5aada209d64467a868c9feaea97da1` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:58.587312 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d13bff-9c1b-44b2-99ea-32083b6d19db None admin] RBAC: Authorizing `identity:get_user(user_id=bd5aada209d64467a868c9feaea97da1)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:58.588810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab8d59-0b61-4425-ab0e-99ae152eab12 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:58.589372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d13bff-9c1b-44b2-99ea-32083b6d19db None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:58.591549 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 115/229] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:58 2022] GET /identity/v3/users/bd5aada209d64467a868c9feaea97da1 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:58.597339 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d13bff-9c1b-44b2-99ea-32083b6d19db None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:58.604573 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:58.723591 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d13bff-9c1b-44b2-99ea-32083b6d19db None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:58.764572 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab8d59-0b61-4425-ab0e-99ae152eab12 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:58.775900 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2769cb-1898-4776-81c6-ab600b7bf1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:58.776875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2769cb-1898-4776-81c6-ab600b7bf1ce None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:58.777351 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2769cb-1898-4776-81c6-ab600b7bf1ce None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:58.777814 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2769cb-1898-4776-81c6-ab600b7bf1ce None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:58.780020 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2769cb-1898-4776-81c6-ab600b7bf1ce None admin] RBAC: Authorizing `identity:get_project(project_id=0e22a81d096b490087b34c4bcaa8c9fa)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:58.781797 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2769cb-1898-4776-81c6-ab600b7bf1ce None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:58.783759 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 116/230] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:32:58 2022] GET /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:32:58.789634 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2769cb-1898-4776-81c6-ab600b7bf1ce None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:58.793275 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76a6ea-8e04-4384-95ac-d9b9100c1150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:58.793962 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76a6ea-8e04-4384-95ac-d9b9100c1150 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:58.794182 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76a6ea-8e04-4384-95ac-d9b9100c1150 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:58.794457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76a6ea-8e04-4384-95ac-d9b9100c1150 None admin] PATH_INFO: `/v3/users/bd5aada209d64467a868c9feaea97da1` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:58.795587 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76a6ea-8e04-4384-95ac-d9b9100c1150 None admin] RBAC: Authorizing `identity:get_user(user_id=bd5aada209d64467a868c9feaea97da1)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:58.805178 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76a6ea-8e04-4384-95ac-d9b9100c1150 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:58.807186 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 115/231] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:32:58 2022] GET /identity/v3/users/bd5aada209d64467a868c9feaea97da1 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:32:58.812300 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76a6ea-8e04-4384-95ac-d9b9100c1150 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:58.852970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:58.902017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2769cb-1898-4776-81c6-ab600b7bf1ce None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:58.939529 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ee3b-e1ff-4242-85a6-187a4bcd280d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:58.941007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:58.942527 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ee3b-e1ff-4242-85a6-187a4bcd280d None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:58.943069 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ee3b-e1ff-4242-85a6-187a4bcd280d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:58.943708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ee3b-e1ff-4242-85a6-187a4bcd280d None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa/users/bd5aada209d64467a868c9feaea97da1/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:58.953657 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7ee3b-e1ff-4242-85a6-187a4bcd280d None admin] RBAC: Authorizing `identity:create_grant(project_id=0e22a81d096b490087b34c4bcaa8c9fa, user_id=bd5aada209d64467a868c9feaea97da1, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:58.955479 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7ee3b-e1ff-4242-85a6-187a4bcd280d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:58.965518 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76a6ea-8e04-4384-95ac-d9b9100c1150 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:58.981353 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 117/232] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:32:58 2022] PUT /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa/users/bd5aada209d64467a868c9feaea97da1/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:32:59.004949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9973de-aede-45d4-82b2-c29278dc110b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:59.005600 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9973de-aede-45d4-82b2-c29278dc110b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:59.005928 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9973de-aede-45d4-82b2-c29278dc110b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:59.006211 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9973de-aede-45d4-82b2-c29278dc110b None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:59.007383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9973de-aede-45d4-82b2-c29278dc110b None admin] RBAC: Authorizing `identity:get_project(project_id=0e22a81d096b490087b34c4bcaa8c9fa)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:59.008920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9973de-aede-45d4-82b2-c29278dc110b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:59.011032 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 116/233] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:32:58 2022] GET /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:32:59.018724 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ee3b-e1ff-4242-85a6-187a4bcd280d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:32:59.168887 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ee3b-e1ff-4242-85a6-187a4bcd280d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:32:59.184279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:32:59.209053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2401f94-231c-4e13-aac9-0e68ad576705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:32:59.209789 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401f94-231c-4e13-aac9-0e68ad576705 None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:59.210075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401f94-231c-4e13-aac9-0e68ad576705 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:59.210350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401f94-231c-4e13-aac9-0e68ad576705 None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa/users/bd5aada209d64467a868c9feaea97da1/roles/30f1e6f9ddb649d2804d9128b17348f6` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:59.212662 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2401f94-231c-4e13-aac9-0e68ad576705 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e22a81d096b490087b34c4bcaa8c9fa, user_id=bd5aada209d64467a868c9feaea97da1, role_id=30f1e6f9ddb649d2804d9128b17348f6)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:32:59.214181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2401f94-231c-4e13-aac9-0e68ad576705 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:32:59.235899 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 118/234] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:32:59 2022] PUT /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa/users/bd5aada209d64467a868c9feaea97da1/roles/30f1e6f9ddb649d2804d9128b17348f6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:32:59.606162 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d82fa9-085c-473a-bbaf-0c8ab313835c None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:59.606450 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d82fa9-085c-473a-bbaf-0c8ab313835c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:59.606725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d82fa9-085c-473a-bbaf-0c8ab313835c None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:59.608324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 117/235] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:59.614353 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc6632-fddd-4e24-88c2-ce4cd69cf9f4 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:59.614641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc6632-fddd-4e24-88c2-ce4cd69cf9f4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:59.614920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc6632-fddd-4e24-88c2-ce4cd69cf9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:59.639858 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596115f6-f161-4727-b04c-ddf7cbb6763b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:59.640408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596115f6-f161-4727-b04c-ddf7cbb6763b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:59.640891 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596115f6-f161-4727-b04c-ddf7cbb6763b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:59.641986 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-75dc6632-fddd-4e24-88c2-ce4cd69cf9f4 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:59.642834 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 118/236] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:32:59.644127 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-75dc6632-fddd-4e24-88c2-ce4cd69cf9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:59.650114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26646191-2e53-437c-9d8e-10604455ec3e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:32:59.650645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26646191-2e53-437c-9d8e-10604455ec3e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:32:59.651112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26646191-2e53-437c-9d8e-10604455ec3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:32:59.685958 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-26646191-2e53-437c-9d8e-10604455ec3e None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:32:59.688799 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-26646191-2e53-437c-9d8e-10604455ec3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:32:59.776599 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 119/237] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:32:59.813882 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 119/238] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:33:00.063015 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc6632-fddd-4e24-88c2-ce4cd69cf9f4 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:00.196121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc6632-fddd-4e24-88c2-ce4cd69cf9f4 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:00.197679 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:00.249261 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5846ca-4dca-4fa8-b158-16a313ec3954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:00.249915 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5846ca-4dca-4fa8-b158-16a313ec3954 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:00.250194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5846ca-4dca-4fa8-b158-16a313ec3954 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:00.250463 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5846ca-4dca-4fa8-b158-16a313ec3954 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:00.251601 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5846ca-4dca-4fa8-b158-16a313ec3954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:00.253070 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5846ca-4dca-4fa8-b158-16a313ec3954 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:00.255396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 120/239] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:00.257029 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26646191-2e53-437c-9d8e-10604455ec3e None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:00.275938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5846ca-4dca-4fa8-b158-16a313ec3954 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:00.368931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:00.411262 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26646191-2e53-437c-9d8e-10604455ec3e None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:00.455805 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75698503-a76d-42f8-9124-e2d178e8c114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:00.456447 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75698503-a76d-42f8-9124-e2d178e8c114 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:00.456745 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75698503-a76d-42f8-9124-e2d178e8c114 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:00.457014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75698503-a76d-42f8-9124-e2d178e8c114 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:00.468722 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5846ca-4dca-4fa8-b158-16a313ec3954 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:00.485594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75698503-a76d-42f8-9124-e2d178e8c114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:00.491027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-75698503-a76d-42f8-9124-e2d178e8c114 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 10:33:00.491027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:00.491027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:00.491027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:00.491027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:00.491027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:00.491027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:00.491027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:00.491027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:00.491027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:00.491027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:00.491027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:00.491027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:00.491027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:00.491027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:00.491027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:00.492116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:00.492116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:00.492116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:00.492116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:00.492116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:00.492116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:00.492116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:00.492116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:00.492116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:00.492116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:00.492116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:00.492116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:00.492116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:00.492116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:00.492116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:00.492116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:00.493281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:00.493281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:00.493281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:00.493281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:00.493281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:00.493281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:00.493281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:00.493281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:00.493281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:00.493281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:00.493281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 10:33:00.493281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:00.493281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 120/240] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:00.500716 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75698503-a76d-42f8-9124-e2d178e8c114 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:00.557194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d602475-9fb4-4ff8-bb7e-65c9aff47f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:00.557807 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d602475-9fb4-4ff8-bb7e-65c9aff47f20 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:00.558088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d602475-9fb4-4ff8-bb7e-65c9aff47f20 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:00.558359 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d602475-9fb4-4ff8-bb7e-65c9aff47f20 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:00.559036 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d602475-9fb4-4ff8-bb7e-65c9aff47f20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:00.561642 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d602475-9fb4-4ff8-bb7e-65c9aff47f20 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:00.605378 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 121/241] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 10:33:00 2022] POST /identity/v3/users => generated 293 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:33:00.653030 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75698503-a76d-42f8-9124-e2d178e8c114 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:00.698398 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85fe57-ad29-4aba-a410-70e1b719e969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:00.699145 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85fe57-ad29-4aba-a410-70e1b719e969 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:00.699440 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85fe57-ad29-4aba-a410-70e1b719e969 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:00.699771 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85fe57-ad29-4aba-a410-70e1b719e969 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:00.700501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85fe57-ad29-4aba-a410-70e1b719e969 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:00.700838 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85fe57-ad29-4aba-a410-70e1b719e969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:00.702299 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85fe57-ad29-4aba-a410-70e1b719e969 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:00.703980 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:00.720761 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 121/242] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:33:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:00.727194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d602475-9fb4-4ff8-bb7e-65c9aff47f20 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:00.759561 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:00.841716 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d602475-9fb4-4ff8-bb7e-65c9aff47f20 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:00.879633 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d8478-737e-441d-8042-30ff34bbf491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:00.880275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d8478-737e-441d-8042-30ff34bbf491 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:00.880660 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d8478-737e-441d-8042-30ff34bbf491 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:00.880943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d8478-737e-441d-8042-30ff34bbf491 None admin] PATH_INFO: `/v3/users/088362a2500240cabc8b2ef3cedd5d43` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:00.895589 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d8478-737e-441d-8042-30ff34bbf491 None admin] RBAC: Authorizing `identity:get_user(user_id=088362a2500240cabc8b2ef3cedd5d43)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:00.897161 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d8478-737e-441d-8042-30ff34bbf491 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:00.899406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 122/243] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:33:00 2022] GET /identity/v3/users/088362a2500240cabc8b2ef3cedd5d43 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:00.906322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85fe57-ad29-4aba-a410-70e1b719e969 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:01.016528 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85fe57-ad29-4aba-a410-70e1b719e969 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:01.052859 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f47410-99e8-481c-820e-7ea858367791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:01.053522 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f47410-99e8-481c-820e-7ea858367791 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:01.053806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f47410-99e8-481c-820e-7ea858367791 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:01.054084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f47410-99e8-481c-820e-7ea858367791 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:01.062531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e3ef9-d89c-4721-8f92-538328ea8685 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:01.062820 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e3ef9-d89c-4721-8f92-538328ea8685 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:01.063100 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e3ef9-d89c-4721-8f92-538328ea8685 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:01.064685 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 123/244] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:01.070293 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fbe38-4055-466e-b1d4-f8bbdd98f816 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:01.070583 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fbe38-4055-466e-b1d4-f8bbdd98f816 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:01.070917 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fbe38-4055-466e-b1d4-f8bbdd98f816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:01.090316 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-055fbe38-4055-466e-b1d4-f8bbdd98f816 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:01.092420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-055fbe38-4055-466e-b1d4-f8bbdd98f816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:01.135062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:01.144506 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f47410-99e8-481c-820e-7ea858367791 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:01.146559 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f47410-99e8-481c-820e-7ea858367791 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:01.182908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 124/245] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:33:01.260965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 122/246] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:01.266648 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fbe38-4055-466e-b1d4-f8bbdd98f816 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:01.283355 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:01.382854 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fbe38-4055-466e-b1d4-f8bbdd98f816 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:01.429273 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a58a4-ebc9-4ddd-8cb4-41c1042b2b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:01.429921 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a58a4-ebc9-4ddd-8cb4-41c1042b2b80 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:01.430202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a58a4-ebc9-4ddd-8cb4-41c1042b2b80 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:01.430476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a58a4-ebc9-4ddd-8cb4-41c1042b2b80 None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:01.431610 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a58a4-ebc9-4ddd-8cb4-41c1042b2b80 None admin] RBAC: Authorizing `identity:get_project(project_id=0e22a81d096b490087b34c4bcaa8c9fa)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:01.433159 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a58a4-ebc9-4ddd-8cb4-41c1042b2b80 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:01.434947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 125/247] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:01 2022] GET /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:01.440719 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f47410-99e8-481c-820e-7ea858367791 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:01.518281 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a58a4-ebc9-4ddd-8cb4-41c1042b2b80 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:01.556114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:01.567434 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f47410-99e8-481c-820e-7ea858367791 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:01.617117 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd601cd2-cc68-4a99-b631-7fc8e5692e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:01.621022 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd601cd2-cc68-4a99-b631-7fc8e5692e22 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:01.621534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd601cd2-cc68-4a99-b631-7fc8e5692e22 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:01.622511 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd601cd2-cc68-4a99-b631-7fc8e5692e22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:01.623460 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd601cd2-cc68-4a99-b631-7fc8e5692e22 None admin] RBAC: Adding query filter params (role.id=4b4be11b3bbb487f996ab28b7f1bda4c, scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa, user.id=088362a2500240cabc8b2ef3cedd5d43) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:01.624433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd601cd2-cc68-4a99-b631-7fc8e5692e22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:01.626618 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd601cd2-cc68-4a99-b631-7fc8e5692e22 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:01.634099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 123/248] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:33:01 2022] GET /identity/v3/role_assignments?user.id=088362a2500240cabc8b2ef3cedd5d43&scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa&role.id=4b4be11b3bbb487f996ab28b7f1bda4c => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:01.643101 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:01.681348 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a58a4-ebc9-4ddd-8cb4-41c1042b2b80 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:01.728928 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e553f2-f961-4cc2-85a3-6e8d8b202d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:01.729575 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e553f2-f961-4cc2-85a3-6e8d8b202d9a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:01.729850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e553f2-f961-4cc2-85a3-6e8d8b202d9a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:01.730117 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e553f2-f961-4cc2-85a3-6e8d8b202d9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:01.746940 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e553f2-f961-4cc2-85a3-6e8d8b202d9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:01.751851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-c9e553f2-f961-4cc2-85a3-6e8d8b202d9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:01.751851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:01.751851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:01.751851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:01.751851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:01.751851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:01.751851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:01.751851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:01.751851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:01.751851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:01.751851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:01.751851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:01.751851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:01.751851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:01.751851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:01.751851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:01.752741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:01.752741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:01.752741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:01.752741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:01.752741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:01.752741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:01.752741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:01.752741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:01.752741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:01.752741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:01.752741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:01.752741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:01.752741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:01.752741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:01.752741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:01.752741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:01.753518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:01.753518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:01.753518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:01.753518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:01.753518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:01.753518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:01.753518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:01.753518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:01.753518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:01.753518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:01.753518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:01.753518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:01.753518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 126/249] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:01.760366 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd601cd2-cc68-4a99-b631-7fc8e5692e22 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:01.917059 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd601cd2-cc68-4a99-b631-7fc8e5692e22 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:01.932923 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659bb60-0ddd-48b8-aee6-9c110be5cc3f None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:01.933209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659bb60-0ddd-48b8-aee6-9c110be5cc3f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:01.933492 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659bb60-0ddd-48b8-aee6-9c110be5cc3f None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:01.936449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 127/250] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:01.944437 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ef254-9634-4a75-b0db-3f10cda70db8 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:01.944745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ef254-9634-4a75-b0db-3f10cda70db8 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:01.945025 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ef254-9634-4a75-b0db-3f10cda70db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:01.964489 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a559c27-7186-421f-9d48-ff7dc81ded5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:01.965222 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a559c27-7186-421f-9d48-ff7dc81ded5a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:01.965559 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a559c27-7186-421f-9d48-ff7dc81ded5a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:01.965833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a559c27-7186-421f-9d48-ff7dc81ded5a None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:01.966503 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a559c27-7186-421f-9d48-ff7dc81ded5a None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:01.966845 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a559c27-7186-421f-9d48-ff7dc81ded5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:01.968216 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a559c27-7186-421f-9d48-ff7dc81ded5a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:01.975049 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-617ef254-9634-4a75-b0db-3f10cda70db8 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:01.976244 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-617ef254-9634-4a75-b0db-3f10cda70db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:01.977993 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 124/251] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:33:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:01.979284 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525d8ad-cd6d-4f5e-bab9-9ceeca3402e5 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:01.979569 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525d8ad-cd6d-4f5e-bab9-9ceeca3402e5 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:01.979838 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525d8ad-cd6d-4f5e-bab9-9ceeca3402e5 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:01.981322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 125/252] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:01.984231 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525d8ad-cd6d-4f5e-bab9-9ceeca3402e5 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:02.030672 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:02.098201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 128/253] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:33:02.099564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa51f03-8238-4e27-a71f-cce3efcf6763 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:02.099847 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa51f03-8238-4e27-a71f-cce3efcf6763 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:02.100185 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa51f03-8238-4e27-a71f-cce3efcf6763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:02.131097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-1aa51f03-8238-4e27-a71f-cce3efcf6763 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:02.132937 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-1aa51f03-8238-4e27-a71f-cce3efcf6763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:02.161513 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525d8ad-cd6d-4f5e-bab9-9ceeca3402e5 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:02.221463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4e016-2896-43be-9b80-db36e819d9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:02.222792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4e016-2896-43be-9b80-db36e819d9a2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:02.224230 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4e016-2896-43be-9b80-db36e819d9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:02.224732 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4e016-2896-43be-9b80-db36e819d9a2 None admin] PATH_INFO: `/v3/users/fffaaaa8a28b414d96467d7df9f7bdca` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:02.226797 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4e016-2896-43be-9b80-db36e819d9a2 None admin] RBAC: Authorizing `identity:get_user(user_id=fffaaaa8a28b414d96467d7df9f7bdca)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:02.229695 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4e016-2896-43be-9b80-db36e819d9a2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:02.234024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 126/254] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:33:01 2022] GET /identity/v3/users/fffaaaa8a28b414d96467d7df9f7bdca => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:02.237931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4e016-2896-43be-9b80-db36e819d9a2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:02.249481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 129/255] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:02.363439 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:02.375978 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4e016-2896-43be-9b80-db36e819d9a2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:02.416390 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c90d9-4007-4167-9b2d-02a385a79027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:02.417346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c90d9-4007-4167-9b2d-02a385a79027 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:02.417793 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c90d9-4007-4167-9b2d-02a385a79027 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:02.418207 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c90d9-4007-4167-9b2d-02a385a79027 None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:02.419680 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c90d9-4007-4167-9b2d-02a385a79027 None admin] RBAC: Authorizing `identity:get_project(project_id=0e22a81d096b490087b34c4bcaa8c9fa)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:02.421358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c90d9-4007-4167-9b2d-02a385a79027 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:02.423637 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 127/256] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:02 2022] GET /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:02.429435 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa51f03-8238-4e27-a71f-cce3efcf6763 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:02.432194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:02.541505 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c90d9-4007-4167-9b2d-02a385a79027 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:02.555259 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa51f03-8238-4e27-a71f-cce3efcf6763 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:02.608397 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf003b5-fc03-4301-af76-435a48f7938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:02.609386 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf003b5-fc03-4301-af76-435a48f7938a None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:02.609857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf003b5-fc03-4301-af76-435a48f7938a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:02.610319 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf003b5-fc03-4301-af76-435a48f7938a None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa/users/fffaaaa8a28b414d96467d7df9f7bdca/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:02.612464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf003b5-fc03-4301-af76-435a48f7938a None admin] RBAC: Authorizing `identity:create_grant(project_id=0e22a81d096b490087b34c4bcaa8c9fa, user_id=fffaaaa8a28b414d96467d7df9f7bdca, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:02.614698 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf003b5-fc03-4301-af76-435a48f7938a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:02.637750 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 130/257] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:33:02 2022] PUT /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa/users/fffaaaa8a28b414d96467d7df9f7bdca/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:33:02.682043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf003b5-fc03-4301-af76-435a48f7938a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:02.744876 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c90d9-4007-4167-9b2d-02a385a79027 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:02.822312 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:02.845700 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f828e6e-4aa8-4ad4-b081-3df1df83ee27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:02.846376 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f828e6e-4aa8-4ad4-b081-3df1df83ee27 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:02.846658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f828e6e-4aa8-4ad4-b081-3df1df83ee27 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:02.847190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f828e6e-4aa8-4ad4-b081-3df1df83ee27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:02.864535 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f828e6e-4aa8-4ad4-b081-3df1df83ee27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:02.871471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-1f828e6e-4aa8-4ad4-b081-3df1df83ee27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:33:02.871471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:02.871471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:02.871471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:02.871471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:02.871471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:02.871471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:02.871471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:02.871471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:02.871471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:02.871471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:02.871471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:02.871471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:02.871471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:02.871471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:02.871471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:02.872431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:02.872431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:02.872431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:02.872431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:02.872431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:02.872431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:02.872431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:02.872431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:02.872431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:02.872431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:02.872431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:02.872431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:02.872431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:02.872431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:02.872431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:02.872431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:02.873266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:02.873266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:02.873266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:02.873266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:02.873266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:02.873266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:02.873266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:02.873266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:02.873266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:02.873266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:02.873266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:33:02.873266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:02.877836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 128/258] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:33:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:33:02.878868 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f828e6e-4aa8-4ad4-b081-3df1df83ee27 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:02.910321 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf003b5-fc03-4301-af76-435a48f7938a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:02.916835 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:02.976827 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348051b9-9975-4482-afa7-9936d3a2d9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:02.977460 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348051b9-9975-4482-afa7-9936d3a2d9a6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:02.977743 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348051b9-9975-4482-afa7-9936d3a2d9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:02.978015 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348051b9-9975-4482-afa7-9936d3a2d9a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:02.998287 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348051b9-9975-4482-afa7-9936d3a2d9a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:03.004793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-348051b9-9975-4482-afa7-9936d3a2d9a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:33:03.004793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:03.004793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:03.004793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:03.004793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:03.004793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:03.004793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:03.004793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:03.004793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:03.004793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:03.004793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:03.004793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:03.004793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:03.004793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:03.004793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:03.004793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:03.005644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:03.005644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:03.005644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:03.005644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:03.005644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:03.005644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:03.005644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:03.005644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:03.005644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:03.005644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:03.005644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:03.005644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:03.005644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:03.005644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:03.005644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:03.005644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:03.006528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:03.006528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:03.006528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:03.006528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:03.006528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:03.006528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:03.006528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:03.006528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:03.006528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:03.006528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:03.006528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:33:03.006528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:03.006528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 131/259] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:33:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:33:03.015239 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348051b9-9975-4482-afa7-9936d3a2d9a6 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:03.060592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f828e6e-4aa8-4ad4-b081-3df1df83ee27 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:03.148379 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4345d-d179-4fce-9af9-25e6df2482c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:03.148944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4345d-d179-4fce-9af9-25e6df2482c1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:03.149224 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4345d-d179-4fce-9af9-25e6df2482c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:03.149496 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4345d-d179-4fce-9af9-25e6df2482c1 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:03.150279 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4345d-d179-4fce-9af9-25e6df2482c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:03.150586 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4345d-d179-4fce-9af9-25e6df2482c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:03.151980 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4345d-d179-4fce-9af9-25e6df2482c1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:03.171034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 129/260] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:03.176747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4345d-d179-4fce-9af9-25e6df2482c1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:03.216782 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348051b9-9975-4482-afa7-9936d3a2d9a6 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:03.259554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:03.274550 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7c744-986a-4bfd-a00b-2c0dad10e346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:03.275169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7c744-986a-4bfd-a00b-2c0dad10e346 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:03.275451 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7c744-986a-4bfd-a00b-2c0dad10e346 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:03.275724 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7c744-986a-4bfd-a00b-2c0dad10e346 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:03.276402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7c744-986a-4bfd-a00b-2c0dad10e346 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:03.276847 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7c744-986a-4bfd-a00b-2c0dad10e346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:03.278418 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7c744-986a-4bfd-a00b-2c0dad10e346 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:03.296071 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 132/261] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:03.301967 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7c744-986a-4bfd-a00b-2c0dad10e346 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:03.351097 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:03.406298 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4345d-d179-4fce-9af9-25e6df2482c1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:03.467422 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7c744-986a-4bfd-a00b-2c0dad10e346 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:03.494252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72411267-646d-4a7b-a30b-173c0f615b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:03.494901 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72411267-646d-4a7b-a30b-173c0f615b41 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:03.495183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72411267-646d-4a7b-a30b-173c0f615b41 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:03.495457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72411267-646d-4a7b-a30b-173c0f615b41 None admin] PATH_INFO: `/v3/users/bd5aada209d64467a868c9feaea97da1` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:03.496640 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72411267-646d-4a7b-a30b-173c0f615b41 None admin] RBAC: Authorizing `identity:get_user(user_id=bd5aada209d64467a868c9feaea97da1)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:03.498084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72411267-646d-4a7b-a30b-173c0f615b41 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:03.499839 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 130/262] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:33:03 2022] GET /identity/v3/users/bd5aada209d64467a868c9feaea97da1 => generated 283 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:03.505516 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72411267-646d-4a7b-a30b-173c0f615b41 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:03.536208 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa9250-cbd6-4436-a3af-7c0b162acf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:03.536877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa9250-cbd6-4436-a3af-7c0b162acf93 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:03.537160 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa9250-cbd6-4436-a3af-7c0b162acf93 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:03.537434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa9250-cbd6-4436-a3af-7c0b162acf93 None admin] PATH_INFO: `/v3/users/bd5aada209d64467a868c9feaea97da1` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:03.541250 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa9250-cbd6-4436-a3af-7c0b162acf93 None admin] RBAC: Authorizing `identity:get_user(user_id=bd5aada209d64467a868c9feaea97da1)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:03.542781 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa9250-cbd6-4436-a3af-7c0b162acf93 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:03.544663 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 133/263] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:33:03 2022] GET /identity/v3/users/bd5aada209d64467a868c9feaea97da1 => generated 283 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:03.554853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa9250-cbd6-4436-a3af-7c0b162acf93 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:03.679804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:03.723301 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72411267-646d-4a7b-a30b-173c0f615b41 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:03.808226 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa9250-cbd6-4436-a3af-7c0b162acf93 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:03.813451 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecadba-6991-4166-81a6-42220d161641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:03.814076 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecadba-6991-4166-81a6-42220d161641 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:03.814358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecadba-6991-4166-81a6-42220d161641 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:03.814645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecadba-6991-4166-81a6-42220d161641 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:03.858357 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:03.893877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e8cfe-4fdb-4322-bde8-31b7b4196a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:03.894526 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e8cfe-4fdb-4322-bde8-31b7b4196a21 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:03.894845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e8cfe-4fdb-4322-bde8-31b7b4196a21 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:03.895120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e8cfe-4fdb-4322-bde8-31b7b4196a21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:03.962685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecadba-6991-4166-81a6-42220d161641 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:03.964455 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecadba-6991-4166-81a6-42220d161641 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:04.008014 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e8cfe-4fdb-4322-bde8-31b7b4196a21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:04.009516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e8cfe-4fdb-4322-bde8-31b7b4196a21 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:04.105206 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:04.130883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 131/264] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:04.136762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecadba-6991-4166-81a6-42220d161641 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:04.194859 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:04.208532 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 134/265] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:04.215198 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e8cfe-4fdb-4322-bde8-31b7b4196a21 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:04.284322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecadba-6991-4166-81a6-42220d161641 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:04.344639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe939b-f1cf-46f5-8b67-11775ef90b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:04.345285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe939b-f1cf-46f5-8b67-11775ef90b0f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:04.345562 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe939b-f1cf-46f5-8b67-11775ef90b0f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:04.345826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe939b-f1cf-46f5-8b67-11775ef90b0f None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:04.353441 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe939b-f1cf-46f5-8b67-11775ef90b0f None admin] RBAC: Authorizing `identity:get_project(project_id=0e22a81d096b490087b34c4bcaa8c9fa)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:04.354933 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe939b-f1cf-46f5-8b67-11775ef90b0f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:04.356798 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 132/266] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:04 2022] GET /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:04.357833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb923f82-7825-44a4-a979-be10ea3ecd4c None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:04.358184 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb923f82-7825-44a4-a979-be10ea3ecd4c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:04.358450 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb923f82-7825-44a4-a979-be10ea3ecd4c None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:04.359881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 133/267] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:04.364172 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb923f82-7825-44a4-a979-be10ea3ecd4c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:04.400244 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e8cfe-4fdb-4322-bde8-31b7b4196a21 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:04.450612 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6377bfe-d0d0-4e92-bb3f-9249572816a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:04.452189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6377bfe-d0d0-4e92-bb3f-9249572816a0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:04.452715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6377bfe-d0d0-4e92-bb3f-9249572816a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:04.453371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6377bfe-d0d0-4e92-bb3f-9249572816a0 None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:04.455357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6377bfe-d0d0-4e92-bb3f-9249572816a0 None admin] RBAC: Authorizing `identity:get_project(project_id=0e22a81d096b490087b34c4bcaa8c9fa)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:04.458418 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6377bfe-d0d0-4e92-bb3f-9249572816a0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:04.464867 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 135/268] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:04 2022] GET /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:04.465985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d71c7a-d5b4-4924-9251-1ec1f316843a None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:04.466215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d71c7a-d5b4-4924-9251-1ec1f316843a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:04.466490 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d71c7a-d5b4-4924-9251-1ec1f316843a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:04.485915 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-26d71c7a-d5b4-4924-9251-1ec1f316843a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:04.487204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-26d71c7a-d5b4-4924-9251-1ec1f316843a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:04.506444 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:04.511032 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb923f82-7825-44a4-a979-be10ea3ecd4c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:04.532743 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:04.560395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12014927-fabf-49d4-b505-fc1ccef9b5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:04.561278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12014927-fabf-49d4-b505-fc1ccef9b5e1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:04.561728 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12014927-fabf-49d4-b505-fc1ccef9b5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:04.562144 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12014927-fabf-49d4-b505-fc1ccef9b5e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:04.568582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 136/269] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:04.568582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5ba93-27b5-47bf-83f0-86932b553286 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:04.568582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5ba93-27b5-47bf-83f0-86932b553286 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:04.568582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5ba93-27b5-47bf-83f0-86932b553286 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:04.568582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 137/270] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:04.568582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5ba93-27b5-47bf-83f0-86932b553286 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:04.570883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12014927-fabf-49d4-b505-fc1ccef9b5e1 None admin] RBAC: Adding query filter params (role.id=529cb3511f3a498b9b7169ed5b0f6b8e, scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa, user.id=bd5aada209d64467a868c9feaea97da1) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:04.572706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12014927-fabf-49d4-b505-fc1ccef9b5e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:04.574831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12014927-fabf-49d4-b505-fc1ccef9b5e1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:04.587221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 134/271] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:33:04 2022] GET /identity/v3/role_assignments?user.id=bd5aada209d64467a868c9feaea97da1&scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa&role.id=529cb3511f3a498b9b7169ed5b0f6b8e => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:04.590682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704861fd-2689-43c1-b1b6-96e0b7915d3a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:04.591171 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704861fd-2689-43c1-b1b6-96e0b7915d3a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:04.592903 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704861fd-2689-43c1-b1b6-96e0b7915d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:04.626035 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-704861fd-2689-43c1-b1b6-96e0b7915d3a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:04.627881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-704861fd-2689-43c1-b1b6-96e0b7915d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:04.760968 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 135/272] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:33:04.764497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5ba93-27b5-47bf-83f0-86932b553286 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:04.799869 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d01ac6-e37f-4e64-9081-04d34a3960c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:04.800617 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d01ac6-e37f-4e64-9081-04d34a3960c3 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:04.801423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d01ac6-e37f-4e64-9081-04d34a3960c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:04.801694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d01ac6-e37f-4e64-9081-04d34a3960c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:04.802430 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d01ac6-e37f-4e64-9081-04d34a3960c3 None admin] RBAC: Adding query filter params (role.id=30f1e6f9ddb649d2804d9128b17348f6, scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa, user.id=bd5aada209d64467a868c9feaea97da1) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:04.802734 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d01ac6-e37f-4e64-9081-04d34a3960c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:04.804168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d01ac6-e37f-4e64-9081-04d34a3960c3 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:04.810685 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 138/273] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:33:04 2022] GET /identity/v3/role_assignments?user.id=bd5aada209d64467a868c9feaea97da1&scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa&role.id=30f1e6f9ddb649d2804d9128b17348f6 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:05.039636 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b54b9-7551-4115-9b58-8a40dc759005 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:05.039974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b54b9-7551-4115-9b58-8a40dc759005 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:05.040159 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b54b9-7551-4115-9b58-8a40dc759005 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:05.041943 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 136/274] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:05.052799 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3a8b3-8e33-4a23-bc47-7002a39ea9ce None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:05.053102 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3a8b3-8e33-4a23-bc47-7002a39ea9ce None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:05.053362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3a8b3-8e33-4a23-bc47-7002a39ea9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:05.075984 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-14d3a8b3-8e33-4a23-bc47-7002a39ea9ce None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:05.077309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-14d3a8b3-8e33-4a23-bc47-7002a39ea9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:05.088064 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:05.146114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b54b9-7551-4115-9b58-8a40dc759005 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:05.155204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 139/275] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:05.170063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3a8b3-8e33-4a23-bc47-7002a39ea9ce None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:05.307590 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b54b9-7551-4115-9b58-8a40dc759005 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:05.315543 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3a8b3-8e33-4a23-bc47-7002a39ea9ce None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:05.325651 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:05.358127 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5418c-a11a-4d04-abad-0175a0201713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:05.358704 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c28d44-f92f-4cf2-b193-f8e56ff5f959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:05.358842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5418c-a11a-4d04-abad-0175a0201713 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:05.359096 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5418c-a11a-4d04-abad-0175a0201713 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:05.359329 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c28d44-f92f-4cf2-b193-f8e56ff5f959 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:05.359492 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5418c-a11a-4d04-abad-0175a0201713 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:05.359651 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c28d44-f92f-4cf2-b193-f8e56ff5f959 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:05.359862 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c28d44-f92f-4cf2-b193-f8e56ff5f959 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:05.361004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c28d44-f92f-4cf2-b193-f8e56ff5f959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:05.363147 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c28d44-f92f-4cf2-b193-f8e56ff5f959 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:05.365343 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 137/276] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:05.370807 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c28d44-f92f-4cf2-b193-f8e56ff5f959 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:05.371849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5418c-a11a-4d04-abad-0175a0201713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:05.377402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-8ec5418c-a11a-4d04-abad-0175a0201713 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:05.377402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:05.377402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:05.377402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:05.377402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:05.377402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:05.377402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:05.377402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:05.377402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:05.377402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:05.377402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:05.377402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:05.377402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:05.377402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:05.377402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:05.377402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:05.378533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:05.378533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:05.378533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:05.378533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:05.378533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:05.378533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:05.378533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:05.378533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:05.378533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:05.378533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:05.378533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:05.378533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:05.378533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:05.378533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:05.378533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:05.378533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:05.380063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:05.380063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:05.380063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:05.380063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:05.380063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:05.380063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:05.380063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:05.380063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:05.380063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:05.380063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:05.380063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:05.380063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:05.382749 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 140/277] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:33:05.389242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5418c-a11a-4d04-abad-0175a0201713 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:05.394487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:05.495717 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c28d44-f92f-4cf2-b193-f8e56ff5f959 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:05.505240 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5418c-a11a-4d04-abad-0175a0201713 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:05.532223 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0362dc0-264f-4ae9-a2fd-d5987e049b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:05.532875 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0362dc0-264f-4ae9-a2fd-d5987e049b23 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:05.533153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0362dc0-264f-4ae9-a2fd-d5987e049b23 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:05.533425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0362dc0-264f-4ae9-a2fd-d5987e049b23 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:05.534069 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0362dc0-264f-4ae9-a2fd-d5987e049b23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:05.536198 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0362dc0-264f-4ae9-a2fd-d5987e049b23 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:05.544975 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774592ff-668b-4f80-82aa-76884158e2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:05.545680 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774592ff-668b-4f80-82aa-76884158e2a0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:05.546136 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774592ff-668b-4f80-82aa-76884158e2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:05.546365 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774592ff-668b-4f80-82aa-76884158e2a0 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:05.547202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774592ff-668b-4f80-82aa-76884158e2a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:05.547511 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774592ff-668b-4f80-82aa-76884158e2a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:05.549202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774592ff-668b-4f80-82aa-76884158e2a0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:05.558416 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 141/278] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:33:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:05.559475 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774592ff-668b-4f80-82aa-76884158e2a0 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:05.572583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 138/279] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 10:33:05 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:33:05.572583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0362dc0-264f-4ae9-a2fd-d5987e049b23 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:05.617419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:05.643380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:05.688856 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774592ff-668b-4f80-82aa-76884158e2a0 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:05.692391 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0362dc0-264f-4ae9-a2fd-d5987e049b23 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:05.732039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa950c-71fd-43c7-8e12-454ca483e3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:05.732715 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa950c-71fd-43c7-8e12-454ca483e3a6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:05.732995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa950c-71fd-43c7-8e12-454ca483e3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:05.733270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa950c-71fd-43c7-8e12-454ca483e3a6 None admin] PATH_INFO: `/v3/users/203acbcb92f24bd1a0d04bff2e3bec52` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:05.733625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350c909-6f92-407c-9770-2157f66bc080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:05.734282 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c909-6f92-407c-9770-2157f66bc080 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:05.734617 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c909-6f92-407c-9770-2157f66bc080 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:05.734892 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c909-6f92-407c-9770-2157f66bc080 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:05.747042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350c909-6f92-407c-9770-2157f66bc080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:05.750086 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa950c-71fd-43c7-8e12-454ca483e3a6 None admin] RBAC: Authorizing `identity:get_user(user_id=203acbcb92f24bd1a0d04bff2e3bec52)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:05.751577 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa950c-71fd-43c7-8e12-454ca483e3a6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:05.752372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-d350c909-6f92-407c-9770-2157f66bc080 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 10:33:05.752372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:05.752372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:05.752372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:05.752372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:05.752372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:05.752372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:05.752372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:05.752372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:05.752372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:05.752372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:05.752372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:05.752372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:05.752372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:05.752372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:05.752372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:05.753296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:05.753296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:05.753296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:05.753296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:05.753296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:05.753296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:05.753296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:05.753296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:05.753296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:05.753296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:05.753296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:05.753296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:05.753296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:05.753296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:05.753296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:05.753296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:05.754798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:05.754798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:05.754798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:05.754798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:05.754798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:05.754798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:05.754798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:05.754798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:05.754798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:05.754798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:05.754798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 10:33:05.754798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:05.755567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 139/280] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:33:05 2022] GET /identity/v3/users/203acbcb92f24bd1a0d04bff2e3bec52 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:05.755648 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 142/281] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:05.755725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71308379-298a-4a34-8114-15d206ca7b68 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:05.755725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71308379-298a-4a34-8114-15d206ca7b68 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:05.755725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71308379-298a-4a34-8114-15d206ca7b68 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:05.756619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 140/282] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:05.760277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350c909-6f92-407c-9770-2157f66bc080 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:05.761771 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ec380-e771-44a8-af22-275e13db57be None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:05.762056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ec380-e771-44a8-af22-275e13db57be None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:05.762334 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ec380-e771-44a8-af22-275e13db57be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:05.782373 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e13ec380-e771-44a8-af22-275e13db57be None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:05.783584 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e13ec380-e771-44a8-af22-275e13db57be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:05.865337 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 141/283] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:05.866216 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ec380-e771-44a8-af22-275e13db57be None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:05.881092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350c909-6f92-407c-9770-2157f66bc080 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:05.894044 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:05.923730 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:05.934310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f857fb-aea8-4ac9-a379-24651c1786b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:05.934919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f857fb-aea8-4ac9-a379-24651c1786b0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:05.935194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f857fb-aea8-4ac9-a379-24651c1786b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:05.935461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f857fb-aea8-4ac9-a379-24651c1786b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:05.936183 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f857fb-aea8-4ac9-a379-24651c1786b0 None admin] RBAC: Adding query filter params (role.id=344db47133bb4fb2843696759f71b2c7, user.id=203acbcb92f24bd1a0d04bff2e3bec52, scope.system=all) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:05.936486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f857fb-aea8-4ac9-a379-24651c1786b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:05.938616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f857fb-aea8-4ac9-a379-24651c1786b0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:05.945188 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 143/284] 10.222.0.20 () {56 vars in 1308 bytes} [Sun Sep 11 10:33:05 2022] GET /identity/v3/role_assignments?user.id=203acbcb92f24bd1a0d04bff2e3bec52&scope.system=all&role.id=344db47133bb4fb2843696759f71b2c7 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:05.993367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ec380-e771-44a8-af22-275e13db57be None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:06.033396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce932aec-7c34-4e0f-93e4-82796389c186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:06.034029 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce932aec-7c34-4e0f-93e4-82796389c186 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:06.034318 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce932aec-7c34-4e0f-93e4-82796389c186 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:06.034598 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce932aec-7c34-4e0f-93e4-82796389c186 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:06.035841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce932aec-7c34-4e0f-93e4-82796389c186 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:06.036149 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce932aec-7c34-4e0f-93e4-82796389c186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:06.037616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce932aec-7c34-4e0f-93e4-82796389c186 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:06.047324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 142/285] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:33:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:06.053304 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f857fb-aea8-4ac9-a379-24651c1786b0 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:06.190516 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce932aec-7c34-4e0f-93e4-82796389c186 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:06.190709 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f857fb-aea8-4ac9-a379-24651c1786b0 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:06.235041 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296111dc-2140-47a0-a60c-1dc475988bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:06.235683 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296111dc-2140-47a0-a60c-1dc475988bb5 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:06.235961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296111dc-2140-47a0-a60c-1dc475988bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:06.236230 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296111dc-2140-47a0-a60c-1dc475988bb5 None admin] PATH_INFO: `/v3/users/088362a2500240cabc8b2ef3cedd5d43` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:06.239134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296111dc-2140-47a0-a60c-1dc475988bb5 None admin] RBAC: Authorizing `identity:get_user(user_id=088362a2500240cabc8b2ef3cedd5d43)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:06.240629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296111dc-2140-47a0-a60c-1dc475988bb5 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:06.242509 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 144/286] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:33:06 2022] GET /identity/v3/users/088362a2500240cabc8b2ef3cedd5d43 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:06.247844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296111dc-2140-47a0-a60c-1dc475988bb5 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:06.333281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:06.348998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce932aec-7c34-4e0f-93e4-82796389c186 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:06.358323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:06.397952 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5f7df-2402-4cfd-b84b-73cf69235efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:06.398829 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5f7df-2402-4cfd-b84b-73cf69235efb None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:06.399244 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5f7df-2402-4cfd-b84b-73cf69235efb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:06.399679 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5f7df-2402-4cfd-b84b-73cf69235efb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:06.420871 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5f7df-2402-4cfd-b84b-73cf69235efb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:06.432501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-dff5f7df-2402-4cfd-b84b-73cf69235efb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:06.432501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:06.432501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:06.432501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:06.432501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:06.432501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:06.432501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:06.432501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:06.432501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:06.432501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:06.432501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:06.432501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:06.432501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:06.432501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:06.432501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:06.432501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:06.433575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:06.433575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:06.433575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:06.433575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:06.433575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:06.433575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:06.433575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:06.433575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:06.433575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:06.433575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:06.433575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:06.433575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:06.433575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:06.433575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:06.433575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:06.433575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:06.434525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:06.434525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:06.434525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:06.434525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:06.434525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:06.434525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:06.434525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:06.434525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:06.434525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:06.434525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:06.434525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:06.434525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:06.437208 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 143/287] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:33:06.443270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296111dc-2140-47a0-a60c-1dc475988bb5 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:06.444259 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5f7df-2402-4cfd-b84b-73cf69235efb None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:06.512571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4b308-aa7f-4b9d-b861-bde0bc7dd1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:06.512571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4b308-aa7f-4b9d-b861-bde0bc7dd1a6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:06.512571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4b308-aa7f-4b9d-b861-bde0bc7dd1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:06.512571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4b308-aa7f-4b9d-b861-bde0bc7dd1a6 None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:06.513310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4b308-aa7f-4b9d-b861-bde0bc7dd1a6 None admin] RBAC: Authorizing `identity:get_project(project_id=0e22a81d096b490087b34c4bcaa8c9fa)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:06.513310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4b308-aa7f-4b9d-b861-bde0bc7dd1a6 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:06.513310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 145/288] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:06 2022] GET /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:06.517975 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4b308-aa7f-4b9d-b861-bde0bc7dd1a6 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:06.585104 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5f7df-2402-4cfd-b84b-73cf69235efb None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:06.651882 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811cae5-32ca-4338-b163-4f098d52ae8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:06.652870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811cae5-32ca-4338-b163-4f098d52ae8f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:06.653345 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811cae5-32ca-4338-b163-4f098d52ae8f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:06.653830 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811cae5-32ca-4338-b163-4f098d52ae8f None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:06.654684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811cae5-32ca-4338-b163-4f098d52ae8f None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:06.655186 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811cae5-32ca-4338-b163-4f098d52ae8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:06.657322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811cae5-32ca-4338-b163-4f098d52ae8f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:06.671226 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 144/289] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:33:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:06.677189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811cae5-32ca-4338-b163-4f098d52ae8f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:06.686987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:06.710119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4b308-aa7f-4b9d-b861-bde0bc7dd1a6 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:06.789947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:06.799029 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811cae5-32ca-4338-b163-4f098d52ae8f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:06.825956 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485c0ce-7dde-43e2-8151-b51876ff0b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:06.826650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485c0ce-7dde-43e2-8151-b51876ff0b9e None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:06.826936 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485c0ce-7dde-43e2-8151-b51876ff0b9e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:06.827213 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485c0ce-7dde-43e2-8151-b51876ff0b9e None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa/users/088362a2500240cabc8b2ef3cedd5d43/roles/4b4be11b3bbb487f996ab28b7f1bda4c` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:06.829214 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485c0ce-7dde-43e2-8151-b51876ff0b9e None admin] RBAC: Authorizing `identity:create_grant(project_id=0e22a81d096b490087b34c4bcaa8c9fa, user_id=088362a2500240cabc8b2ef3cedd5d43, role_id=4b4be11b3bbb487f996ab28b7f1bda4c)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:06.830688 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485c0ce-7dde-43e2-8151-b51876ff0b9e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:06.844327 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e115267-13f3-49d5-8400-6355b27975ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:06.845085 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115267-13f3-49d5-8400-6355b27975ca None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:06.845371 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115267-13f3-49d5-8400-6355b27975ca None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:06.845646 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115267-13f3-49d5-8400-6355b27975ca None admin] PATH_INFO: `/v3/users/fffaaaa8a28b414d96467d7df9f7bdca` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:06.852363 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e115267-13f3-49d5-8400-6355b27975ca None admin] RBAC: Authorizing `identity:get_user(user_id=fffaaaa8a28b414d96467d7df9f7bdca)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:06.855696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e115267-13f3-49d5-8400-6355b27975ca None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:06.857938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 146/290] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:33:06 2022] PUT /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa/users/088362a2500240cabc8b2ef3cedd5d43/roles/4b4be11b3bbb487f996ab28b7f1bda4c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:33:06.858983 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 145/291] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:33:06 2022] GET /identity/v3/users/fffaaaa8a28b414d96467d7df9f7bdca => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:06.865724 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485c0ce-7dde-43e2-8151-b51876ff0b9e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:07.018566 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485c0ce-7dde-43e2-8151-b51876ff0b9e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:07.056805 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457a6ff-59ca-4c4c-98bf-9fa08d8d8065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:07.057432 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457a6ff-59ca-4c4c-98bf-9fa08d8d8065 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:07.057710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457a6ff-59ca-4c4c-98bf-9fa08d8d8065 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:07.057984 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457a6ff-59ca-4c4c-98bf-9fa08d8d8065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:07.133742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:07.150947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457a6ff-59ca-4c4c-98bf-9fa08d8d8065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:07.152424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457a6ff-59ca-4c4c-98bf-9fa08d8d8065 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:07.267385 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 147/292] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:07.273596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e115267-13f3-49d5-8400-6355b27975ca None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:07.376897 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:07.410338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e115267-13f3-49d5-8400-6355b27975ca None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:07.444270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e363b3-1f06-4769-8656-b0690e156f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:07.444926 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e363b3-1f06-4769-8656-b0690e156f99 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:07.445204 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e363b3-1f06-4769-8656-b0690e156f99 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:07.445477 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e363b3-1f06-4769-8656-b0690e156f99 None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:07.446597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e363b3-1f06-4769-8656-b0690e156f99 None admin] RBAC: Authorizing `identity:get_project(project_id=0e22a81d096b490087b34c4bcaa8c9fa)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:07.448039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e363b3-1f06-4769-8656-b0690e156f99 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:07.449719 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 146/293] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:07 2022] GET /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:07.457876 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457a6ff-59ca-4c4c-98bf-9fa08d8d8065 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:07.589432 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:07.608425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457a6ff-59ca-4c4c-98bf-9fa08d8d8065 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:07.652411 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8693b90-fb09-4a49-93ad-c06a154f47c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:07.653053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8693b90-fb09-4a49-93ad-c06a154f47c1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:07.653330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8693b90-fb09-4a49-93ad-c06a154f47c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:07.653600 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8693b90-fb09-4a49-93ad-c06a154f47c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:07.654327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8693b90-fb09-4a49-93ad-c06a154f47c1 None admin] RBAC: Adding query filter params (role.id=344db47133bb4fb2843696759f71b2c7, scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa, user.id=fffaaaa8a28b414d96467d7df9f7bdca) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:07.654634 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8693b90-fb09-4a49-93ad-c06a154f47c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:07.656057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8693b90-fb09-4a49-93ad-c06a154f47c1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:07.665363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 148/294] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:33:07 2022] GET /identity/v3/role_assignments?user.id=fffaaaa8a28b414d96467d7df9f7bdca&scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa&role.id=344db47133bb4fb2843696759f71b2c7 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:08.349585 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232efc2-45a4-40c7-b3c7-35095d89ba73 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:08.350094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232efc2-45a4-40c7-b3c7-35095d89ba73 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:08.350167 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232efc2-45a4-40c7-b3c7-35095d89ba73 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:08.351716 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 147/295] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:08.357325 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d101ac-7fdf-41bc-9de9-9fec6df004ca None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:08.357609 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d101ac-7fdf-41bc-9de9-9fec6df004ca None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:08.357891 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d101ac-7fdf-41bc-9de9-9fec6df004ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:08.376675 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-c8d101ac-7fdf-41bc-9de9-9fec6df004ca None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:08.378039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bc0f6-cfb2-4392-a861-04f2b7fc2b01 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:08.378324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bc0f6-cfb2-4392-a861-04f2b7fc2b01 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:08.378503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c8d101ac-7fdf-41bc-9de9-9fec6df004ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:08.378593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bc0f6-cfb2-4392-a861-04f2b7fc2b01 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:08.382904 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 148/296] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:08.389315 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4114ff-aa1b-42f9-aba6-a81ff92539cf None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:08.389601 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4114ff-aa1b-42f9-aba6-a81ff92539cf None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:08.390109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4114ff-aa1b-42f9-aba6-a81ff92539cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:08.416531 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9f4114ff-aa1b-42f9-aba6-a81ff92539cf None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:08.419949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9f4114ff-aa1b-42f9-aba6-a81ff92539cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:08.466079 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 149/297] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:33:08.496105 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 149/298] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:08.632082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da44950-c354-4cf5-a2ea-c75d47e3bbfe None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:08.633044 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da44950-c354-4cf5-a2ea-c75d47e3bbfe None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:08.633534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da44950-c354-4cf5-a2ea-c75d47e3bbfe None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:08.635320 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 150/299] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:08.640642 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6140b9-3360-41fa-9520-b0e7aa7d100a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:08.641145 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6140b9-3360-41fa-9520-b0e7aa7d100a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:08.641622 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6140b9-3360-41fa-9520-b0e7aa7d100a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:08.659898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-eb6140b9-3360-41fa-9520-b0e7aa7d100a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:08.661398 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-eb6140b9-3360-41fa-9520-b0e7aa7d100a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:08.737097 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 150/300] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:08.751379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da44950-c354-4cf5-a2ea-c75d47e3bbfe None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:08.769916 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6140b9-3360-41fa-9520-b0e7aa7d100a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:08.772742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:08.853256 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:08.878886 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da44950-c354-4cf5-a2ea-c75d47e3bbfe None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:08.884331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6140b9-3360-41fa-9520-b0e7aa7d100a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:08.926054 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f5ca7-6f39-4db8-9c56-05d570678dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:08.926704 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f5ca7-6f39-4db8-9c56-05d570678dca None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:08.926971 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f5ca7-6f39-4db8-9c56-05d570678dca None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:08.927243 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f5ca7-6f39-4db8-9c56-05d570678dca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:08.932838 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1f7b2-142b-4840-a193-a0999ebbc182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:08.933473 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1f7b2-142b-4840-a193-a0999ebbc182 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:08.933754 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1f7b2-142b-4840-a193-a0999ebbc182 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:08.934029 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1f7b2-142b-4840-a193-a0999ebbc182 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:08.935194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1f7b2-142b-4840-a193-a0999ebbc182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:08.936658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1f7b2-142b-4840-a193-a0999ebbc182 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:08.938739 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 151/301] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:08.941033 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f5ca7-6f39-4db8-9c56-05d570678dca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:08.944450 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1f7b2-142b-4840-a193-a0999ebbc182 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:08.946959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-717f5ca7-6f39-4db8-9c56-05d570678dca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 10:33:08.946959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:08.946959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:08.946959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:08.946959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:08.946959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:08.946959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:08.946959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:08.946959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:08.946959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:08.946959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:08.946959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:08.946959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:08.946959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:08.946959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:08.946959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:08.947985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:08.947985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:08.947985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:08.947985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:08.947985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:08.947985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:08.947985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:08.947985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:08.947985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:08.947985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:08.947985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:08.947985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:08.947985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:08.947985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:08.947985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:08.947985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:08.949180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:08.949180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:08.949180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:08.949180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:08.949180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:08.949180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:08.949180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:08.949180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:08.949180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:08.949180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:08.949180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 10:33:08.949180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:08.952324 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 151/302] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:08.957732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f5ca7-6f39-4db8-9c56-05d570678dca None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:09.027240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:09.062114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1f7b2-142b-4840-a193-a0999ebbc182 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:09.085202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f5ca7-6f39-4db8-9c56-05d570678dca None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:09.099463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f634eb1-efcb-4ade-b4b5-423cf9876e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:09.100424 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f634eb1-efcb-4ade-b4b5-423cf9876e7d None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:09.100927 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f634eb1-efcb-4ade-b4b5-423cf9876e7d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:09.101379 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f634eb1-efcb-4ade-b4b5-423cf9876e7d None admin] PATH_INFO: `/v3/groups` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:09.102315 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f634eb1-efcb-4ade-b4b5-423cf9876e7d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:09.104132 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f634eb1-efcb-4ade-b4b5-423cf9876e7d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:09.120272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcb01c-4a66-4dd5-9543-6b532f7b0922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:09.121117 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcb01c-4a66-4dd5-9543-6b532f7b0922 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:09.121396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcb01c-4a66-4dd5-9543-6b532f7b0922 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:09.121667 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcb01c-4a66-4dd5-9543-6b532f7b0922 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:09.122337 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffcb01c-4a66-4dd5-9543-6b532f7b0922 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:09.122646 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffcb01c-4a66-4dd5-9543-6b532f7b0922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:09.132612 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffcb01c-4a66-4dd5-9543-6b532f7b0922 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:09.132811 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 152/303] 10.222.0.20 () {60 vars in 1134 bytes} [Sun Sep 11 10:33:08 2022] POST /identity/v3/groups => generated 229 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:33:09.132811 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f634eb1-efcb-4ade-b4b5-423cf9876e7d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:09.134244 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 152/304] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:33:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:09.139911 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcb01c-4a66-4dd5-9543-6b532f7b0922 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:09.144925 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:09.261899 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f634eb1-efcb-4ade-b4b5-423cf9876e7d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:09.265019 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcb01c-4a66-4dd5-9543-6b532f7b0922 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:09.296818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:09.305188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a020b4d-b5b2-4980-999e-804ed9acabbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:09.306341 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a020b4d-b5b2-4980-999e-804ed9acabbf None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:09.306626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a020b4d-b5b2-4980-999e-804ed9acabbf None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:09.307073 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a020b4d-b5b2-4980-999e-804ed9acabbf None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:09.322012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a020b4d-b5b2-4980-999e-804ed9acabbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:09.324014 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0fe87-f668-4683-bb67-08df0c975634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:09.324754 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0fe87-f668-4683-bb67-08df0c975634 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:09.325038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0fe87-f668-4683-bb67-08df0c975634 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:09.325317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0fe87-f668-4683-bb67-08df0c975634 None admin] PATH_INFO: `/v3/users/2d11ccaf3e4943ed933851b2854bfbae` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:09.327594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-2a020b4d-b5b2-4980-999e-804ed9acabbf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:09.327594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:09.327594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:09.327594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:09.327594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:09.327594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:09.327594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:09.327594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:09.327594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:09.327594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:09.327594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:09.327594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:09.327594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:09.327594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:09.327594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:09.327594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:09.328453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:09.328453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:09.328453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:09.328453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:09.328453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:09.328453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:09.328453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:09.328453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:09.328453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:09.328453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:09.328453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:09.328453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:09.328453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:09.328453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:09.328453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:09.328453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:09.329274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:09.329274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:09.329274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:09.329274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:09.329274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:09.329274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:09.329274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:09.329274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:09.329274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:09.329274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:09.329274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:09.329274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:09.329860 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 153/305] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:09.337155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a020b4d-b5b2-4980-999e-804ed9acabbf None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:09.347128 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0fe87-f668-4683-bb67-08df0c975634 None admin] RBAC: Authorizing `identity:get_user(user_id=2d11ccaf3e4943ed933851b2854bfbae)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:09.350414 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0fe87-f668-4683-bb67-08df0c975634 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:09.351704 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 153/306] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:33:09 2022] GET /identity/v3/users/2d11ccaf3e4943ed933851b2854bfbae => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:09.356499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0fe87-f668-4683-bb67-08df0c975634 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:09.438418 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:09.467506 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a020b4d-b5b2-4980-999e-804ed9acabbf None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:09.496995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0fe87-f668-4683-bb67-08df0c975634 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:09.503269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f1bf3-544e-4adc-acfb-d0e62a61d096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:09.504004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f1bf3-544e-4adc-acfb-d0e62a61d096 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:09.504291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f1bf3-544e-4adc-acfb-d0e62a61d096 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:09.504581 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f1bf3-544e-4adc-acfb-d0e62a61d096 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:09.505251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f1bf3-544e-4adc-acfb-d0e62a61d096 None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:09.505552 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f1bf3-544e-4adc-acfb-d0e62a61d096 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:09.506997 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f1bf3-544e-4adc-acfb-d0e62a61d096 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:09.517764 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 154/307] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:33:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:09.523275 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e839eb7-1abe-42eb-813d-9ec899898db2 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:09.523275 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e839eb7-1abe-42eb-813d-9ec899898db2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:09.523275 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e839eb7-1abe-42eb-813d-9ec899898db2 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:09.523275 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 155/308] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:09.523808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e839eb7-1abe-42eb-813d-9ec899898db2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:09.535849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc23a85-6209-481c-aff5-61cab6261e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:09.536516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc23a85-6209-481c-aff5-61cab6261e2f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:09.536825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc23a85-6209-481c-aff5-61cab6261e2f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:09.537099 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc23a85-6209-481c-aff5-61cab6261e2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:09.537830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc23a85-6209-481c-aff5-61cab6261e2f None admin] RBAC: Adding query filter params (role.id=4b4be11b3bbb487f996ab28b7f1bda4c, user.id=2d11ccaf3e4943ed933851b2854bfbae, scope.system=all) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:09.538191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc23a85-6209-481c-aff5-61cab6261e2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:09.539630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc23a85-6209-481c-aff5-61cab6261e2f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:09.548611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 154/309] 10.222.0.20 () {56 vars in 1308 bytes} [Sun Sep 11 10:33:09 2022] GET /identity/v3/role_assignments?user.id=2d11ccaf3e4943ed933851b2854bfbae&scope.system=all&role.id=4b4be11b3bbb487f996ab28b7f1bda4c => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:09.548611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad917cac-5268-4f0f-9ff7-677c1c334fcc None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:09.548611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad917cac-5268-4f0f-9ff7-677c1c334fcc None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:09.548611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad917cac-5268-4f0f-9ff7-677c1c334fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:09.570818 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-ad917cac-5268-4f0f-9ff7-677c1c334fcc None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:09.571448 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ad917cac-5268-4f0f-9ff7-677c1c334fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:09.593840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:09.655686 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 155/310] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:09.663087 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e839eb7-1abe-42eb-813d-9ec899898db2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:09.704684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dae9f8-ba2b-4e51-a209-eb8b20d04eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:09.705556 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dae9f8-ba2b-4e51-a209-eb8b20d04eeb None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:09.705998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dae9f8-ba2b-4e51-a209-eb8b20d04eeb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:09.706412 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dae9f8-ba2b-4e51-a209-eb8b20d04eeb None admin] PATH_INFO: `/v3/users/203acbcb92f24bd1a0d04bff2e3bec52` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:09.707935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dae9f8-ba2b-4e51-a209-eb8b20d04eeb None admin] RBAC: Authorizing `identity:get_user(user_id=203acbcb92f24bd1a0d04bff2e3bec52)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:09.709596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dae9f8-ba2b-4e51-a209-eb8b20d04eeb None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:09.711890 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 156/311] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:33:09 2022] GET /identity/v3/users/203acbcb92f24bd1a0d04bff2e3bec52 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:09.722267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad917cac-5268-4f0f-9ff7-677c1c334fcc None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:09.780509 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:09.829086 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad917cac-5268-4f0f-9ff7-677c1c334fcc None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:09.865292 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687382b-c878-422f-b3b6-5d6d0e4d8c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:09.866215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687382b-c878-422f-b3b6-5d6d0e4d8c75 None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:09.866633 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687382b-c878-422f-b3b6-5d6d0e4d8c75 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:09.867045 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687382b-c878-422f-b3b6-5d6d0e4d8c75 None admin] PATH_INFO: `/v3/system/users/203acbcb92f24bd1a0d04bff2e3bec52/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:09.868621 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687382b-c878-422f-b3b6-5d6d0e4d8c75 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=203acbcb92f24bd1a0d04bff2e3bec52, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:09.870144 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687382b-c878-422f-b3b6-5d6d0e4d8c75 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:09.881600 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 156/312] 10.222.0.20 () {58 vars in 1334 bytes} [Sun Sep 11 10:33:09 2022] PUT /identity/v3/system/users/203acbcb92f24bd1a0d04bff2e3bec52/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:33:09.942018 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dae9f8-ba2b-4e51-a209-eb8b20d04eeb None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:10.054711 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dae9f8-ba2b-4e51-a209-eb8b20d04eeb None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:10.075388 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:10.092181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a567124-0315-41e9-8b47-6adc2737df2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:10.092858 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a567124-0315-41e9-8b47-6adc2737df2e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:10.093139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a567124-0315-41e9-8b47-6adc2737df2e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:10.093421 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a567124-0315-41e9-8b47-6adc2737df2e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:10.106080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a567124-0315-41e9-8b47-6adc2737df2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:10.111656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-1a567124-0315-41e9-8b47-6adc2737df2e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 10:33:10.111656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:10.111656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:10.111656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:10.111656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:10.111656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:10.111656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:10.111656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:10.111656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:10.111656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:10.111656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:10.111656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:10.111656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:10.111656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:10.111656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:10.111656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:10.112597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:10.112597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:10.112597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:10.112597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:10.112597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:10.112597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:10.112597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:10.112597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:10.112597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:10.112597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:10.112597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:10.112597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:10.112597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:10.112597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:10.112597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:10.112597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:10.114091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:10.114091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:10.114091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:10.114091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:10.114091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:10.114091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:10.114091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:10.114091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:10.114091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:10.114091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:10.114091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 10:33:10.114091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:10.114091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 157/313] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:10.121849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687382b-c878-422f-b3b6-5d6d0e4d8c75 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:10.227194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687382b-c878-422f-b3b6-5d6d0e4d8c75 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:10.245148 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:10.268358 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756fd4e-232e-4d54-a289-d16d0ccd3422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:10.269007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756fd4e-232e-4d54-a289-d16d0ccd3422 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:10.269933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756fd4e-232e-4d54-a289-d16d0ccd3422 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:10.270202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756fd4e-232e-4d54-a289-d16d0ccd3422 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:10.270894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756fd4e-232e-4d54-a289-d16d0ccd3422 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:10.271193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756fd4e-232e-4d54-a289-d16d0ccd3422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:10.272595 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756fd4e-232e-4d54-a289-d16d0ccd3422 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:10.281507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 157/314] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:33:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:10.287384 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a567124-0315-41e9-8b47-6adc2737df2e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:10.391193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a567124-0315-41e9-8b47-6adc2737df2e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:10.427115 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd129e8-6a0d-4383-8f3b-cca889049666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:10.427744 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd129e8-6a0d-4383-8f3b-cca889049666 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:10.428020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd129e8-6a0d-4383-8f3b-cca889049666 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:10.428335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd129e8-6a0d-4383-8f3b-cca889049666 None admin] PATH_INFO: `/v3/users/088362a2500240cabc8b2ef3cedd5d43` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:10.429489 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd129e8-6a0d-4383-8f3b-cca889049666 None admin] RBAC: Authorizing `identity:get_user(user_id=088362a2500240cabc8b2ef3cedd5d43)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:10.430967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd129e8-6a0d-4383-8f3b-cca889049666 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:10.432858 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 158/315] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:33:10 2022] GET /identity/v3/users/088362a2500240cabc8b2ef3cedd5d43 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:10.438400 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756fd4e-232e-4d54-a289-d16d0ccd3422 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:10.546398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756fd4e-232e-4d54-a289-d16d0ccd3422 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:10.581044 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59c11d-2e5f-4fdf-9e42-bf855dd44306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:10.581685 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59c11d-2e5f-4fdf-9e42-bf855dd44306 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:10.582025 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59c11d-2e5f-4fdf-9e42-bf855dd44306 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:10.582292 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59c11d-2e5f-4fdf-9e42-bf855dd44306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:10.633387 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:10.660955 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59c11d-2e5f-4fdf-9e42-bf855dd44306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:10.662353 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59c11d-2e5f-4fdf-9e42-bf855dd44306 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:10.773078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 158/316] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:10.778591 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd129e8-6a0d-4383-8f3b-cca889049666 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:10.828592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:10.885617 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd129e8-6a0d-4383-8f3b-cca889049666 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:10.920012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c292c-84c5-4919-b314-d3f1d0ced69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:10.920572 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c292c-84c5-4919-b314-d3f1d0ced69e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:10.920859 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c292c-84c5-4919-b314-d3f1d0ced69e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:10.921125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c292c-84c5-4919-b314-d3f1d0ced69e None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:10.922250 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c292c-84c5-4919-b314-d3f1d0ced69e None admin] RBAC: Authorizing `identity:get_project(project_id=0e22a81d096b490087b34c4bcaa8c9fa)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:10.923749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c292c-84c5-4919-b314-d3f1d0ced69e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:10.926352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 159/317] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:10 2022] GET /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:10.934127 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59c11d-2e5f-4fdf-9e42-bf855dd44306 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:11.026404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:11.047286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59c11d-2e5f-4fdf-9e42-bf855dd44306 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:11.083384 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f068d1-1a30-4b5b-83ed-07791c2cf575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:11.083992 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f068d1-1a30-4b5b-83ed-07791c2cf575 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:11.084365 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f068d1-1a30-4b5b-83ed-07791c2cf575 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:11.084670 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f068d1-1a30-4b5b-83ed-07791c2cf575 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:11.085444 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f068d1-1a30-4b5b-83ed-07791c2cf575 None admin] RBAC: Adding query filter params (role.id=4b4be11b3bbb487f996ab28b7f1bda4c, scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa, user.id=088362a2500240cabc8b2ef3cedd5d43) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:11.085755 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f068d1-1a30-4b5b-83ed-07791c2cf575 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:11.087182 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f068d1-1a30-4b5b-83ed-07791c2cf575 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:11.093373 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 159/318] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:33:10 2022] GET /identity/v3/role_assignments?user.id=088362a2500240cabc8b2ef3cedd5d43&scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa&role.id=4b4be11b3bbb487f996ab28b7f1bda4c => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:11.447120 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b300c25-1be4-4ac8-a5ac-0382322b54e7 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:11.447539 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b300c25-1be4-4ac8-a5ac-0382322b54e7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:11.447710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b300c25-1be4-4ac8-a5ac-0382322b54e7 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:11.449208 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 160/319] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:11.454285 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cca85f-b225-463d-b287-56c5bf628cd6 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:11.454579 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cca85f-b225-463d-b287-56c5bf628cd6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:11.454854 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cca85f-b225-463d-b287-56c5bf628cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:11.473674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-69cca85f-b225-463d-b287-56c5bf628cd6 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:11.474872 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-69cca85f-b225-463d-b287-56c5bf628cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:11.542617 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 160/320] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:11.832293 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b300c25-1be4-4ac8-a5ac-0382322b54e7 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:11.888893 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619cef0-9a12-4bfb-b4a6-46fc7e57e3bc None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:11.889406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619cef0-9a12-4bfb-b4a6-46fc7e57e3bc None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:11.889871 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619cef0-9a12-4bfb-b4a6-46fc7e57e3bc None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:11.891373 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 161/321] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:33:11.896388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780ef34-90f3-4cd9-9ed7-47a60bea13b8 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:11.896704 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780ef34-90f3-4cd9-9ed7-47a60bea13b8 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:11.896981 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780ef34-90f3-4cd9-9ed7-47a60bea13b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:11.917763 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-2780ef34-90f3-4cd9-9ed7-47a60bea13b8 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:11.918959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2780ef34-90f3-4cd9-9ed7-47a60bea13b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:11.939851 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b300c25-1be4-4ac8-a5ac-0382322b54e7 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:11.956392 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:11.979109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7693bb8-d016-4b56-ba40-9abb0af213d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:11.979670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7693bb8-d016-4b56-ba40-9abb0af213d9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:11.979971 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7693bb8-d016-4b56-ba40-9abb0af213d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:11.980253 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7693bb8-d016-4b56-ba40-9abb0af213d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:11.981827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7693bb8-d016-4b56-ba40-9abb0af213d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:11.984381 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7693bb8-d016-4b56-ba40-9abb0af213d9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:11.988594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 161/322] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:11.992355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7693bb8-d016-4b56-ba40-9abb0af213d9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:11.997182 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 162/323] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:33:12.105223 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7693bb8-d016-4b56-ba40-9abb0af213d9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:12.138796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a5622-48d0-4f47-9d12-fc2e44dfb8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:12.139403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a5622-48d0-4f47-9d12-fc2e44dfb8ea None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:12.139685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a5622-48d0-4f47-9d12-fc2e44dfb8ea None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:12.139960 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a5622-48d0-4f47-9d12-fc2e44dfb8ea None admin] PATH_INFO: `/v3/groups` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:12.140617 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a5622-48d0-4f47-9d12-fc2e44dfb8ea None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:12.142049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a5622-48d0-4f47-9d12-fc2e44dfb8ea None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:12.162839 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 162/324] 10.222.0.20 () {60 vars in 1134 bytes} [Sun Sep 11 10:33:11 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:33:12.190956 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5db95-cc2d-4e60-bdfe-3ef1f2289d70 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:12.191252 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5db95-cc2d-4e60-bdfe-3ef1f2289d70 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:12.191527 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5db95-cc2d-4e60-bdfe-3ef1f2289d70 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:12.193024 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 163/325] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:12.199017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd6c89-4212-4a30-b579-86373f481b4a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:12.199311 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd6c89-4212-4a30-b579-86373f481b4a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:12.199591 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd6c89-4212-4a30-b579-86373f481b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:12.218403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e7cd6c89-4212-4a30-b579-86373f481b4a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:12.219669 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e7cd6c89-4212-4a30-b579-86373f481b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:12.264847 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:12.276891 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5db95-cc2d-4e60-bdfe-3ef1f2289d70 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:12.281165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:12.296484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 163/326] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:12.395344 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5db95-cc2d-4e60-bdfe-3ef1f2289d70 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:12.430825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b2692-9ecb-4633-98b5-7977fe4b92e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:12.431662 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b2692-9ecb-4633-98b5-7977fe4b92e4 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:12.431792 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b2692-9ecb-4633-98b5-7977fe4b92e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:12.431981 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b2692-9ecb-4633-98b5-7977fe4b92e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:12.443197 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b2692-9ecb-4633-98b5-7977fe4b92e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:12.448156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-160b2692-9ecb-4633-98b5-7977fe4b92e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 10:33:12.448156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:12.448156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:12.448156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:12.448156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:12.448156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:12.448156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:12.448156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:12.448156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:12.448156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:12.448156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:12.448156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:12.448156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:12.448156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:12.448156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:12.448156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:12.449157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:12.449157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:12.449157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:12.449157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:12.449157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:12.449157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:12.449157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:12.449157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:12.449157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:12.449157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:12.449157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:12.449157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:12.449157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:12.449157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:12.449157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:12.449157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:12.450106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:12.450106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:12.450106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:12.450106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:12.450106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:12.450106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:12.450106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:12.450106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:12.450106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:12.450106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:12.450106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 10:33:12.450106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:12.450106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 164/327] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:33:12.456696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd6c89-4212-4a30-b579-86373f481b4a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:12.567285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd6c89-4212-4a30-b579-86373f481b4a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:12.592498 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b2692-9ecb-4633-98b5-7977fe4b92e4 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:12.604689 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81d2e1-c036-4cd8-b0f6-5bdc2a78137e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:12.605668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81d2e1-c036-4cd8-b0f6-5bdc2a78137e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:12.605955 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81d2e1-c036-4cd8-b0f6-5bdc2a78137e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:12.606234 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81d2e1-c036-4cd8-b0f6-5bdc2a78137e None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:12.606911 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81d2e1-c036-4cd8-b0f6-5bdc2a78137e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:12.607218 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81d2e1-c036-4cd8-b0f6-5bdc2a78137e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:12.608618 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81d2e1-c036-4cd8-b0f6-5bdc2a78137e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:12.617947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 164/328] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:33:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:12.623358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81d2e1-c036-4cd8-b0f6-5bdc2a78137e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:12.677275 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:12.694380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:12.738885 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b2692-9ecb-4633-98b5-7977fe4b92e4 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:12.770113 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81d2e1-c036-4cd8-b0f6-5bdc2a78137e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:12.790664 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82482f14-6c94-49ca-ad19-fb1eb65a9826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:12.791305 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82482f14-6c94-49ca-ad19-fb1eb65a9826 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:12.791916 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82482f14-6c94-49ca-ad19-fb1eb65a9826 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:12.791916 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82482f14-6c94-49ca-ad19-fb1eb65a9826 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:12.802613 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82482f14-6c94-49ca-ad19-fb1eb65a9826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:12.807505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-82482f14-6c94-49ca-ad19-fb1eb65a9826 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:12.807505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:12.807505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:12.807505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:12.807505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:12.807505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:12.807505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:12.807505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:12.807505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:12.807505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:12.807505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:12.807505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:12.807505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:12.807505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:12.807505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:12.807505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:12.808388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:12.808388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:12.808388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:12.808388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:12.808388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:12.808388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:12.808388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:12.808388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:12.808388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:12.808388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:12.808388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:12.808388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:12.808388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:12.808388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:12.808388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:12.808388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:12.809209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:12.809209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:12.809209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:12.809209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:12.809209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:12.809209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:12.809209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:12.809209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:12.809209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:12.809209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:12.809209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:12.809209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:12.809209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 165/329] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:12.814177 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82482f14-6c94-49ca-ad19-fb1eb65a9826 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:12.823980 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cf14e-4772-4c59-957f-c31b82772b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:12.824964 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cf14e-4772-4c59-957f-c31b82772b00 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:12.825986 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cf14e-4772-4c59-957f-c31b82772b00 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:12.826468 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cf14e-4772-4c59-957f-c31b82772b00 None admin] PATH_INFO: `/v3/users/2d11ccaf3e4943ed933851b2854bfbae` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:12.828311 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1cf14e-4772-4c59-957f-c31b82772b00 None admin] RBAC: Authorizing `identity:get_user(user_id=2d11ccaf3e4943ed933851b2854bfbae)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:12.830724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1cf14e-4772-4c59-957f-c31b82772b00 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:12.833228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 165/330] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:33:12 2022] GET /identity/v3/users/2d11ccaf3e4943ed933851b2854bfbae => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:12.839088 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cf14e-4772-4c59-957f-c31b82772b00 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:12.940574 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82482f14-6c94-49ca-ad19-fb1eb65a9826 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:12.960890 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cf14e-4772-4c59-957f-c31b82772b00 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:12.963302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:12.973164 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:12.987596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131a394-c5c1-4caa-85c1-44f39e63e2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:12.988886 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131a394-c5c1-4caa-85c1-44f39e63e2dd None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:12.989173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131a394-c5c1-4caa-85c1-44f39e63e2dd None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:12.989421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131a394-c5c1-4caa-85c1-44f39e63e2dd None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:12.990191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131a394-c5c1-4caa-85c1-44f39e63e2dd None admin] RBAC: Adding query filter params (name=member) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:12.990491 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131a394-c5c1-4caa-85c1-44f39e63e2dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:12.991991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131a394-c5c1-4caa-85c1-44f39e63e2dd None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:13.001557 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 166/331] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:33:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:13.004791 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fd12c-4e22-49f7-a220-1df6bdc766b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:13.005464 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fd12c-4e22-49f7-a220-1df6bdc766b5 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:13.005746 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fd12c-4e22-49f7-a220-1df6bdc766b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:13.006015 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fd12c-4e22-49f7-a220-1df6bdc766b5 None admin] PATH_INFO: `/v3/system/users/2d11ccaf3e4943ed933851b2854bfbae/roles/4b4be11b3bbb487f996ab28b7f1bda4c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:13.009709 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131a394-c5c1-4caa-85c1-44f39e63e2dd None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:13.011044 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fd12c-4e22-49f7-a220-1df6bdc766b5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2d11ccaf3e4943ed933851b2854bfbae, role_id=4b4be11b3bbb487f996ab28b7f1bda4c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:13.012469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fd12c-4e22-49f7-a220-1df6bdc766b5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:13.025667 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 166/332] 10.222.0.20 () {58 vars in 1334 bytes} [Sun Sep 11 10:33:12 2022] PUT /identity/v3/system/users/2d11ccaf3e4943ed933851b2854bfbae/roles/4b4be11b3bbb487f996ab28b7f1bda4c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:33:13.140920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131a394-c5c1-4caa-85c1-44f39e63e2dd None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:13.180717 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb16d5e-f45a-4ab3-9276-1e2c160760ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:13.181441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb16d5e-f45a-4ab3-9276-1e2c160760ce None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:13.181719 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb16d5e-f45a-4ab3-9276-1e2c160760ce None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:13.181990 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb16d5e-f45a-4ab3-9276-1e2c160760ce None admin] PATH_INFO: `/v3/users/203acbcb92f24bd1a0d04bff2e3bec52` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:13.183221 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb16d5e-f45a-4ab3-9276-1e2c160760ce None admin] RBAC: Authorizing `identity:get_user(user_id=203acbcb92f24bd1a0d04bff2e3bec52)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:13.184796 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb16d5e-f45a-4ab3-9276-1e2c160760ce None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:13.186796 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 167/333] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:33:13 2022] GET /identity/v3/users/203acbcb92f24bd1a0d04bff2e3bec52 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:13.195622 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fd12c-4e22-49f7-a220-1df6bdc766b5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:13.313264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fd12c-4e22-49f7-a220-1df6bdc766b5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:13.352385 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151773b0-ec25-4bef-8399-a71cadf0a13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:13.353079 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151773b0-ec25-4bef-8399-a71cadf0a13e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:13.353362 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151773b0-ec25-4bef-8399-a71cadf0a13e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:13.353636 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151773b0-ec25-4bef-8399-a71cadf0a13e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:13.354366 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151773b0-ec25-4bef-8399-a71cadf0a13e None admin] RBAC: Adding query filter params (role.id=344db47133bb4fb2843696759f71b2c7, user.id=203acbcb92f24bd1a0d04bff2e3bec52, scope.system=all) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:13.354677 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151773b0-ec25-4bef-8399-a71cadf0a13e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:13.356180 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151773b0-ec25-4bef-8399-a71cadf0a13e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:13.369003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 167/334] 10.222.0.20 () {56 vars in 1308 bytes} [Sun Sep 11 10:33:13 2022] GET /identity/v3/role_assignments?user.id=203acbcb92f24bd1a0d04bff2e3bec52&scope.system=all&role.id=344db47133bb4fb2843696759f71b2c7 => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:15.068887 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cdf56-3407-4a9d-848c-311dad29822d None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:15.069399 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cdf56-3407-4a9d-848c-311dad29822d None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:15.069477 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cdf56-3407-4a9d-848c-311dad29822d None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:15.071052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 168/335] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:15.076730 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4ff91-e36a-42ba-aa18-e21fcddc0a1f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:15.077135 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4ff91-e36a-42ba-aa18-e21fcddc0a1f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:15.077305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4ff91-e36a-42ba-aa18-e21fcddc0a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:15.109562 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-02f4ff91-e36a-42ba-aa18-e21fcddc0a1f None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:15.110819 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-02f4ff91-e36a-42ba-aa18-e21fcddc0a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:15.144987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:15.200983 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 168/336] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:33:15.242215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc34f5-f95b-466b-aab5-f7544e720951 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:15.242531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc34f5-f95b-466b-aab5-f7544e720951 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:15.242774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc34f5-f95b-466b-aab5-f7544e720951 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:15.244265 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 169/337] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:15.249754 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e82f6-67e4-4f57-aefc-d3b4bfa84c84 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:15.250105 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e82f6-67e4-4f57-aefc-d3b4bfa84c84 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:15.250387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e82f6-67e4-4f57-aefc-d3b4bfa84c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:15.277557 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3a0e82f6-67e4-4f57-aefc-d3b4bfa84c84 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:15.278769 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3a0e82f6-67e4-4f57-aefc-d3b4bfa84c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:15.358889 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 169/338] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:15.726859 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b7f2-594b-43f2-aec0-9242542bdeca None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:15.727138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b7f2-594b-43f2-aec0-9242542bdeca None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:15.727617 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b7f2-594b-43f2-aec0-9242542bdeca None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:15.729247 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 170/339] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:15.734920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66086902-8f09-434b-9c37-800cb0c6a461 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:15.735185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66086902-8f09-434b-9c37-800cb0c6a461 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:15.735459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66086902-8f09-434b-9c37-800cb0c6a461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:15.761584 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-66086902-8f09-434b-9c37-800cb0c6a461 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:15.762795 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-66086902-8f09-434b-9c37-800cb0c6a461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:15.832085 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8b7f2-594b-43f2-aec0-9242542bdeca None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:15.852878 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 170/340] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:15.853576 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66086902-8f09-434b-9c37-800cb0c6a461 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:15.886497 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:15.935239 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:16.009140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66086902-8f09-434b-9c37-800cb0c6a461 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:16.033768 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8b7f2-594b-43f2-aec0-9242542bdeca None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:16.083308 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c924e-c4f6-4a4e-9a1b-b0905f2973bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:16.083956 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c924e-c4f6-4a4e-9a1b-b0905f2973bb None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:16.084235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c924e-c4f6-4a4e-9a1b-b0905f2973bb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:16.084502 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c924e-c4f6-4a4e-9a1b-b0905f2973bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:16.106470 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988c23a-c2e6-4a34-91b8-99509b9b85e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:16.107163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988c23a-c2e6-4a34-91b8-99509b9b85e9 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:16.107419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988c23a-c2e6-4a34-91b8-99509b9b85e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:16.107696 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988c23a-c2e6-4a34-91b8-99509b9b85e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:16.108647 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c924e-c4f6-4a4e-9a1b-b0905f2973bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:16.114410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-819c924e-c4f6-4a4e-9a1b-b0905f2973bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:16.114410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:16.114410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:16.114410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:16.114410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:16.114410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:16.114410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:16.114410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:16.114410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:16.114410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:16.114410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:16.114410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:16.114410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:16.114410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:16.114410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:16.114410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:16.115331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:16.115331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:16.115331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:16.115331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:16.115331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:16.115331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:16.115331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:16.115331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:16.115331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:16.115331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:16.115331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:16.115331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:16.115331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:16.115331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:16.115331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:16.115331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:16.116126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:16.116126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:16.116126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:16.116126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:16.116126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:16.116126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:16.116126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:16.116126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:16.116126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:16.116126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:16.116126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:16.116126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:16.116126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 171/341] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:16.121905 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c924e-c4f6-4a4e-9a1b-b0905f2973bb None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:16.134409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988c23a-c2e6-4a34-91b8-99509b9b85e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:16.139920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-3988c23a-c2e6-4a34-91b8-99509b9b85e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:33:16.139920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:16.139920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:16.139920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:16.139920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:16.139920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:16.139920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:16.139920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:16.139920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:16.139920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:16.139920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:16.139920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:16.139920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:16.139920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:16.139920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:16.139920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:16.140908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:16.140908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:16.140908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:16.140908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:16.140908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:16.140908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:16.140908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:16.140908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:16.140908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:16.140908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:16.140908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:16.140908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:16.140908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:16.140908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:16.140908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:16.140908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:16.141674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:16.141674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:16.141674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:16.141674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:16.141674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:16.141674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:16.141674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:16.141674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:16.141674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:16.141674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:16.141674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:33:16.141674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:16.149517 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 171/342] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:33:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:16.155519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988c23a-c2e6-4a34-91b8-99509b9b85e9 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:16.275104 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:16.320471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c924e-c4f6-4a4e-9a1b-b0905f2973bb None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:16.320689 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988c23a-c2e6-4a34-91b8-99509b9b85e9 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:16.341448 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:16.375401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd596402-4380-4c18-a352-e269af79c1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:16.376018 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd596402-4380-4c18-a352-e269af79c1d3 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:16.376297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd596402-4380-4c18-a352-e269af79c1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:16.376584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd596402-4380-4c18-a352-e269af79c1d3 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:16.377271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd596402-4380-4c18-a352-e269af79c1d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:16.377578 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd596402-4380-4c18-a352-e269af79c1d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:16.379083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd596402-4380-4c18-a352-e269af79c1d3 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:16.394783 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 172/343] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:16.397357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d388593-ec5d-49fb-a008-4a116bc11f17 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:16.397642 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d388593-ec5d-49fb-a008-4a116bc11f17 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:16.397918 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d388593-ec5d-49fb-a008-4a116bc11f17 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:16.399290 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 173/344] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:16.400436 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12c980-e060-4bc4-9c33-79e6ca2c5618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:16.401136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12c980-e060-4bc4-9c33-79e6ca2c5618 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:16.401416 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12c980-e060-4bc4-9c33-79e6ca2c5618 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:16.401689 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12c980-e060-4bc4-9c33-79e6ca2c5618 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:16.402710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12c980-e060-4bc4-9c33-79e6ca2c5618 None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:16.403020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12c980-e060-4bc4-9c33-79e6ca2c5618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:16.404493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12c980-e060-4bc4-9c33-79e6ca2c5618 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:16.406874 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d388593-ec5d-49fb-a008-4a116bc11f17 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:16.418135 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 172/345] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:33:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:16.423528 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210d634-8763-4b0f-a47b-16d8f070094c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:16.423823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210d634-8763-4b0f-a47b-16d8f070094c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:16.424099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210d634-8763-4b0f-a47b-16d8f070094c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:16.450662 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9210d634-8763-4b0f-a47b-16d8f070094c None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:16.451854 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9210d634-8763-4b0f-a47b-16d8f070094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:16.536668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 173/346] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:16.536668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210d634-8763-4b0f-a47b-16d8f070094c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:16.564152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d388593-ec5d-49fb-a008-4a116bc11f17 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:16.604942 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:16.633048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c26a6-7847-4bf7-aaf3-4420bccf8442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:16.634067 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c26a6-7847-4bf7-aaf3-4420bccf8442 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:16.634542 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c26a6-7847-4bf7-aaf3-4420bccf8442 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:16.635012 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c26a6-7847-4bf7-aaf3-4420bccf8442 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:16.641826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210d634-8763-4b0f-a47b-16d8f070094c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:16.679883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc597f-5fd5-41fc-90c4-f1bcad138a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:16.680475 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc597f-5fd5-41fc-90c4-f1bcad138a53 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:16.680785 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc597f-5fd5-41fc-90c4-f1bcad138a53 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:16.681058 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc597f-5fd5-41fc-90c4-f1bcad138a53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:16.718226 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:16.763044 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc597f-5fd5-41fc-90c4-f1bcad138a53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:16.764678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc597f-5fd5-41fc-90c4-f1bcad138a53 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:16.789476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c26a6-7847-4bf7-aaf3-4420bccf8442 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:16.791245 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c26a6-7847-4bf7-aaf3-4420bccf8442 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:16.839283 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:16.878172 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 174/347] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:16.879436 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc597f-5fd5-41fc-90c4-f1bcad138a53 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:16.972784 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 174/348] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:16.973852 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c26a6-7847-4bf7-aaf3-4420bccf8442 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:16.995135 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc597f-5fd5-41fc-90c4-f1bcad138a53 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:17.035133 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea48f5-f9a3-4b2a-bdab-89d3eaa8fff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:17.035892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea48f5-f9a3-4b2a-bdab-89d3eaa8fff9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:17.036270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea48f5-f9a3-4b2a-bdab-89d3eaa8fff9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:17.036673 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea48f5-f9a3-4b2a-bdab-89d3eaa8fff9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:17.049358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea48f5-f9a3-4b2a-bdab-89d3eaa8fff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:17.055330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-57ea48f5-f9a3-4b2a-bdab-89d3eaa8fff9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:17.055330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:17.055330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:17.055330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:17.055330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:17.055330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:17.055330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:17.055330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:17.055330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:17.055330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:17.055330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:17.055330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:17.055330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:17.055330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:17.055330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:17.055330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:17.056206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:17.056206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:17.056206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:17.056206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:17.056206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:17.056206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:17.056206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:17.056206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:17.056206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:17.056206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:17.056206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:17.056206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:17.056206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:17.056206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:17.056206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:17.056206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:17.057227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:17.057227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:17.057227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:17.057227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:17.057227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:17.057227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:17.057227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:17.057227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:17.057227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:17.057227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:17.057227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:17.057227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:17.057227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 175/349] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:17.057896 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497e44b-6bb0-4517-8ee9-04fa2c986542 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:17.058564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497e44b-6bb0-4517-8ee9-04fa2c986542 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:17.058901 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497e44b-6bb0-4517-8ee9-04fa2c986542 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:17.063280 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 176/350] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:17.063280 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497e44b-6bb0-4517-8ee9-04fa2c986542 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:17.093249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:17.094070 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:17.108961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c26a6-7847-4bf7-aaf3-4420bccf8442 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:17.149841 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9808133-09ae-4b5e-8699-6fa9fb7294c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:17.150752 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9808133-09ae-4b5e-8699-6fa9fb7294c8 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:17.151032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9808133-09ae-4b5e-8699-6fa9fb7294c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:17.151303 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9808133-09ae-4b5e-8699-6fa9fb7294c8 None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:17.152457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9808133-09ae-4b5e-8699-6fa9fb7294c8 None admin] RBAC: Authorizing `identity:get_project(project_id=a0bc949d68f2445ca2585ec234ea2c73)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:17.153947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9808133-09ae-4b5e-8699-6fa9fb7294c8 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:17.155593 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 175/351] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:16 2022] GET /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:17.156350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9808133-09ae-4b5e-8699-6fa9fb7294c8 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:17.185701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497e44b-6bb0-4517-8ee9-04fa2c986542 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:17.231787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21c2e6-88b3-49f0-a5c0-212227a390c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:17.232422 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21c2e6-88b3-49f0-a5c0-212227a390c1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:17.232891 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21c2e6-88b3-49f0-a5c0-212227a390c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:17.233168 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21c2e6-88b3-49f0-a5c0-212227a390c1 None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:17.234861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21c2e6-88b3-49f0-a5c0-212227a390c1 None admin] RBAC: Authorizing `identity:get_project(project_id=a0bc949d68f2445ca2585ec234ea2c73)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:17.236300 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21c2e6-88b3-49f0-a5c0-212227a390c1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:17.238111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 177/352] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:17 2022] GET /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:17.240598 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5472ca-cf5c-4357-b58e-8d78c54e7040 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:17.240598 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5472ca-cf5c-4357-b58e-8d78c54e7040 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:17.240598 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5472ca-cf5c-4357-b58e-8d78c54e7040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:17.263182 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-6e5472ca-cf5c-4357-b58e-8d78c54e7040 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:17.264370 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6e5472ca-cf5c-4357-b58e-8d78c54e7040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:17.282581 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9808133-09ae-4b5e-8699-6fa9fb7294c8 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:17.323871 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85861b53-2266-47df-b9ec-9b18735e84e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:17.324725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85861b53-2266-47df-b9ec-9b18735e84e9 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:17.325008 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85861b53-2266-47df-b9ec-9b18735e84e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:17.325280 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85861b53-2266-47df-b9ec-9b18735e84e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:17.341140 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85861b53-2266-47df-b9ec-9b18735e84e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:17.348157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-85861b53-2266-47df-b9ec-9b18735e84e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 10:33:17.348157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:17.348157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:17.348157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:17.348157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:17.348157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:17.348157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:17.348157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:17.348157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:17.348157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:17.348157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:17.348157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:17.348157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:17.348157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:17.348157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:17.348157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:17.349091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:17.349091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:17.349091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:17.349091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:17.349091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:17.349091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:17.349091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:17.349091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:17.349091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:17.349091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:17.349091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:17.349091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:17.349091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:17.349091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:17.349091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:17.349091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:17.349902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:17.349902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:17.349902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:17.349902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:17.349902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:17.349902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:17.349902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:17.349902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:17.349902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:17.349902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:17.349902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 10:33:17.349902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:17.349902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 176/353] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:17.350548 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85861b53-2266-47df-b9ec-9b18735e84e9 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:17.355248 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:17.355931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 178/354] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:17.356957 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5472ca-cf5c-4357-b58e-8d78c54e7040 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:17.388079 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:17.476129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85861b53-2266-47df-b9ec-9b18735e84e9 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:17.476571 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5472ca-cf5c-4357-b58e-8d78c54e7040 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:17.515003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bbad7-2c9f-4596-8028-33f524726b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:17.515640 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bbad7-2c9f-4596-8028-33f524726b2b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:17.515919 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bbad7-2c9f-4596-8028-33f524726b2b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:17.516189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bbad7-2c9f-4596-8028-33f524726b2b None admin] PATH_INFO: `/v3/groups/9cd7836e6c494ac89823b82d4d577573` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:17.522320 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bbad7-2c9f-4596-8028-33f524726b2b None admin] RBAC: Authorizing `identity:get_group(group_id=9cd7836e6c494ac89823b82d4d577573)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:17.523785 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bbad7-2c9f-4596-8028-33f524726b2b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:17.524064 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff831b2-f152-4a82-9494-ce9e616496e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:17.524708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff831b2-f152-4a82-9494-ce9e616496e3 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:17.524987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff831b2-f152-4a82-9494-ce9e616496e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:17.525257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff831b2-f152-4a82-9494-ce9e616496e3 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:17.525712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 179/355] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 10:33:17 2022] GET /identity/v3/groups/9cd7836e6c494ac89823b82d4d577573 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:17.525922 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff831b2-f152-4a82-9494-ce9e616496e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:17.526221 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff831b2-f152-4a82-9494-ce9e616496e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:17.526445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bbad7-2c9f-4596-8028-33f524726b2b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:17.529570 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff831b2-f152-4a82-9494-ce9e616496e3 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:17.538821 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 177/356] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:33:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:17.539730 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff831b2-f152-4a82-9494-ce9e616496e3 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:17.619573 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:17.650391 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:17.661918 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff831b2-f152-4a82-9494-ce9e616496e3 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:17.662182 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bbad7-2c9f-4596-8028-33f524726b2b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:17.701220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f53663-312a-497b-b0cd-b3bcb503361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:17.701849 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f53663-312a-497b-b0cd-b3bcb503361e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:17.702173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f53663-312a-497b-b0cd-b3bcb503361e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:17.702393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f53663-312a-497b-b0cd-b3bcb503361e None admin] PATH_INFO: `/v3/groups/9cd7836e6c494ac89823b82d4d577573` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:17.703478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f53663-312a-497b-b0cd-b3bcb503361e None admin] RBAC: Authorizing `identity:get_group(group_id=9cd7836e6c494ac89823b82d4d577573)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:17.703722 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25b682-57cf-43a0-9ab3-9d1c6289e1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:17.704332 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25b682-57cf-43a0-9ab3-9d1c6289e1d3 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:17.704639 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25b682-57cf-43a0-9ab3-9d1c6289e1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:17.704916 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25b682-57cf-43a0-9ab3-9d1c6289e1d3 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:17.705021 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f53663-312a-497b-b0cd-b3bcb503361e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:17.705592 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25b682-57cf-43a0-9ab3-9d1c6289e1d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:17.705898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25b682-57cf-43a0-9ab3-9d1c6289e1d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:17.707367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 180/357] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 10:33:17 2022] GET /identity/v3/groups/9cd7836e6c494ac89823b82d4d577573 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:17.707809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25b682-57cf-43a0-9ab3-9d1c6289e1d3 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:17.708526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cd833-6e68-426b-9eb1-7619006dc83b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:17.708829 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cd833-6e68-426b-9eb1-7619006dc83b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:17.709097 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cd833-6e68-426b-9eb1-7619006dc83b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:17.710514 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 181/358] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:17.711020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409cd833-6e68-426b-9eb1-7619006dc83b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:17.726624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 178/359] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:33:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:17.726624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25b682-57cf-43a0-9ab3-9d1c6289e1d3 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:17.839658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409cd833-6e68-426b-9eb1-7619006dc83b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:17.839849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25b682-57cf-43a0-9ab3-9d1c6289e1d3 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:17.869446 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:17.880470 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9d96f-c678-4989-958e-44f08c3b997e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:17.880868 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e420bb-9cdf-477a-aae8-b71ffe7fcc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:17.881257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9d96f-c678-4989-958e-44f08c3b997e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:17.881962 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e420bb-9cdf-477a-aae8-b71ffe7fcc12 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:17.882068 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9d96f-c678-4989-958e-44f08c3b997e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:17.882139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e420bb-9cdf-477a-aae8-b71ffe7fcc12 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:17.882205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9d96f-c678-4989-958e-44f08c3b997e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:17.882281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e420bb-9cdf-477a-aae8-b71ffe7fcc12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:17.882722 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e420bb-9cdf-477a-aae8-b71ffe7fcc12 None admin] RBAC: Adding query filter params (group.id=9cd7836e6c494ac89823b82d4d577573, role.id=344db47133bb4fb2843696759f71b2c7, scope.project.id=a0bc949d68f2445ca2585ec234ea2c73) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:17.883034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e420bb-9cdf-477a-aae8-b71ffe7fcc12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:17.884456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e420bb-9cdf-477a-aae8-b71ffe7fcc12 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:17.892035 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 182/360] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Sep 11 10:33:17 2022] GET /identity/v3/role_assignments?group.id=9cd7836e6c494ac89823b82d4d577573&scope.project.id=a0bc949d68f2445ca2585ec234ea2c73&role.id=344db47133bb4fb2843696759f71b2c7 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:17.893007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e420bb-9cdf-477a-aae8-b71ffe7fcc12 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:17.932352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:17.979209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9d96f-c678-4989-958e-44f08c3b997e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:17.981011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9d96f-c678-4989-958e-44f08c3b997e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:18.041889 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e420bb-9cdf-477a-aae8-b71ffe7fcc12 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:18.090649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be50eed-532d-4e6a-a720-5927d53897ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:18.091297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be50eed-532d-4e6a-a720-5927d53897ff None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:18.091908 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be50eed-532d-4e6a-a720-5927d53897ff None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:18.092186 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be50eed-532d-4e6a-a720-5927d53897ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:18.106817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be50eed-532d-4e6a-a720-5927d53897ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:18.112403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-8be50eed-532d-4e6a-a720-5927d53897ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:33:18.112403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:18.112403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:18.112403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:18.112403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:18.112403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:18.112403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:18.112403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:18.112403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:18.112403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:18.112403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:18.112403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:18.112403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:18.112403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:18.112403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:18.112403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:18.113574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:18.113574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:18.113574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:18.113574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:18.113574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:18.113574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:18.113574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:18.113574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:18.113574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:18.113574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:18.113574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:18.113574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:18.113574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:18.113574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:18.113574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:18.113574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:18.114949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:18.114949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:18.114949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:18.114949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:18.114949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:18.114949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:18.114949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:18.114949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:18.114949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:18.114949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:18.114949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:33:18.114949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:18.114949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 183/361] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:33:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:18.115611 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be50eed-532d-4e6a-a720-5927d53897ff None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:18.125683 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 179/362] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:18.126493 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc53f1-d13a-496d-92c1-52751907ac8f None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:18.126777 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc53f1-d13a-496d-92c1-52751907ac8f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:18.127048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc53f1-d13a-496d-92c1-52751907ac8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:18.148775 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-8acc53f1-d13a-496d-92c1-52751907ac8f None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:18.149888 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8acc53f1-d13a-496d-92c1-52751907ac8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:18.184783 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:18.223464 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:18.247335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 180/363] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:18.247518 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be50eed-532d-4e6a-a720-5927d53897ff None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:18.248013 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc53f1-d13a-496d-92c1-52751907ac8f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:18.301263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28830b2-92ad-42c7-85f7-2be2b822a4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:18.302243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28830b2-92ad-42c7-85f7-2be2b822a4a4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:18.302711 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28830b2-92ad-42c7-85f7-2be2b822a4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:18.303219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28830b2-92ad-42c7-85f7-2be2b822a4a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:18.304129 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28830b2-92ad-42c7-85f7-2be2b822a4a4 None admin] RBAC: Adding query filter params (group.id=9cd7836e6c494ac89823b82d4d577573, role.id=30f1e6f9ddb649d2804d9128b17348f6, scope.project.id=a0bc949d68f2445ca2585ec234ea2c73) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:18.304723 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28830b2-92ad-42c7-85f7-2be2b822a4a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:18.306341 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28830b2-92ad-42c7-85f7-2be2b822a4a4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:18.313677 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 184/364] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Sep 11 10:33:18 2022] GET /identity/v3/role_assignments?group.id=9cd7836e6c494ac89823b82d4d577573&scope.project.id=a0bc949d68f2445ca2585ec234ea2c73&role.id=30f1e6f9ddb649d2804d9128b17348f6 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:18.315929 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28830b2-92ad-42c7-85f7-2be2b822a4a4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:18.389464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc53f1-d13a-496d-92c1-52751907ac8f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:18.451107 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e7273-c1d8-41d6-986c-987379704401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:18.452116 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e7273-c1d8-41d6-986c-987379704401 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:18.452616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e7273-c1d8-41d6-986c-987379704401 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:18.453142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e7273-c1d8-41d6-986c-987379704401 None admin] PATH_INFO: `/v3/users/2d11ccaf3e4943ed933851b2854bfbae` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:18.457324 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e7273-c1d8-41d6-986c-987379704401 None admin] RBAC: Authorizing `identity:get_user(user_id=2d11ccaf3e4943ed933851b2854bfbae)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:18.459189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e7273-c1d8-41d6-986c-987379704401 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:18.460288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28830b2-92ad-42c7-85f7-2be2b822a4a4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:18.461691 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 181/365] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:33:18 2022] GET /identity/v3/users/2d11ccaf3e4943ed933851b2854bfbae => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:18.462809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e7273-c1d8-41d6-986c-987379704401 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:18.504775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a72464-3a7c-4532-9cbd-34da844a16b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:18.505569 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a72464-3a7c-4532-9cbd-34da844a16b7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:18.505914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a72464-3a7c-4532-9cbd-34da844a16b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:18.506188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a72464-3a7c-4532-9cbd-34da844a16b7 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:18.510456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a72464-3a7c-4532-9cbd-34da844a16b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:18.510456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a72464-3a7c-4532-9cbd-34da844a16b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:18.510456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a72464-3a7c-4532-9cbd-34da844a16b7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:18.517341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:18.519894 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 185/366] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:18.521238 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a72464-3a7c-4532-9cbd-34da844a16b7 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:18.534832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:18.623100 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e7273-c1d8-41d6-986c-987379704401 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:18.643454 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a72464-3a7c-4532-9cbd-34da844a16b7 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:18.666739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527fad0-e907-4e62-9f32-b57b72ad2352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:18.667383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527fad0-e907-4e62-9f32-b57b72ad2352 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:18.667655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527fad0-e907-4e62-9f32-b57b72ad2352 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:18.667927 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527fad0-e907-4e62-9f32-b57b72ad2352 None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:18.669078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527fad0-e907-4e62-9f32-b57b72ad2352 None admin] RBAC: Authorizing `identity:get_project(project_id=0e22a81d096b490087b34c4bcaa8c9fa)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:18.670512 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527fad0-e907-4e62-9f32-b57b72ad2352 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:18.672444 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 182/367] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:18 2022] GET /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:18.673260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527fad0-e907-4e62-9f32-b57b72ad2352 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:18.686016 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cdd96-f4bb-41c0-9d04-ac74ff6b278e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:18.686639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cdd96-f4bb-41c0-9d04-ac74ff6b278e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:18.686920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cdd96-f4bb-41c0-9d04-ac74ff6b278e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:18.687192 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cdd96-f4bb-41c0-9d04-ac74ff6b278e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:18.688383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cdd96-f4bb-41c0-9d04-ac74ff6b278e None admin] RBAC: Adding query filter params (role.id=4b4be11b3bbb487f996ab28b7f1bda4c, user.id=2d11ccaf3e4943ed933851b2854bfbae, scope.system=all) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:18.688729 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cdd96-f4bb-41c0-9d04-ac74ff6b278e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:18.690570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cdd96-f4bb-41c0-9d04-ac74ff6b278e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:18.709251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 186/368] 10.222.0.20 () {56 vars in 1308 bytes} [Sun Sep 11 10:33:18 2022] GET /identity/v3/role_assignments?user.id=2d11ccaf3e4943ed933851b2854bfbae&scope.system=all&role.id=4b4be11b3bbb487f996ab28b7f1bda4c => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:18.710060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cdd96-f4bb-41c0-9d04-ac74ff6b278e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:18.866367 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:18.869624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:18.879261 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527fad0-e907-4e62-9f32-b57b72ad2352 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:18.923361 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1456f-e5ff-4d1d-9b10-f9f12449a78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:18.924258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1456f-e5ff-4d1d-9b10-f9f12449a78a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:18.924561 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1456f-e5ff-4d1d-9b10-f9f12449a78a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:18.924852 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1456f-e5ff-4d1d-9b10-f9f12449a78a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:18.941277 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cdd96-f4bb-41c0-9d04-ac74ff6b278e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:19.013903 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf8c41-b735-43ea-b5ab-15ca07b61de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:19.014463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf8c41-b735-43ea-b5ab-15ca07b61de1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:19.014882 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf8c41-b735-43ea-b5ab-15ca07b61de1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:19.015155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf8c41-b735-43ea-b5ab-15ca07b61de1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:19.026443 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1456f-e5ff-4d1d-9b10-f9f12449a78a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:19.028314 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1456f-e5ff-4d1d-9b10-f9f12449a78a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:19.029852 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf8c41-b735-43ea-b5ab-15ca07b61de1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:19.035258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-fbdf8c41-b735-43ea-b5ab-15ca07b61de1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:33:19.035258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:19.035258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:19.035258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:19.035258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:19.035258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:19.035258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:19.035258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:19.035258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:19.035258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:19.035258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:19.035258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:19.035258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:19.035258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:19.035258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:19.035258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:19.036136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:19.036136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:19.036136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:19.036136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:19.036136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:19.036136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:19.036136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:19.036136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:19.036136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:19.036136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:19.036136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:19.036136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:19.036136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:19.036136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:19.036136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:19.036136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:19.036979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:19.036979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:19.036979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:19.036979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:19.036979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:19.036979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:19.036979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:19.036979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:19.036979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:19.036979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:19.036979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:33:19.036979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:19.036979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 187/369] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:33:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:19.038090 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf8c41-b735-43ea-b5ab-15ca07b61de1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:19.154761 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:19.164649 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 183/370] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:19.165591 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1456f-e5ff-4d1d-9b10-f9f12449a78a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:19.171444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf8c41-b735-43ea-b5ab-15ca07b61de1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:19.206805 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:19.217762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a4361-9231-410d-96f1-56b6e0a3ebd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:19.218962 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a4361-9231-410d-96f1-56b6e0a3ebd6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:19.219242 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a4361-9231-410d-96f1-56b6e0a3ebd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:19.219521 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a4361-9231-410d-96f1-56b6e0a3ebd6 None admin] PATH_INFO: `/v3/groups/9cd7836e6c494ac89823b82d4d577573` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:19.221095 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a4361-9231-410d-96f1-56b6e0a3ebd6 None admin] RBAC: Authorizing `identity:get_group(group_id=9cd7836e6c494ac89823b82d4d577573)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:19.223559 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a4361-9231-410d-96f1-56b6e0a3ebd6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:19.226276 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 188/371] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 10:33:19 2022] GET /identity/v3/groups/9cd7836e6c494ac89823b82d4d577573 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:19.227137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a4361-9231-410d-96f1-56b6e0a3ebd6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:19.300983 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1456f-e5ff-4d1d-9b10-f9f12449a78a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:19.345359 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813eb0a0-3f24-4783-859d-cd556067e581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:19.345978 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813eb0a0-3f24-4783-859d-cd556067e581 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:19.346148 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a4361-9231-410d-96f1-56b6e0a3ebd6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:19.346300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813eb0a0-3f24-4783-859d-cd556067e581 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:19.346523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813eb0a0-3f24-4783-859d-cd556067e581 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:19.347526 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813eb0a0-3f24-4783-859d-cd556067e581 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:19.347834 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813eb0a0-3f24-4783-859d-cd556067e581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:19.350270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813eb0a0-3f24-4783-859d-cd556067e581 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:19.360571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 184/372] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:19.363505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813eb0a0-3f24-4783-859d-cd556067e581 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:19.399849 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd67ce-86db-4edd-aff1-9d83261a5bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:19.400791 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd67ce-86db-4edd-aff1-9d83261a5bd4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:19.401078 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd67ce-86db-4edd-aff1-9d83261a5bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:19.401806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd67ce-86db-4edd-aff1-9d83261a5bd4 None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:19.403256 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd67ce-86db-4edd-aff1-9d83261a5bd4 None admin] RBAC: Authorizing `identity:get_project(project_id=0e22a81d096b490087b34c4bcaa8c9fa)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:19.405457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd67ce-86db-4edd-aff1-9d83261a5bd4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:19.408382 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 189/373] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:19 2022] GET /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:19.409338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd67ce-86db-4edd-aff1-9d83261a5bd4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:19.441245 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:19.497169 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:19.498644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813eb0a0-3f24-4783-859d-cd556067e581 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:19.543076 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5646a-1f65-4ce6-8206-db7fcb2ea1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:19.543955 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5646a-1f65-4ce6-8206-db7fcb2ea1b7 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:19.544239 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5646a-1f65-4ce6-8206-db7fcb2ea1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:19.544518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5646a-1f65-4ce6-8206-db7fcb2ea1b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:19.545287 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5646a-1f65-4ce6-8206-db7fcb2ea1b7 None admin] RBAC: Adding query filter params (group.id=9cd7836e6c494ac89823b82d4d577573, role.id=344db47133bb4fb2843696759f71b2c7, scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:19.545536 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd67ce-86db-4edd-aff1-9d83261a5bd4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:19.545704 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5646a-1f65-4ce6-8206-db7fcb2ea1b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:19.547201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5646a-1f65-4ce6-8206-db7fcb2ea1b7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:19.554618 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 185/374] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Sep 11 10:33:19 2022] GET /identity/v3/role_assignments?group.id=9cd7836e6c494ac89823b82d4d577573&scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa&role.id=344db47133bb4fb2843696759f71b2c7 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:19.555881 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5646a-1f65-4ce6-8206-db7fcb2ea1b7 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:19.587821 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b336d4-d524-40e3-a52f-fe877bf56dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:19.588445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b336d4-d524-40e3-a52f-fe877bf56dc4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:19.588856 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b336d4-d524-40e3-a52f-fe877bf56dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:19.589232 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b336d4-d524-40e3-a52f-fe877bf56dc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:19.670532 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b336d4-d524-40e3-a52f-fe877bf56dc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:19.672260 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b336d4-d524-40e3-a52f-fe877bf56dc4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:19.701192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5646a-1f65-4ce6-8206-db7fcb2ea1b7 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:19.732229 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:19.743045 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:19.765306 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35edc3-b4f4-45e9-81ef-27dba2ffbca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:19.765973 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35edc3-b4f4-45e9-81ef-27dba2ffbca0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:19.766263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35edc3-b4f4-45e9-81ef-27dba2ffbca0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:19.766541 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35edc3-b4f4-45e9-81ef-27dba2ffbca0 None admin] PATH_INFO: `/v3/groups/9cd7836e6c494ac89823b82d4d577573` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:19.767831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35edc3-b4f4-45e9-81ef-27dba2ffbca0 None admin] RBAC: Authorizing `identity:get_group(group_id=9cd7836e6c494ac89823b82d4d577573)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:19.769450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35edc3-b4f4-45e9-81ef-27dba2ffbca0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:19.772167 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 186/375] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 10:33:19 2022] GET /identity/v3/groups/9cd7836e6c494ac89823b82d4d577573 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:19.777056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35edc3-b4f4-45e9-81ef-27dba2ffbca0 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:19.795686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 190/376] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:19.806006 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b336d4-d524-40e3-a52f-fe877bf56dc4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:19.896049 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35edc3-b4f4-45e9-81ef-27dba2ffbca0 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:19.932466 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecfd48-3229-4081-b32c-225ce951727d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:19.933117 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecfd48-3229-4081-b32c-225ce951727d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:19.933401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecfd48-3229-4081-b32c-225ce951727d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:19.933677 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecfd48-3229-4081-b32c-225ce951727d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:19.934409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eecfd48-3229-4081-b32c-225ce951727d None admin] RBAC: Adding query filter params (group.id=9cd7836e6c494ac89823b82d4d577573, role.id=30f1e6f9ddb649d2804d9128b17348f6, scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:19.934720 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eecfd48-3229-4081-b32c-225ce951727d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:19.936150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eecfd48-3229-4081-b32c-225ce951727d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:19.942734 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 187/377] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Sep 11 10:33:19 2022] GET /identity/v3/role_assignments?group.id=9cd7836e6c494ac89823b82d4d577573&scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa&role.id=30f1e6f9ddb649d2804d9128b17348f6 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:19.959790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b336d4-d524-40e3-a52f-fe877bf56dc4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:20.008245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3616cf-710e-4e36-8113-93b7be8bda0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:20.008922 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3616cf-710e-4e36-8113-93b7be8bda0e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:20.009202 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3616cf-710e-4e36-8113-93b7be8bda0e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:20.009474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3616cf-710e-4e36-8113-93b7be8bda0e None admin] PATH_INFO: `/v3/projects/7c1c2ee49dc945b2a0f435c605ac4ed3` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:20.013340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3616cf-710e-4e36-8113-93b7be8bda0e None admin] RBAC: Authorizing `identity:get_project(project_id=7c1c2ee49dc945b2a0f435c605ac4ed3)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:20.014800 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3616cf-710e-4e36-8113-93b7be8bda0e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:20.016954 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 191/378] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:19 2022] GET /identity/v3/projects/7c1c2ee49dc945b2a0f435c605ac4ed3 => generated 344 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:20.023313 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecfd48-3229-4081-b32c-225ce951727d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:20.109441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:20.164811 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecfd48-3229-4081-b32c-225ce951727d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:20.202181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0a346-7dbf-40a9-b119-df4595b5c349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:20.202826 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0a346-7dbf-40a9-b119-df4595b5c349 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:20.203108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0a346-7dbf-40a9-b119-df4595b5c349 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:20.203381 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0a346-7dbf-40a9-b119-df4595b5c349 None admin] PATH_INFO: `/v3/groups/498b31fe507040afabf8c228228ec469` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:20.209861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0a346-7dbf-40a9-b119-df4595b5c349 None admin] RBAC: Authorizing `identity:get_group(group_id=498b31fe507040afabf8c228228ec469)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:20.211320 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0a346-7dbf-40a9-b119-df4595b5c349 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:20.216658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 188/379] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 10:33:20 2022] GET /identity/v3/groups/498b31fe507040afabf8c228228ec469 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:20.219283 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3616cf-710e-4e36-8113-93b7be8bda0e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:20.252025 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:20.331045 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3616cf-710e-4e36-8113-93b7be8bda0e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:20.375803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd5f39-76b5-4681-860d-206aae7b79be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:20.376339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd5f39-76b5-4681-860d-206aae7b79be None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:20.376638 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd5f39-76b5-4681-860d-206aae7b79be None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:20.376908 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd5f39-76b5-4681-860d-206aae7b79be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:20.377645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd5f39-76b5-4681-860d-206aae7b79be None admin] RBAC: Adding query filter params (group.id=498b31fe507040afabf8c228228ec469, role.id=529cb3511f3a498b9b7169ed5b0f6b8e, scope.project.id=7c1c2ee49dc945b2a0f435c605ac4ed3) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:20.377950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd5f39-76b5-4681-860d-206aae7b79be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:20.379431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd5f39-76b5-4681-860d-206aae7b79be None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:20.385892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 192/380] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Sep 11 10:33:20 2022] GET /identity/v3/role_assignments?group.id=498b31fe507040afabf8c228228ec469&scope.project.id=7c1c2ee49dc945b2a0f435c605ac4ed3&role.id=529cb3511f3a498b9b7169ed5b0f6b8e => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:20.861367 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b902140-6186-4f59-b953-2238c1152c60 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:20.861756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b902140-6186-4f59-b953-2238c1152c60 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:20.861930 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b902140-6186-4f59-b953-2238c1152c60 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:20.863337 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 189/381] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:20.869258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73307f36-8fdb-43b3-8191-248b72bcee0b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:20.869545 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73307f36-8fdb-43b3-8191-248b72bcee0b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:20.869822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73307f36-8fdb-43b3-8191-248b72bcee0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:20.897561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-73307f36-8fdb-43b3-8191-248b72bcee0b None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:20.898792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-73307f36-8fdb-43b3-8191-248b72bcee0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:20.973886 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 193/382] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:21.167823 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad23a11-811d-4bd3-931a-d7c01cf649c4 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:21.168734 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad23a11-811d-4bd3-931a-d7c01cf649c4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:21.169164 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad23a11-811d-4bd3-931a-d7c01cf649c4 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:21.171100 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 190/383] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:21.176321 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb42327-6712-4c7c-ab11-e23e31467e18 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:21.176701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb42327-6712-4c7c-ab11-e23e31467e18 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:21.176907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb42327-6712-4c7c-ab11-e23e31467e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:21.201519 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2fb42327-6712-4c7c-ab11-e23e31467e18 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:21.202711 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2fb42327-6712-4c7c-ab11-e23e31467e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:21.228146 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:21.294163 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 194/384] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:21.565074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad23a11-811d-4bd3-931a-d7c01cf649c4 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:21.682310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad23a11-811d-4bd3-931a-d7c01cf649c4 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:21.700448 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:21.720965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573082cd-9f98-4250-ae22-b77c370d4249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:21.721861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573082cd-9f98-4250-ae22-b77c370d4249 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:21.723331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573082cd-9f98-4250-ae22-b77c370d4249 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:21.723331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573082cd-9f98-4250-ae22-b77c370d4249 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:21.735843 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573082cd-9f98-4250-ae22-b77c370d4249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:21.742278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-573082cd-9f98-4250-ae22-b77c370d4249 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:21.742278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:21.742278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:21.742278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:21.742278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:21.742278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:21.742278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:21.742278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:21.742278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:21.742278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:21.742278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:21.742278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:21.742278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:21.742278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:21.742278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:21.742278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:21.743193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:21.743193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:21.743193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:21.743193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:21.743193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:21.743193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:21.743193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:21.743193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:21.743193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:21.743193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:21.743193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:21.743193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:21.743193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:21.743193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:21.743193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:21.743193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:21.744345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:21.744345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:21.744345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:21.744345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:21.744345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:21.744345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:21.744345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:21.744345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:21.744345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:21.744345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:21.744345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:21.744345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:21.744345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 191/385] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:21.749769 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb42327-6712-4c7c-ab11-e23e31467e18 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:21.816384 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573082cd-9f98-4250-ae22-b77c370d4249 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:21.888285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb42327-6712-4c7c-ab11-e23e31467e18 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:21.927029 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf688a0-238a-4ba2-9c66-9ebc39b2c69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:21.927883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf688a0-238a-4ba2-9c66-9ebc39b2c69e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:21.928372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf688a0-238a-4ba2-9c66-9ebc39b2c69e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:21.928958 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf688a0-238a-4ba2-9c66-9ebc39b2c69e None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:21.929779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf688a0-238a-4ba2-9c66-9ebc39b2c69e None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:21.930492 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf688a0-238a-4ba2-9c66-9ebc39b2c69e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:21.931986 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf688a0-238a-4ba2-9c66-9ebc39b2c69e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:21.942287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 195/386] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:33:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:21.953324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf688a0-238a-4ba2-9c66-9ebc39b2c69e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:21.998120 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:22.036293 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573082cd-9f98-4250-ae22-b77c370d4249 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:22.074596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28520a-6331-4015-a534-550d6345b809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:22.075140 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28520a-6331-4015-a534-550d6345b809 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:22.075412 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28520a-6331-4015-a534-550d6345b809 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:22.075679 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28520a-6331-4015-a534-550d6345b809 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:22.101467 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28520a-6331-4015-a534-550d6345b809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:22.106939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-7f28520a-6331-4015-a534-550d6345b809 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:33:22.106939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:22.106939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:22.106939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:22.106939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:22.106939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:22.106939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:22.106939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:22.106939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:22.106939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:22.106939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:22.106939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:22.106939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:22.106939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:22.106939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:22.106939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:22.107924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:22.107924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:22.107924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:22.107924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:22.107924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:22.107924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:22.107924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:22.107924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:22.107924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:22.107924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:22.107924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:22.107924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:22.107924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:22.107924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:22.107924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:22.107924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:22.108898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:22.108898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:22.108898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:22.108898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:22.108898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:22.108898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:22.108898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:22.108898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:22.108898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:22.108898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:22.108898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:33:22.108898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:22.108898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 192/387] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:33:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:33:22.116471 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec3edf-c563-42d0-b3de-055647f6d5f1 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:22.117200 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec3edf-c563-42d0-b3de-055647f6d5f1 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:22.117624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec3edf-c563-42d0-b3de-055647f6d5f1 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:22.119406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 193/388] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:22.120819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec3edf-c563-42d0-b3de-055647f6d5f1 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:22.145487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf688a0-238a-4ba2-9c66-9ebc39b2c69e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:22.185261 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599af8c9-302e-4c42-bc69-faace59e2e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:22.186289 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599af8c9-302e-4c42-bc69-faace59e2e2f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:22.186537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599af8c9-302e-4c42-bc69-faace59e2e2f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:22.186901 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599af8c9-302e-4c42-bc69-faace59e2e2f None admin] PATH_INFO: `/v3/groups/9cd7836e6c494ac89823b82d4d577573` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:22.188199 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599af8c9-302e-4c42-bc69-faace59e2e2f None admin] RBAC: Authorizing `identity:get_group(group_id=9cd7836e6c494ac89823b82d4d577573)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:22.189726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599af8c9-302e-4c42-bc69-faace59e2e2f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:22.192341 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 196/389] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 10:33:21 2022] GET /identity/v3/groups/9cd7836e6c494ac89823b82d4d577573 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:22.193679 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fc4a3-16e1-4c65-88d7-40396b2d11bf None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:22.194117 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fc4a3-16e1-4c65-88d7-40396b2d11bf None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:22.194487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fc4a3-16e1-4c65-88d7-40396b2d11bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:22.194590 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:22.213851 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-391fc4a3-16e1-4c65-88d7-40396b2d11bf None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:22.215271 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-391fc4a3-16e1-4c65-88d7-40396b2d11bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:22.267831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec3edf-c563-42d0-b3de-055647f6d5f1 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:22.300957 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 197/390] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:22.302643 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fc4a3-16e1-4c65-88d7-40396b2d11bf None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:22.317161 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad1e93-d892-461d-82cc-235c7a52df8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:22.318018 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad1e93-d892-461d-82cc-235c7a52df8c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:22.318451 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad1e93-d892-461d-82cc-235c7a52df8c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:22.318873 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad1e93-d892-461d-82cc-235c7a52df8c None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:22.319706 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad1e93-d892-461d-82cc-235c7a52df8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:22.320150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad1e93-d892-461d-82cc-235c7a52df8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:22.324009 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad1e93-d892-461d-82cc-235c7a52df8c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:22.335523 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:22.346411 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 194/391] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:22.352166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad1e93-d892-461d-82cc-235c7a52df8c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:22.471175 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fc4a3-16e1-4c65-88d7-40396b2d11bf None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:22.545883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d178334-ab1b-4eb9-915b-0527009636fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:22.546526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d178334-ab1b-4eb9-915b-0527009636fa None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:22.546803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d178334-ab1b-4eb9-915b-0527009636fa None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:22.547071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d178334-ab1b-4eb9-915b-0527009636fa None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:22.548229 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d178334-ab1b-4eb9-915b-0527009636fa None admin] RBAC: Authorizing `identity:get_project(project_id=a0bc949d68f2445ca2585ec234ea2c73)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:22.549691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d178334-ab1b-4eb9-915b-0527009636fa None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:22.551531 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 198/392] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:22 2022] GET /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:22.561684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d178334-ab1b-4eb9-915b-0527009636fa None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:22.567593 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:22.571726 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad1e93-d892-461d-82cc-235c7a52df8c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:22.614739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7aabb7-bda1-47a3-afe7-32156d9fea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:22.615408 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7aabb7-bda1-47a3-afe7-32156d9fea12 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:22.615829 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7aabb7-bda1-47a3-afe7-32156d9fea12 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:22.616174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7aabb7-bda1-47a3-afe7-32156d9fea12 None admin] PATH_INFO: `/v3/groups/9cd7836e6c494ac89823b82d4d577573` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:22.617540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7aabb7-bda1-47a3-afe7-32156d9fea12 None admin] RBAC: Authorizing `identity:get_group(group_id=9cd7836e6c494ac89823b82d4d577573)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:22.619255 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7aabb7-bda1-47a3-afe7-32156d9fea12 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:22.621406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 195/393] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 10:33:22 2022] GET /identity/v3/groups/9cd7836e6c494ac89823b82d4d577573 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:22.622250 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7aabb7-bda1-47a3-afe7-32156d9fea12 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:22.658567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:22.681175 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d178334-ab1b-4eb9-915b-0527009636fa None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:22.723597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946afc9-fc5d-4b31-9678-c6e5afcb9266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:22.724264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946afc9-fc5d-4b31-9678-c6e5afcb9266 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:22.724556 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946afc9-fc5d-4b31-9678-c6e5afcb9266 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:22.724856 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946afc9-fc5d-4b31-9678-c6e5afcb9266 None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73/groups/9cd7836e6c494ac89823b82d4d577573/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:22.726760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946afc9-fc5d-4b31-9678-c6e5afcb9266 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0bc949d68f2445ca2585ec234ea2c73, group_id=9cd7836e6c494ac89823b82d4d577573, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:22.728185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946afc9-fc5d-4b31-9678-c6e5afcb9266 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:22.744642 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 199/394] 10.222.0.20 () {58 vars in 1442 bytes} [Sun Sep 11 10:33:22 2022] PUT /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73/groups/9cd7836e6c494ac89823b82d4d577573/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:33:22.745931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946afc9-fc5d-4b31-9678-c6e5afcb9266 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:22.760015 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7aabb7-bda1-47a3-afe7-32156d9fea12 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:22.811043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a8fa1-6180-4be1-b77b-53b555da35ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:22.812938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a8fa1-6180-4be1-b77b-53b555da35ac None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:22.813818 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a8fa1-6180-4be1-b77b-53b555da35ac None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:22.814384 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a8fa1-6180-4be1-b77b-53b555da35ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:22.832376 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a8fa1-6180-4be1-b77b-53b555da35ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:22.839650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-cd3a8fa1-6180-4be1-b77b-53b555da35ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:22.839650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:22.839650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:22.839650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:22.839650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:22.839650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:22.839650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:22.839650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:22.839650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:22.839650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:22.839650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:22.839650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:22.839650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:22.839650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:22.839650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:22.839650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:22.840625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:22.840625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:22.840625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:22.840625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:22.840625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:22.840625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:22.840625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:22.840625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:22.840625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:22.840625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:22.840625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:22.840625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:22.840625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:22.840625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:22.840625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:22.840625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:22.841423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:22.841423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:22.841423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:22.841423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:22.841423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:22.841423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:22.841423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:22.841423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:22.841423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:22.841423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:22.841423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:22.841423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:22.848157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 196/395] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:22.848157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42857180-debc-41f0-85c8-2a76b64d47c7 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:22.848157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42857180-debc-41f0-85c8-2a76b64d47c7 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:22.848157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42857180-debc-41f0-85c8-2a76b64d47c7 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:22.848157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 197/396] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:22.851651 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42857180-debc-41f0-85c8-2a76b64d47c7 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:22.879989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946afc9-fc5d-4b31-9678-c6e5afcb9266 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:22.904575 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:22.919977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3477e-8198-4595-a4f0-8e14f10ddbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:22.920645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3477e-8198-4595-a4f0-8e14f10ddbd9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:22.920930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3477e-8198-4595-a4f0-8e14f10ddbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:22.921206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3477e-8198-4595-a4f0-8e14f10ddbd9 None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:22.923289 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3477e-8198-4595-a4f0-8e14f10ddbd9 None admin] RBAC: Authorizing `identity:get_project(project_id=a0bc949d68f2445ca2585ec234ea2c73)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:22.924788 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3477e-8198-4595-a4f0-8e14f10ddbd9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:22.928024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 200/397] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:22 2022] GET /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:22.929380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd038554-e8a8-4d87-a3ab-163ac8ed320d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:22.929662 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd038554-e8a8-4d87-a3ab-163ac8ed320d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:22.929938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd038554-e8a8-4d87-a3ab-163ac8ed320d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:22.948921 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-fd038554-e8a8-4d87-a3ab-163ac8ed320d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:22.950113 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fd038554-e8a8-4d87-a3ab-163ac8ed320d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:22.954689 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:23.002016 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42857180-debc-41f0-85c8-2a76b64d47c7 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:23.040684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 201/398] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:23.042178 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd038554-e8a8-4d87-a3ab-163ac8ed320d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:23.052042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40654cf8-7f63-47a8-8ae7-f92397f8cc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:23.052693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40654cf8-7f63-47a8-8ae7-f92397f8cc42 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:23.052973 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40654cf8-7f63-47a8-8ae7-f92397f8cc42 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:23.053246 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40654cf8-7f63-47a8-8ae7-f92397f8cc42 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:23.053919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40654cf8-7f63-47a8-8ae7-f92397f8cc42 None admin] RBAC: Adding query filter params (name=member) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:23.057537 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40654cf8-7f63-47a8-8ae7-f92397f8cc42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:23.059626 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40654cf8-7f63-47a8-8ae7-f92397f8cc42 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:23.076510 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 198/399] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:33:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:23.086424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40654cf8-7f63-47a8-8ae7-f92397f8cc42 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:23.178349 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd038554-e8a8-4d87-a3ab-163ac8ed320d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:23.186402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:23.200849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40654cf8-7f63-47a8-8ae7-f92397f8cc42 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:23.219758 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3cf63-dd64-4861-8d59-28262010206b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:23.220692 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3cf63-dd64-4861-8d59-28262010206b None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:23.221115 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3cf63-dd64-4861-8d59-28262010206b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:23.222398 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3cf63-dd64-4861-8d59-28262010206b None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73/groups/9cd7836e6c494ac89823b82d4d577573/roles/30f1e6f9ddb649d2804d9128b17348f6` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:23.224756 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3cf63-dd64-4861-8d59-28262010206b None admin] RBAC: Authorizing `identity:create_grant(project_id=a0bc949d68f2445ca2585ec234ea2c73, group_id=9cd7836e6c494ac89823b82d4d577573, role_id=30f1e6f9ddb649d2804d9128b17348f6)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:23.227327 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3cf63-dd64-4861-8d59-28262010206b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:23.239559 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d658b8-b6e5-44c6-8b58-70f80f4770ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:23.240208 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d658b8-b6e5-44c6-8b58-70f80f4770ef None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:23.241233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d658b8-b6e5-44c6-8b58-70f80f4770ef None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:23.241464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d658b8-b6e5-44c6-8b58-70f80f4770ef None admin] PATH_INFO: `/v3/groups/9cd7836e6c494ac89823b82d4d577573` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:23.241881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:23.243612 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d658b8-b6e5-44c6-8b58-70f80f4770ef None admin] RBAC: Authorizing `identity:get_group(group_id=9cd7836e6c494ac89823b82d4d577573)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:23.246027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d658b8-b6e5-44c6-8b58-70f80f4770ef None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:23.247742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 202/400] 10.222.0.20 () {58 vars in 1442 bytes} [Sun Sep 11 10:33:23 2022] PUT /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73/groups/9cd7836e6c494ac89823b82d4d577573/roles/30f1e6f9ddb649d2804d9128b17348f6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:33:23.248342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 199/401] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 10:33:23 2022] GET /identity/v3/groups/9cd7836e6c494ac89823b82d4d577573 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:23.252297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daafb3-7df8-4a9f-b9e9-eef25b619383 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:23.252297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daafb3-7df8-4a9f-b9e9-eef25b619383 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:23.252297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daafb3-7df8-4a9f-b9e9-eef25b619383 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:23.252297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 203/402] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:23.256510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daafb3-7df8-4a9f-b9e9-eef25b619383 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:23.257567 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176308d3-6115-4289-9e18-6718bea9d643 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:23.258007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176308d3-6115-4289-9e18-6718bea9d643 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:23.258454 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176308d3-6115-4289-9e18-6718bea9d643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:23.284007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-176308d3-6115-4289-9e18-6718bea9d643 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:23.286190 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-176308d3-6115-4289-9e18-6718bea9d643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:23.385764 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 200/403] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:23.387044 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176308d3-6115-4289-9e18-6718bea9d643 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:23.388357 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daafb3-7df8-4a9f-b9e9-eef25b619383 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:23.430221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db93a70-1e14-439c-9ce5-dfe96f77762f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:23.431335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db93a70-1e14-439c-9ce5-dfe96f77762f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:23.431975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db93a70-1e14-439c-9ce5-dfe96f77762f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:23.432357 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db93a70-1e14-439c-9ce5-dfe96f77762f None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:23.433729 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db93a70-1e14-439c-9ce5-dfe96f77762f None admin] RBAC: Authorizing `identity:get_project(project_id=0e22a81d096b490087b34c4bcaa8c9fa)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:23.435366 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db93a70-1e14-439c-9ce5-dfe96f77762f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:23.442564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 204/404] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:23 2022] GET /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:23.446339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db93a70-1e14-439c-9ce5-dfe96f77762f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:23.513054 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:23.534152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176308d3-6115-4289-9e18-6718bea9d643 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:23.538130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:23.575913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db93a70-1e14-439c-9ce5-dfe96f77762f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:23.583960 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c602e6-593d-42ed-b62c-1247c0faba09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:23.585281 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c602e6-593d-42ed-b62c-1247c0faba09 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:23.585565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c602e6-593d-42ed-b62c-1247c0faba09 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:23.585843 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c602e6-593d-42ed-b62c-1247c0faba09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:23.600180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c602e6-593d-42ed-b62c-1247c0faba09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:23.607710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-c8c602e6-593d-42ed-b62c-1247c0faba09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:33:23.607710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:23.607710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:23.607710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:23.607710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:23.607710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:23.607710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:23.607710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:23.607710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:23.607710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:23.607710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:23.607710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:23.607710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:23.607710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:23.607710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:23.607710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:23.608655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:23.608655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:23.608655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:23.608655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:23.608655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:23.608655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:23.608655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:23.608655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:23.608655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:23.608655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:23.608655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:23.608655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:23.608655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:23.608655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:23.608655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:23.608655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:23.609431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:23.609431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:23.609431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:23.609431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:23.609431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:23.609431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:23.609431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:23.609431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:23.609431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:23.609431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:23.609431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:33:23.609431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:23.610611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 201/405] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:33:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:23.615793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c602e6-593d-42ed-b62c-1247c0faba09 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:23.618375 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b4cdf-d2f2-416f-9c2a-3ffe86f8c21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:23.619036 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b4cdf-d2f2-416f-9c2a-3ffe86f8c21b None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:23.619315 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b4cdf-d2f2-416f-9c2a-3ffe86f8c21b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:23.619589 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b4cdf-d2f2-416f-9c2a-3ffe86f8c21b None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa/groups/9cd7836e6c494ac89823b82d4d577573/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:23.622245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b4cdf-d2f2-416f-9c2a-3ffe86f8c21b None admin] RBAC: Authorizing `identity:create_grant(project_id=0e22a81d096b490087b34c4bcaa8c9fa, group_id=9cd7836e6c494ac89823b82d4d577573, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:23.623084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b4cdf-d2f2-416f-9c2a-3ffe86f8c21b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:23.647671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 205/406] 10.222.0.20 () {58 vars in 1442 bytes} [Sun Sep 11 10:33:23 2022] PUT /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa/groups/9cd7836e6c494ac89823b82d4d577573/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:33:23.701703 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b4cdf-d2f2-416f-9c2a-3ffe86f8c21b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:23.820516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c602e6-593d-42ed-b62c-1247c0faba09 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:23.886505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee678242-483e-4e01-bf66-3b6b1aabe229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:23.887130 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee678242-483e-4e01-bf66-3b6b1aabe229 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:23.887453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee678242-483e-4e01-bf66-3b6b1aabe229 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:23.887725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee678242-483e-4e01-bf66-3b6b1aabe229 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:23.888697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee678242-483e-4e01-bf66-3b6b1aabe229 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:23.889001 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee678242-483e-4e01-bf66-3b6b1aabe229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:23.890975 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee678242-483e-4e01-bf66-3b6b1aabe229 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:23.901462 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 202/407] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:23.906997 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee678242-483e-4e01-bf66-3b6b1aabe229 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:23.920809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:23.930381 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b4cdf-d2f2-416f-9c2a-3ffe86f8c21b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:23.977344 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:23.994510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3a351-ed44-4801-91df-fe8a975987cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:23.995422 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3a351-ed44-4801-91df-fe8a975987cb None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:23.995705 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3a351-ed44-4801-91df-fe8a975987cb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:23.995977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3a351-ed44-4801-91df-fe8a975987cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:24.021882 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3a351-ed44-4801-91df-fe8a975987cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:24.027566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-9da3a351-ed44-4801-91df-fe8a975987cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:33:24.027566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:24.027566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:24.027566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:24.027566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:24.027566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:24.027566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:24.027566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:24.027566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:24.027566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:24.027566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:24.027566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:24.027566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:24.027566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:24.027566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:24.027566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:24.028433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:24.028433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:24.028433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:24.028433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:24.028433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:24.028433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:24.028433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:24.028433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:24.028433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:24.028433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:24.028433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:24.028433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:24.028433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:24.028433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:24.028433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:24.028433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:24.029265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:24.029265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:24.029265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:24.029265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:24.029265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:24.029265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:24.029265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:24.029265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:24.029265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:24.029265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:24.029265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:33:24.029265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:24.029860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee678242-483e-4e01-bf66-3b6b1aabe229 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:24.037093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 206/408] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:33:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:33:24.049209 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3a351-ed44-4801-91df-fe8a975987cb None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:24.089224 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be13ce-b539-4046-b0f5-b18cf2ebc4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:24.089861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be13ce-b539-4046-b0f5-b18cf2ebc4e9 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:24.090143 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be13ce-b539-4046-b0f5-b18cf2ebc4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:24.090418 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be13ce-b539-4046-b0f5-b18cf2ebc4e9 None admin] PATH_INFO: `/v3/groups/9cd7836e6c494ac89823b82d4d577573` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:24.092474 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be13ce-b539-4046-b0f5-b18cf2ebc4e9 None admin] RBAC: Authorizing `identity:get_group(group_id=9cd7836e6c494ac89823b82d4d577573)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:24.093945 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be13ce-b539-4046-b0f5-b18cf2ebc4e9 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:24.098068 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 203/409] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 10:33:23 2022] GET /identity/v3/groups/9cd7836e6c494ac89823b82d4d577573 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:24.102893 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be13ce-b539-4046-b0f5-b18cf2ebc4e9 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:24.210830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:24.248279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be13ce-b539-4046-b0f5-b18cf2ebc4e9 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:24.291512 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3588e-f224-4784-ad41-cb15baa7d00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:24.293256 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3588e-f224-4784-ad41-cb15baa7d00e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:24.294319 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3588e-f224-4784-ad41-cb15baa7d00e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:24.294964 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3588e-f224-4784-ad41-cb15baa7d00e None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:24.296967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3a351-ed44-4801-91df-fe8a975987cb None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:24.299612 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3588e-f224-4784-ad41-cb15baa7d00e None admin] RBAC: Authorizing `identity:get_project(project_id=0e22a81d096b490087b34c4bcaa8c9fa)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:24.301817 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3588e-f224-4784-ad41-cb15baa7d00e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:24.313345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 204/410] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:24 2022] GET /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:24.314558 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3588e-f224-4784-ad41-cb15baa7d00e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:24.380921 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc7b3f-81f9-43e2-a8ad-940ea83ddbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:24.381907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc7b3f-81f9-43e2-a8ad-940ea83ddbad None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:24.382377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc7b3f-81f9-43e2-a8ad-940ea83ddbad None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:24.382870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc7b3f-81f9-43e2-a8ad-940ea83ddbad None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:24.383737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc7b3f-81f9-43e2-a8ad-940ea83ddbad None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:24.384223 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc7b3f-81f9-43e2-a8ad-940ea83ddbad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:24.385949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc7b3f-81f9-43e2-a8ad-940ea83ddbad None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:24.395985 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 207/411] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:24.402116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc7b3f-81f9-43e2-a8ad-940ea83ddbad None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:24.454785 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:24.513277 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc7b3f-81f9-43e2-a8ad-940ea83ddbad None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:24.550695 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a2e6c-61f7-46cd-b5e8-666b4c67f311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:24.551751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a2e6c-61f7-46cd-b5e8-666b4c67f311 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:24.552269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a2e6c-61f7-46cd-b5e8-666b4c67f311 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:24.552757 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a2e6c-61f7-46cd-b5e8-666b4c67f311 None admin] PATH_INFO: `/v3/groups/498b31fe507040afabf8c228228ec469` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:24.554366 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a2e6c-61f7-46cd-b5e8-666b4c67f311 None admin] RBAC: Authorizing `identity:get_group(group_id=498b31fe507040afabf8c228228ec469)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:24.555999 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a2e6c-61f7-46cd-b5e8-666b4c67f311 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:24.558550 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 208/412] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 10:33:24 2022] GET /identity/v3/groups/498b31fe507040afabf8c228228ec469 => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:24.564580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a2e6c-61f7-46cd-b5e8-666b4c67f311 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:24.614784 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3588e-f224-4784-ad41-cb15baa7d00e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:24.680649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a2e6c-61f7-46cd-b5e8-666b4c67f311 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:24.698196 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cc468-2c31-4922-934f-e56d4cced1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:24.699237 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cc468-2c31-4922-934f-e56d4cced1a5 None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:24.699708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cc468-2c31-4922-934f-e56d4cced1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:24.700234 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cc468-2c31-4922-934f-e56d4cced1a5 None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa/groups/9cd7836e6c494ac89823b82d4d577573/roles/30f1e6f9ddb649d2804d9128b17348f6` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:24.704074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cc468-2c31-4922-934f-e56d4cced1a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e22a81d096b490087b34c4bcaa8c9fa, group_id=9cd7836e6c494ac89823b82d4d577573, role_id=30f1e6f9ddb649d2804d9128b17348f6)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:24.719509 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cc468-2c31-4922-934f-e56d4cced1a5 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:24.722699 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:24.739382 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 205/413] 10.222.0.20 () {58 vars in 1442 bytes} [Sun Sep 11 10:33:24 2022] PUT /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa/groups/9cd7836e6c494ac89823b82d4d577573/roles/30f1e6f9ddb649d2804d9128b17348f6 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:33:24.772320 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31ac23-2e23-4b79-b549-b0516e162bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:24.772937 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31ac23-2e23-4b79-b549-b0516e162bec None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:24.773220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31ac23-2e23-4b79-b549-b0516e162bec None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:24.773495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31ac23-2e23-4b79-b549-b0516e162bec None admin] PATH_INFO: `/v3/projects/7c1c2ee49dc945b2a0f435c605ac4ed3` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:24.777619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31ac23-2e23-4b79-b549-b0516e162bec None admin] RBAC: Authorizing `identity:get_project(project_id=7c1c2ee49dc945b2a0f435c605ac4ed3)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:24.779201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31ac23-2e23-4b79-b549-b0516e162bec None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:24.782104 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 209/414] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:24 2022] GET /identity/v3/projects/7c1c2ee49dc945b2a0f435c605ac4ed3 => generated 344 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:24.787812 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cc468-2c31-4922-934f-e56d4cced1a5 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:24.792095 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:24.924041 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cc468-2c31-4922-934f-e56d4cced1a5 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:24.970086 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a52732-9d54-4a6a-98cf-cdd7c9f9f883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:24.971125 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a52732-9d54-4a6a-98cf-cdd7c9f9f883 None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:24.972372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a52732-9d54-4a6a-98cf-cdd7c9f9f883 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:24.972889 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a52732-9d54-4a6a-98cf-cdd7c9f9f883 None admin] PATH_INFO: `/v3/projects/7c1c2ee49dc945b2a0f435c605ac4ed3/groups/498b31fe507040afabf8c228228ec469/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:24.975215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a52732-9d54-4a6a-98cf-cdd7c9f9f883 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c1c2ee49dc945b2a0f435c605ac4ed3, group_id=498b31fe507040afabf8c228228ec469, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:24.977031 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a52732-9d54-4a6a-98cf-cdd7c9f9f883 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:24.994564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 206/415] 10.222.0.20 () {58 vars in 1442 bytes} [Sun Sep 11 10:33:24 2022] PUT /identity/v3/projects/7c1c2ee49dc945b2a0f435c605ac4ed3/groups/498b31fe507040afabf8c228228ec469/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:33:25.286196 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046c558-00f5-4316-847c-5268427ca911 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:25.286570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046c558-00f5-4316-847c-5268427ca911 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:25.286746 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046c558-00f5-4316-847c-5268427ca911 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:25.288096 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 210/416] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:25.293613 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c07db-4dde-4095-a27c-84b4d8bfb43c None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:25.294489 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c07db-4dde-4095-a27c-84b4d8bfb43c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:25.294988 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c07db-4dde-4095-a27c-84b4d8bfb43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:25.317305 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-189c07db-4dde-4095-a27c-84b4d8bfb43c None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:25.318902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-189c07db-4dde-4095-a27c-84b4d8bfb43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:25.400894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:25.418140 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 207/417] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:25.788979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046c558-00f5-4316-847c-5268427ca911 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:25.920319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046c558-00f5-4316-847c-5268427ca911 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:25.950790 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d71eb-8d1f-4371-9403-39fe89c95ea8 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:25.951397 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d71eb-8d1f-4371-9403-39fe89c95ea8 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:25.951864 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d71eb-8d1f-4371-9403-39fe89c95ea8 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:25.953946 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 208/418] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:25.960754 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b949583-efbf-4a3c-be5d-efb14689ad1b None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:25.961646 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b949583-efbf-4a3c-be5d-efb14689ad1b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:25.962123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b949583-efbf-4a3c-be5d-efb14689ad1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:25.974694 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4c9a3-c452-40f8-a95f-4ecc5e5c7f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:25.975264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4c9a3-c452-40f8-a95f-4ecc5e5c7f07 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:25.975547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4c9a3-c452-40f8-a95f-4ecc5e5c7f07 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:25.975826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4c9a3-c452-40f8-a95f-4ecc5e5c7f07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:25.984391 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-3b949583-efbf-4a3c-be5d-efb14689ad1b None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:25.985989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3b949583-efbf-4a3c-be5d-efb14689ad1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:26.001120 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4c9a3-c452-40f8-a95f-4ecc5e5c7f07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:26.006634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-e7f4c9a3-c452-40f8-a95f-4ecc5e5c7f07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:26.006634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:26.006634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:26.006634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:26.006634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:26.006634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:26.006634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:26.006634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:26.006634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:26.006634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:26.006634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:26.006634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:26.006634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:26.006634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:26.006634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:26.006634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:26.007526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:26.007526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:26.007526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:26.007526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:26.007526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:26.007526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:26.007526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:26.007526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:26.007526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:26.007526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:26.007526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:26.007526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:26.007526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:26.007526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:26.007526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:26.007526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:26.008313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:26.008313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:26.008313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:26.008313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:26.008313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:26.008313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:26.008313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:26.008313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:26.008313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:26.008313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:26.008313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:26.008313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:26.011049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 211/419] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:26.013351 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4c9a3-c452-40f8-a95f-4ecc5e5c7f07 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:26.102128 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 209/420] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:33:26.108019 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:26.172395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4c9a3-c452-40f8-a95f-4ecc5e5c7f07 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:26.215181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3440a-6ad8-4164-9570-9e8876381a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:26.215828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3440a-6ad8-4164-9570-9e8876381a17 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:26.216114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3440a-6ad8-4164-9570-9e8876381a17 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:26.216390 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3440a-6ad8-4164-9570-9e8876381a17 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:26.217117 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3440a-6ad8-4164-9570-9e8876381a17 None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:26.217421 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3440a-6ad8-4164-9570-9e8876381a17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:26.218929 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3440a-6ad8-4164-9570-9e8876381a17 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:26.234791 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 212/421] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:33:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:26.241356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b949583-efbf-4a3c-be5d-efb14689ad1b None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:26.333652 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b530c4-8fe8-48d0-b6cd-eb8fb28a3ecd None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:26.333997 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b530c4-8fe8-48d0-b6cd-eb8fb28a3ecd None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:26.334208 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b530c4-8fe8-48d0-b6cd-eb8fb28a3ecd None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:26.335543 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 213/422] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:33:26.340709 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4503ab-bf91-4e0d-844c-62cfe0197394 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:26.340997 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4503ab-bf91-4e0d-844c-62cfe0197394 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:26.341272 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4503ab-bf91-4e0d-844c-62cfe0197394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:26.356302 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b949583-efbf-4a3c-be5d-efb14689ad1b None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:26.381606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-cc4503ab-bf91-4e0d-844c-62cfe0197394 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:26.382795 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cc4503ab-bf91-4e0d-844c-62cfe0197394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:26.391641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d816c-8623-45c7-aea7-5a83a12001aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:26.392525 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d816c-8623-45c7-aea7-5a83a12001aa None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:26.393122 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d816c-8623-45c7-aea7-5a83a12001aa None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:26.393625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d816c-8623-45c7-aea7-5a83a12001aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:26.410783 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:26.462641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d816c-8623-45c7-aea7-5a83a12001aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:26.464439 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d816c-8623-45c7-aea7-5a83a12001aa None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:26.532865 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 214/423] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:26.533665 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4503ab-bf91-4e0d-844c-62cfe0197394 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:26.594342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 210/424] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:26.600511 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d816c-8623-45c7-aea7-5a83a12001aa None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:26.609518 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:26.646722 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:26.732456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4503ab-bf91-4e0d-844c-62cfe0197394 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:26.805182 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d816c-8623-45c7-aea7-5a83a12001aa None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:26.811068 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0972f-3adb-4135-be20-23cd5af98fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:26.813597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0972f-3adb-4135-be20-23cd5af98fd6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:26.813887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0972f-3adb-4135-be20-23cd5af98fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:26.814163 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0972f-3adb-4135-be20-23cd5af98fd6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:26.846335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0972f-3adb-4135-be20-23cd5af98fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:26.854490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-69f0972f-3adb-4135-be20-23cd5af98fd6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:33:26.854490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:26.854490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:26.854490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:26.854490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:26.854490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:26.854490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:26.854490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:26.854490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:26.854490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:26.854490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:26.854490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:26.854490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:26.854490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:26.854490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:26.854490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:26.855386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:26.855386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:26.855386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:26.855386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:26.855386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:26.855386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:26.855386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:26.855386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:26.855386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:26.855386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:26.855386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:26.855386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:26.855386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:26.855386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:26.855386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:26.855386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:26.856181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:26.856181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:26.856181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:26.856181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:26.856181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:26.856181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:26.856181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:26.856181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:26.856181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:26.856181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:26.856181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:33:26.856181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:26.856181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 215/425] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:33:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:26.861992 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0972f-3adb-4135-be20-23cd5af98fd6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:26.885109 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed940a1d-a2b7-4d7c-a457-a7674f5a8ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:26.885741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed940a1d-a2b7-4d7c-a457-a7674f5a8ad0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:26.886013 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed940a1d-a2b7-4d7c-a457-a7674f5a8ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:26.886280 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed940a1d-a2b7-4d7c-a457-a7674f5a8ad0 None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:26.887524 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed940a1d-a2b7-4d7c-a457-a7674f5a8ad0 None admin] RBAC: Authorizing `identity:get_project(project_id=a0bc949d68f2445ca2585ec234ea2c73)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:26.889019 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed940a1d-a2b7-4d7c-a457-a7674f5a8ad0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:26.891175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 211/426] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:26 2022] GET /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:26.891950 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed940a1d-a2b7-4d7c-a457-a7674f5a8ad0 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:26.992918 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:26.997469 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:26.998434 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0972f-3adb-4135-be20-23cd5af98fd6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:27.008822 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed940a1d-a2b7-4d7c-a457-a7674f5a8ad0 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:27.041443 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560e040-8798-401e-b9ff-7548dc6715f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:27.042133 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560e040-8798-401e-b9ff-7548dc6715f4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:27.042656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560e040-8798-401e-b9ff-7548dc6715f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:27.042930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560e040-8798-401e-b9ff-7548dc6715f4 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:27.043691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560e040-8798-401e-b9ff-7548dc6715f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:27.043989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560e040-8798-401e-b9ff-7548dc6715f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:27.045376 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560e040-8798-401e-b9ff-7548dc6715f4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:27.047615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4c922-5dda-4155-ba3f-0eb7412ef0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:27.048464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4c922-5dda-4155-ba3f-0eb7412ef0f9 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:27.048986 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4c922-5dda-4155-ba3f-0eb7412ef0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:27.049462 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4c922-5dda-4155-ba3f-0eb7412ef0f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:27.058902 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 216/427] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:27.059708 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560e040-8798-401e-b9ff-7548dc6715f4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:27.063297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4c922-5dda-4155-ba3f-0eb7412ef0f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:27.069310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-55b4c922-5dda-4155-ba3f-0eb7412ef0f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:27.069310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:27.069310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:27.069310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:27.069310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:27.069310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:27.069310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:27.069310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:27.069310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:27.069310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:27.069310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:27.069310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:27.069310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:27.069310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:27.069310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:27.069310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:27.070210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:27.070210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:27.070210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:27.070210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:27.070210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:27.070210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:27.070210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:27.070210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:27.070210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:27.070210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:27.070210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:27.070210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:27.070210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:27.070210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:27.070210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:27.070210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:27.070987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:27.070987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:27.070987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:27.070987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:27.070987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:27.070987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:27.070987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:27.070987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:27.070987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:27.070987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:27.070987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 10:33:27.070987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:27.078379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 212/428] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:27.079546 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4c922-5dda-4155-ba3f-0eb7412ef0f9 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:27.173469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560e040-8798-401e-b9ff-7548dc6715f4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:27.192611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4c922-5dda-4155-ba3f-0eb7412ef0f9 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:27.215485 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0e598-b133-4136-b1fe-dce664195ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:27.216735 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0e598-b133-4136-b1fe-dce664195ad7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:27.217019 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0e598-b133-4136-b1fe-dce664195ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:27.217292 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0e598-b133-4136-b1fe-dce664195ad7 None admin] PATH_INFO: `/v3/groups/9cd7836e6c494ac89823b82d4d577573` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:27.218963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0e598-b133-4136-b1fe-dce664195ad7 None admin] RBAC: Authorizing `identity:get_group(group_id=9cd7836e6c494ac89823b82d4d577573)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:27.220590 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0e598-b133-4136-b1fe-dce664195ad7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:27.224704 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 217/429] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 10:33:27 2022] GET /identity/v3/groups/9cd7836e6c494ac89823b82d4d577573 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:27.226043 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0e598-b133-4136-b1fe-dce664195ad7 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:27.238787 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cc9d7-81b8-425e-ad0f-4e03efc6af13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:27.239971 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cc9d7-81b8-425e-ad0f-4e03efc6af13 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:27.240493 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cc9d7-81b8-425e-ad0f-4e03efc6af13 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:27.241041 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cc9d7-81b8-425e-ad0f-4e03efc6af13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:27.265207 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:27.270525 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:27.322829 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cc9d7-81b8-425e-ad0f-4e03efc6af13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:27.324809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cc9d7-81b8-425e-ad0f-4e03efc6af13 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:27.349451 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0e598-b133-4136-b1fe-dce664195ad7 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:27.384821 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753486c5-b903-4577-9377-053f1a138454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:27.385657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753486c5-b903-4577-9377-053f1a138454 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:27.385793 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753486c5-b903-4577-9377-053f1a138454 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:27.385972 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753486c5-b903-4577-9377-053f1a138454 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:27.386605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753486c5-b903-4577-9377-053f1a138454 None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:27.386908 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753486c5-b903-4577-9377-053f1a138454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:27.388264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753486c5-b903-4577-9377-053f1a138454 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:27.401880 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 218/430] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:33:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:27.401880 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753486c5-b903-4577-9377-053f1a138454 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:27.442355 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 213/431] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:27.444467 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14df45-1a33-49d7-a400-f89b2b21a69d None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:27.444847 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14df45-1a33-49d7-a400-f89b2b21a69d None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:27.445191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14df45-1a33-49d7-a400-f89b2b21a69d None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:27.446720 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 214/432] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:27.447333 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14df45-1a33-49d7-a400-f89b2b21a69d None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:27.502629 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:27.508239 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:27.520733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753486c5-b903-4577-9377-053f1a138454 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:27.559693 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd65fb-be17-46fe-b285-998a3fc50fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:27.560415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd65fb-be17-46fe-b285-998a3fc50fc9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:27.560834 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd65fb-be17-46fe-b285-998a3fc50fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:27.561118 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd65fb-be17-46fe-b285-998a3fc50fc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:27.561905 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd65fb-be17-46fe-b285-998a3fc50fc9 None admin] RBAC: Adding query filter params (group.id=9cd7836e6c494ac89823b82d4d577573, role.id=344db47133bb4fb2843696759f71b2c7, scope.project.id=a0bc949d68f2445ca2585ec234ea2c73) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:27.562217 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd65fb-be17-46fe-b285-998a3fc50fc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:27.563655 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd65fb-be17-46fe-b285-998a3fc50fc9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:27.565042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14df45-1a33-49d7-a400-f89b2b21a69d None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:27.580659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 219/433] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Sep 11 10:33:27 2022] GET /identity/v3/role_assignments?group.id=9cd7836e6c494ac89823b82d4d577573&scope.project.id=a0bc949d68f2445ca2585ec234ea2c73&role.id=344db47133bb4fb2843696759f71b2c7 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:27.580659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16633-1dcf-46f9-996c-bfbcbe76276f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:27.580659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16633-1dcf-46f9-996c-bfbcbe76276f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:27.580659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16633-1dcf-46f9-996c-bfbcbe76276f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:27.592909 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-6db16633-1dcf-46f9-996c-bfbcbe76276f None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:27.594266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6db16633-1dcf-46f9-996c-bfbcbe76276f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:27.622544 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590db094-3d92-4c71-aca5-c2a076764222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:27.623798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590db094-3d92-4c71-aca5-c2a076764222 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:27.624135 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590db094-3d92-4c71-aca5-c2a076764222 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:27.624747 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590db094-3d92-4c71-aca5-c2a076764222 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:27.676250 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 220/434] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:27.685729 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db16633-1dcf-46f9-996c-bfbcbe76276f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:27.703813 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590db094-3d92-4c71-aca5-c2a076764222 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:27.716472 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590db094-3d92-4c71-aca5-c2a076764222 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:27.783935 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:27.805640 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:27.832201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db16633-1dcf-46f9-996c-bfbcbe76276f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:27.856630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 215/435] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:27.858476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319d890-dd42-4a02-abcd-dc286286bbd4 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:27.858476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319d890-dd42-4a02-abcd-dc286286bbd4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:27.859080 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319d890-dd42-4a02-abcd-dc286286bbd4 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:27.860093 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 216/436] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:27.860972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319d890-dd42-4a02-abcd-dc286286bbd4 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:27.878571 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07c858-27d0-4a36-9401-9840e126c1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:27.879322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07c858-27d0-4a36-9401-9840e126c1ff None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:27.879670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07c858-27d0-4a36-9401-9840e126c1ff None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:27.880010 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07c858-27d0-4a36-9401-9840e126c1ff None admin] PATH_INFO: `/v3/projects/a0bc949d68f2445ca2585ec234ea2c73` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:27.881267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07c858-27d0-4a36-9401-9840e126c1ff None admin] RBAC: Authorizing `identity:get_project(project_id=a0bc949d68f2445ca2585ec234ea2c73)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:27.882770 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07c858-27d0-4a36-9401-9840e126c1ff None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:27.884643 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 221/437] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:27 2022] GET /identity/v3/projects/a0bc949d68f2445ca2585ec234ea2c73 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:27.885595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01976b-1afe-4aed-9568-c3206f739d32 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:27.885873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01976b-1afe-4aed-9568-c3206f739d32 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:27.886144 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01976b-1afe-4aed-9568-c3206f739d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:27.905905 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7a01976b-1afe-4aed-9568-c3206f739d32 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:27.907097 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7a01976b-1afe-4aed-9568-c3206f739d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:27.980032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319d890-dd42-4a02-abcd-dc286286bbd4 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:27.985773 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 222/438] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:27.986673 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01976b-1afe-4aed-9568-c3206f739d32 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:28.020129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1e9cf-9e07-4a2d-ac3e-cc2f5c525616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:28.020795 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1e9cf-9e07-4a2d-ac3e-cc2f5c525616 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:28.021070 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1e9cf-9e07-4a2d-ac3e-cc2f5c525616 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:28.021341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1e9cf-9e07-4a2d-ac3e-cc2f5c525616 None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:28.023082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1e9cf-9e07-4a2d-ac3e-cc2f5c525616 None admin] RBAC: Authorizing `identity:get_project(project_id=0e22a81d096b490087b34c4bcaa8c9fa)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:28.024609 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1e9cf-9e07-4a2d-ac3e-cc2f5c525616 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:28.026557 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 217/439] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:27 2022] GET /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:28.026896 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1e9cf-9e07-4a2d-ac3e-cc2f5c525616 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:28.053016 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:28.099744 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:28.122302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01976b-1afe-4aed-9568-c3206f739d32 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:28.156489 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1e9cf-9e07-4a2d-ac3e-cc2f5c525616 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:28.158915 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b01950-8a75-4517-8619-346615280314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:28.160343 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b01950-8a75-4517-8619-346615280314 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:28.160610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b01950-8a75-4517-8619-346615280314 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:28.161113 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b01950-8a75-4517-8619-346615280314 None admin] PATH_INFO: `/v3/groups/9cd7836e6c494ac89823b82d4d577573` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:28.162805 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b01950-8a75-4517-8619-346615280314 None admin] RBAC: Authorizing `identity:get_group(group_id=9cd7836e6c494ac89823b82d4d577573)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:28.164424 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b01950-8a75-4517-8619-346615280314 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:28.172262 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 223/440] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 10:33:27 2022] GET /identity/v3/groups/9cd7836e6c494ac89823b82d4d577573 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:28.172262 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b01950-8a75-4517-8619-346615280314 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:28.196675 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc58c2-8102-45c5-9124-716f1687fdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:28.197417 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc58c2-8102-45c5-9124-716f1687fdd3 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:28.197687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc58c2-8102-45c5-9124-716f1687fdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:28.197960 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc58c2-8102-45c5-9124-716f1687fdd3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:28.209412 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc58c2-8102-45c5-9124-716f1687fdd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:28.214628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-c7cc58c2-8102-45c5-9124-716f1687fdd3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:33:28.214628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:28.214628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:28.214628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:28.214628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:28.214628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:28.214628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:28.214628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:28.214628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:28.214628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:28.214628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:28.214628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:28.214628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:28.214628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:28.214628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:28.214628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:28.215484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:28.215484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:28.215484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:28.215484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:28.215484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:28.215484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:28.215484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:28.215484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:28.215484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:28.215484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:28.215484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:28.215484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:28.215484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:28.215484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:28.215484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:28.215484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:28.216299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:28.216299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:28.216299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:28.216299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:28.216299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:28.216299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:28.216299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:28.216299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:28.216299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:28.216299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:28.216299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:33:28.216299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:28.216299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 218/441] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:33:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:28.216997 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc58c2-8102-45c5-9124-716f1687fdd3 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:28.276132 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b01950-8a75-4517-8619-346615280314 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:28.299498 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:28.309628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809a558-d22a-4cde-a80d-4ae1e9b63ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:28.310309 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809a558-d22a-4cde-a80d-4ae1e9b63ffe None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:28.310590 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809a558-d22a-4cde-a80d-4ae1e9b63ffe None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:28.310869 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809a558-d22a-4cde-a80d-4ae1e9b63ffe None admin] PATH_INFO: `/v3/groups/9cd7836e6c494ac89823b82d4d577573` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:28.311974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809a558-d22a-4cde-a80d-4ae1e9b63ffe None admin] RBAC: Authorizing `identity:get_group(group_id=9cd7836e6c494ac89823b82d4d577573)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:28.313423 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809a558-d22a-4cde-a80d-4ae1e9b63ffe None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:28.314993 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 224/442] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 10:33:28 2022] GET /identity/v3/groups/9cd7836e6c494ac89823b82d4d577573 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:28.316323 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809a558-d22a-4cde-a80d-4ae1e9b63ffe None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:28.324058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc58c2-8102-45c5-9124-716f1687fdd3 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:28.334066 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:28.358233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6af53-0c63-4c5d-80d7-2168783cecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:28.358775 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6af53-0c63-4c5d-80d7-2168783cecf9 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:28.359048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6af53-0c63-4c5d-80d7-2168783cecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:28.359318 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6af53-0c63-4c5d-80d7-2168783cecf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:28.360044 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6af53-0c63-4c5d-80d7-2168783cecf9 None admin] RBAC: Adding query filter params (group.id=9cd7836e6c494ac89823b82d4d577573, role.id=30f1e6f9ddb649d2804d9128b17348f6, scope.project.id=a0bc949d68f2445ca2585ec234ea2c73) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:28.360353 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6af53-0c63-4c5d-80d7-2168783cecf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:28.361807 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6af53-0c63-4c5d-80d7-2168783cecf9 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:28.368001 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 219/443] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Sep 11 10:33:28 2022] GET /identity/v3/role_assignments?group.id=9cd7836e6c494ac89823b82d4d577573&scope.project.id=a0bc949d68f2445ca2585ec234ea2c73&role.id=30f1e6f9ddb649d2804d9128b17348f6 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:28.368799 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6af53-0c63-4c5d-80d7-2168783cecf9 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:28.418346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809a558-d22a-4cde-a80d-4ae1e9b63ffe None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:28.454871 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cc3d8-819b-4c49-97b2-6f69e480803c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:28.455489 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cc3d8-819b-4c49-97b2-6f69e480803c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:28.455768 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cc3d8-819b-4c49-97b2-6f69e480803c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:28.456153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cc3d8-819b-4c49-97b2-6f69e480803c None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:28.457203 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59cc3d8-819b-4c49-97b2-6f69e480803c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:28.457530 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59cc3d8-819b-4c49-97b2-6f69e480803c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:28.458971 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59cc3d8-819b-4c49-97b2-6f69e480803c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:28.476214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 225/444] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:28.477166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cc3d8-819b-4c49-97b2-6f69e480803c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:28.492357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6af53-0c63-4c5d-80d7-2168783cecf9 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:28.530063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457367a-da1d-408e-9b4b-5095126c0370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:28.530725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457367a-da1d-408e-9b4b-5095126c0370 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:28.531009 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457367a-da1d-408e-9b4b-5095126c0370 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:28.531285 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457367a-da1d-408e-9b4b-5095126c0370 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:28.543587 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457367a-da1d-408e-9b4b-5095126c0370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:28.549615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-2457367a-da1d-408e-9b4b-5095126c0370 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:33:28.549615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:28.549615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:28.549615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:28.549615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:28.549615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:28.549615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:28.549615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:28.549615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:28.549615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:28.549615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:28.549615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:28.549615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:28.549615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:28.549615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:28.549615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:28.552152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:28.552152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:28.552152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:28.552152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:28.552152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:28.552152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:28.552152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:28.552152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:28.552152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:28.552152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:28.552152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:28.552152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:28.552152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:28.552152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:28.552152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:28.552152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:28.553263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:28.553263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:28.553263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:28.553263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:28.553263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:28.553263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:28.553263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:28.553263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:28.553263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:28.553263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:28.553263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:33:28.553263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:28.553263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 220/445] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:33:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:28.553263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457367a-da1d-408e-9b4b-5095126c0370 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:28.557202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:28.582820 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:28.607195 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cc3d8-819b-4c49-97b2-6f69e480803c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:28.646228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3cf30-0096-4335-9761-7c7b3815a2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:28.646761 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3cf30-0096-4335-9761-7c7b3815a2ca None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:28.647047 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3cf30-0096-4335-9761-7c7b3815a2ca None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:28.647319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3cf30-0096-4335-9761-7c7b3815a2ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:28.648048 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3cf30-0096-4335-9761-7c7b3815a2ca None admin] RBAC: Adding query filter params (group.id=9cd7836e6c494ac89823b82d4d577573, role.id=344db47133bb4fb2843696759f71b2c7, scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:28.648358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3cf30-0096-4335-9761-7c7b3815a2ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:28.649832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3cf30-0096-4335-9761-7c7b3815a2ca None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:28.656318 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 226/446] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Sep 11 10:33:28 2022] GET /identity/v3/role_assignments?group.id=9cd7836e6c494ac89823b82d4d577573&scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa&role.id=344db47133bb4fb2843696759f71b2c7 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:28.657671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3cf30-0096-4335-9761-7c7b3815a2ca None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:28.681388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457367a-da1d-408e-9b4b-5095126c0370 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:28.733455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085ea72-fbec-4cc2-9994-a14b12bb57f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:28.734186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085ea72-fbec-4cc2-9994-a14b12bb57f0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:28.734782 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085ea72-fbec-4cc2-9994-a14b12bb57f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:28.734782 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085ea72-fbec-4cc2-9994-a14b12bb57f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:28.793948 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3cf30-0096-4335-9761-7c7b3815a2ca None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:28.828375 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085ea72-fbec-4cc2-9994-a14b12bb57f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:28.830068 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085ea72-fbec-4cc2-9994-a14b12bb57f0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:28.836468 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde36c7c-6b5b-4524-8b68-d288a6332d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:28.837781 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde36c7c-6b5b-4524-8b68-d288a6332d11 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:28.838253 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde36c7c-6b5b-4524-8b68-d288a6332d11 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:28.838744 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde36c7c-6b5b-4524-8b68-d288a6332d11 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:28.839654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde36c7c-6b5b-4524-8b68-d288a6332d11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:28.839957 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde36c7c-6b5b-4524-8b68-d288a6332d11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:28.841154 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:28.841404 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde36c7c-6b5b-4524-8b68-d288a6332d11 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:28.851832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 227/447] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:28.857774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde36c7c-6b5b-4524-8b68-d288a6332d11 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:28.867915 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:28.953742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 221/448] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:28.958900 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085ea72-fbec-4cc2-9994-a14b12bb57f0 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:28.973377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde36c7c-6b5b-4524-8b68-d288a6332d11 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:29.011298 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ec9d3-28af-4f78-8623-00c3509b6e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:29.012922 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ec9d3-28af-4f78-8623-00c3509b6e5b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:29.013199 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ec9d3-28af-4f78-8623-00c3509b6e5b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:29.014599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ec9d3-28af-4f78-8623-00c3509b6e5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:29.072685 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085ea72-fbec-4cc2-9994-a14b12bb57f0 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:29.075402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:29.094292 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ec9d3-28af-4f78-8623-00c3509b6e5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:29.096153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ec9d3-28af-4f78-8623-00c3509b6e5b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:29.104583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:29.110279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29e704-92cb-4377-947e-d0c1e693228b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:29.110904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29e704-92cb-4377-947e-d0c1e693228b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:29.111176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29e704-92cb-4377-947e-d0c1e693228b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:29.111448 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29e704-92cb-4377-947e-d0c1e693228b None admin] PATH_INFO: `/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:29.112623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29e704-92cb-4377-947e-d0c1e693228b None admin] RBAC: Authorizing `identity:get_project(project_id=0e22a81d096b490087b34c4bcaa8c9fa)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:29.114046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29e704-92cb-4377-947e-d0c1e693228b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:29.115774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 222/449] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:28 2022] GET /identity/v3/projects/0e22a81d096b490087b34c4bcaa8c9fa => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:29.121129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29e704-92cb-4377-947e-d0c1e693228b None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:29.193877 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 228/450] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:29.199364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ec9d3-28af-4f78-8623-00c3509b6e5b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:29.219050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29e704-92cb-4377-947e-d0c1e693228b None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:29.253408 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b901ad-bc21-4413-b5fa-d793273d639c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:29.254022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b901ad-bc21-4413-b5fa-d793273d639c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:29.254302 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b901ad-bc21-4413-b5fa-d793273d639c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:29.254575 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b901ad-bc21-4413-b5fa-d793273d639c None admin] PATH_INFO: `/v3/groups/9cd7836e6c494ac89823b82d4d577573` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:29.255678 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b901ad-bc21-4413-b5fa-d793273d639c None admin] RBAC: Authorizing `identity:get_group(group_id=9cd7836e6c494ac89823b82d4d577573)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:29.257153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b901ad-bc21-4413-b5fa-d793273d639c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:29.258707 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 223/451] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 10:33:29 2022] GET /identity/v3/groups/9cd7836e6c494ac89823b82d4d577573 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:29.264334 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b901ad-bc21-4413-b5fa-d793273d639c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:29.293219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ec9d3-28af-4f78-8623-00c3509b6e5b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:29.300257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:29.304062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:29.327488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38839e28-89f9-4116-99dc-350277767c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:29.328105 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38839e28-89f9-4116-99dc-350277767c0b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:29.328373 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38839e28-89f9-4116-99dc-350277767c0b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:29.328677 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38839e28-89f9-4116-99dc-350277767c0b None admin] PATH_INFO: `/v3/projects/7c1c2ee49dc945b2a0f435c605ac4ed3` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:29.329819 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38839e28-89f9-4116-99dc-350277767c0b None admin] RBAC: Authorizing `identity:get_project(project_id=7c1c2ee49dc945b2a0f435c605ac4ed3)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:29.331336 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38839e28-89f9-4116-99dc-350277767c0b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:29.333144 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 229/452] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:33:29 2022] GET /identity/v3/projects/7c1c2ee49dc945b2a0f435c605ac4ed3 => generated 344 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:29.338326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38839e28-89f9-4116-99dc-350277767c0b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:29.364387 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b901ad-bc21-4413-b5fa-d793273d639c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:29.398184 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96e511-87ac-44cb-9498-7ab26b6ba5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:29.398779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96e511-87ac-44cb-9498-7ab26b6ba5a9 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:29.399059 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96e511-87ac-44cb-9498-7ab26b6ba5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:29.399326 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96e511-87ac-44cb-9498-7ab26b6ba5a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:29.400043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96e511-87ac-44cb-9498-7ab26b6ba5a9 None admin] RBAC: Adding query filter params (group.id=9cd7836e6c494ac89823b82d4d577573, role.id=30f1e6f9ddb649d2804d9128b17348f6, scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:29.400344 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96e511-87ac-44cb-9498-7ab26b6ba5a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:29.401801 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96e511-87ac-44cb-9498-7ab26b6ba5a9 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:29.407383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 224/453] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Sep 11 10:33:29 2022] GET /identity/v3/role_assignments?group.id=9cd7836e6c494ac89823b82d4d577573&scope.project.id=0e22a81d096b490087b34c4bcaa8c9fa&role.id=30f1e6f9ddb649d2804d9128b17348f6 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:29.436399 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38839e28-89f9-4116-99dc-350277767c0b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:29.474002 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d657ef-ec3e-40e3-ac50-cf54b24d8e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:29.474554 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d657ef-ec3e-40e3-ac50-cf54b24d8e0a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:29.474831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d657ef-ec3e-40e3-ac50-cf54b24d8e0a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:29.475102 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d657ef-ec3e-40e3-ac50-cf54b24d8e0a None admin] PATH_INFO: `/v3/groups/498b31fe507040afabf8c228228ec469` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:29.476254 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d657ef-ec3e-40e3-ac50-cf54b24d8e0a None admin] RBAC: Authorizing `identity:get_group(group_id=498b31fe507040afabf8c228228ec469)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:29.477780 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d657ef-ec3e-40e3-ac50-cf54b24d8e0a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:29.479431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 230/454] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 10:33:29 2022] GET /identity/v3/groups/498b31fe507040afabf8c228228ec469 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:29.485488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96e511-87ac-44cb-9498-7ab26b6ba5a9 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:29.590225 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96e511-87ac-44cb-9498-7ab26b6ba5a9 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:29.592534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:29.625564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e455bd-9433-482d-8a15-f68521e124ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:29.626163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e455bd-9433-482d-8a15-f68521e124ef None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:29.626440 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e455bd-9433-482d-8a15-f68521e124ef None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:29.626709 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e455bd-9433-482d-8a15-f68521e124ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:29.627456 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e455bd-9433-482d-8a15-f68521e124ef None admin] RBAC: Adding query filter params (group.id=498b31fe507040afabf8c228228ec469, role.id=529cb3511f3a498b9b7169ed5b0f6b8e, scope.project.id=7c1c2ee49dc945b2a0f435c605ac4ed3) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:29.627762 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e455bd-9433-482d-8a15-f68521e124ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:29.629217 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e455bd-9433-482d-8a15-f68521e124ef None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:29.635195 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 225/455] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Sep 11 10:33:29 2022] GET /identity/v3/role_assignments?group.id=498b31fe507040afabf8c228228ec469&scope.project.id=7c1c2ee49dc945b2a0f435c605ac4ed3&role.id=529cb3511f3a498b9b7169ed5b0f6b8e => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:32.149236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f8977-1762-4035-9150-a3bf6aa5c9f9 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:32.150200 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f8977-1762-4035-9150-a3bf6aa5c9f9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:32.150729 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f8977-1762-4035-9150-a3bf6aa5c9f9 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:32.152630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 231/456] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:32.159002 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e944e-31ee-46f1-95f1-d7f6b2f97ff3 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:32.159519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e944e-31ee-46f1-95f1-d7f6b2f97ff3 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:32.159519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e944e-31ee-46f1-95f1-d7f6b2f97ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:32.185677 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-1c9e944e-31ee-46f1-95f1-d7f6b2f97ff3 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:32.186886 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-1c9e944e-31ee-46f1-95f1-d7f6b2f97ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:32.265886 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 226/457] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:32.318111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efefbf-f554-462a-8095-7ddbf5649afe None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:32.318450 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efefbf-f554-462a-8095-7ddbf5649afe None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:32.318655 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efefbf-f554-462a-8095-7ddbf5649afe None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:32.320241 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 232/458] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:32.325522 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252f5a6-7815-4c62-93dd-bc36024492e4 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:32.325810 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252f5a6-7815-4c62-93dd-bc36024492e4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:32.326079 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252f5a6-7815-4c62-93dd-bc36024492e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:32.351075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-5252f5a6-7815-4c62-93dd-bc36024492e4 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:32.352291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-5252f5a6-7815-4c62-93dd-bc36024492e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:32.430234 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 227/459] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:32.692995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efefbf-f554-462a-8095-7ddbf5649afe None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:32.764059 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:32.824965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f2657-939f-411e-9e49-ee842768b938 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:32.825285 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f2657-939f-411e-9e49-ee842768b938 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:32.825513 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f2657-939f-411e-9e49-ee842768b938 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:32.828235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 228/460] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:32.831938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f2657-939f-411e-9e49-ee842768b938 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:32.838219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efefbf-f554-462a-8095-7ddbf5649afe None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:32.861392 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:32.879141 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7302050-7f30-4bf8-84e0-9533a3dd13f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:32.879856 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7302050-7f30-4bf8-84e0-9533a3dd13f7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:32.880138 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7302050-7f30-4bf8-84e0-9533a3dd13f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:32.880466 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7302050-7f30-4bf8-84e0-9533a3dd13f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:32.892093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7302050-7f30-4bf8-84e0-9533a3dd13f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:32.893913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7302050-7f30-4bf8-84e0-9533a3dd13f7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:32.910702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-a7302050-7f30-4bf8-84e0-9533a3dd13f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:32.910702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:32.910702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:32.910702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:32.910702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:32.910702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:32.910702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:32.910702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:32.910702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:32.910702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:32.910702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:32.910702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:32.910702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:32.910702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:32.910702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:32.910702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:32.912282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:32.912282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:32.912282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:32.912282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:32.912282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:32.912282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:32.912282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:32.912282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:32.912282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:32.912282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:32.912282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:32.912282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:32.912282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:32.912282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:32.912282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:32.912282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:32.912282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:32.913387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:32.913387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:32.913387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:32.914442 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 233/461] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:32.915815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9b64a-6177-499d-831f-da3d646254ab None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:32.916194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9b64a-6177-499d-831f-da3d646254ab None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:32.916576 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9b64a-6177-499d-831f-da3d646254ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:32.935125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b7b9b64a-6177-499d-831f-da3d646254ab None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:32.936455 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b7b9b64a-6177-499d-831f-da3d646254ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:32.954954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f2657-939f-411e-9e49-ee842768b938 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:32.992993 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a116e84-6b3a-4488-8313-7070d8378fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:32.993626 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a116e84-6b3a-4488-8313-7070d8378fb0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:32.993905 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a116e84-6b3a-4488-8313-7070d8378fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:32.994179 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a116e84-6b3a-4488-8313-7070d8378fb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:33.006076 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a116e84-6b3a-4488-8313-7070d8378fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:33.007594 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a116e84-6b3a-4488-8313-7070d8378fb0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:33.010941 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 234/462] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:33.012074 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9b64a-6177-499d-831f-da3d646254ab None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:33.024289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-0a116e84-6b3a-4488-8313-7070d8378fb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:33.024289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:33.024289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:33.024289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:33.024289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:33.024289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:33.024289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:33.024289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:33.024289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:33.024289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:33.024289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:33.024289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:33.024289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:33.024289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:33.024289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:33.024289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:33.025331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:33.025331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:33.025331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:33.025331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:33.025331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:33.025331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:33.025331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:33.025331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:33.025331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:33.025331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:33.025331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:33.025331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:33.025331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:33.025331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:33.025331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:33.025331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:33.025331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:33.029855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:33.029855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:33.029855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:33.029855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 229/463] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:33:33.029855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ee181-a427-4953-8555-d98c314c56af None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:33.029855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ee181-a427-4953-8555-d98c314c56af None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:33.029855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ee181-a427-4953-8555-d98c314c56af None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:33.029855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 230/464] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:33.034580 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14176f02-6442-432f-9317-4345e23281a2 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:33.034864 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14176f02-6442-432f-9317-4345e23281a2 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:33.035138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14176f02-6442-432f-9317-4345e23281a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:33.046653 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:33.055748 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-14176f02-6442-432f-9317-4345e23281a2 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:33.056958 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-14176f02-6442-432f-9317-4345e23281a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:33.125108 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9b64a-6177-499d-831f-da3d646254ab None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:33.136925 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 231/465] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:33.137942 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14176f02-6442-432f-9317-4345e23281a2 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:33.157194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:33.173408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e77bf-6e5e-4e1c-9e36-f477c2d8a52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:33.174041 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e77bf-6e5e-4e1c-9e36-f477c2d8a52b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:33.174282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e77bf-6e5e-4e1c-9e36-f477c2d8a52b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:33.174732 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e77bf-6e5e-4e1c-9e36-f477c2d8a52b None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:33.175397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e77bf-6e5e-4e1c-9e36-f477c2d8a52b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:33.175768 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e77bf-6e5e-4e1c-9e36-f477c2d8a52b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:33.177301 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e77bf-6e5e-4e1c-9e36-f477c2d8a52b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:33.200927 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 235/466] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:33.207492 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e77bf-6e5e-4e1c-9e36-f477c2d8a52b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:33.310822 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14176f02-6442-432f-9317-4345e23281a2 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:33.332522 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:33.351289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd1fd3-c63e-4030-8694-295258c214dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:33.351603 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e77bf-6e5e-4e1c-9e36-f477c2d8a52b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:33.351950 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd1fd3-c63e-4030-8694-295258c214dd None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:33.352230 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd1fd3-c63e-4030-8694-295258c214dd None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:33.352500 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd1fd3-c63e-4030-8694-295258c214dd None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:33.353263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd1fd3-c63e-4030-8694-295258c214dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:33.353570 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd1fd3-c63e-4030-8694-295258c214dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:33.355036 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd1fd3-c63e-4030-8694-295258c214dd None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:33.374262 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 232/467] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:33.375206 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd1fd3-c63e-4030-8694-295258c214dd None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:33.392408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ec3a4-e496-4b8e-ba39-215a94de62f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:33.393688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ec3a4-e496-4b8e-ba39-215a94de62f7 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:33.393968 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ec3a4-e496-4b8e-ba39-215a94de62f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:33.394237 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ec3a4-e496-4b8e-ba39-215a94de62f7 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:33.394876 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ec3a4-e496-4b8e-ba39-215a94de62f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:33.396290 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ec3a4-e496-4b8e-ba39-215a94de62f7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:33.420808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 236/468] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 10:33:33 2022] POST /identity/v3/users => generated 246 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:33:33.421920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ec3a4-e496-4b8e-ba39-215a94de62f7 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:33.471787 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:33.511225 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd1fd3-c63e-4030-8694-295258c214dd None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:33.550324 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234d8c4-e6ed-42fd-9a5e-b560de75597f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:33.551271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234d8c4-e6ed-42fd-9a5e-b560de75597f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:33.551724 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234d8c4-e6ed-42fd-9a5e-b560de75597f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:33.551825 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ec3a4-e496-4b8e-ba39-215a94de62f7 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:33.552273 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234d8c4-e6ed-42fd-9a5e-b560de75597f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:33.563894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234d8c4-e6ed-42fd-9a5e-b560de75597f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:33.565887 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234d8c4-e6ed-42fd-9a5e-b560de75597f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:33.582347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-c234d8c4-e6ed-42fd-9a5e-b560de75597f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:33.582347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:33.582347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:33.582347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:33.582347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:33.582347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:33.582347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:33.582347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:33.582347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:33.582347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:33.582347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:33.582347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:33.582347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:33.582347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:33.582347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:33.582347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:33.583296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:33.583296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:33.583296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:33.583296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:33.583296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:33.583296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:33.583296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:33.583296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:33.583296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:33.583296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:33.583296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:33.583296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:33.583296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:33.583296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:33.583296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:33.583296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:33.583296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:33.584119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:33.584119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:33.584119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:33.586323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 233/469] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:33.591905 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac06d6-578b-4944-8e49-618aca9bfa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:33.592583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac06d6-578b-4944-8e49-618aca9bfa2a None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:33.592873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac06d6-578b-4944-8e49-618aca9bfa2a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:33.593192 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac06d6-578b-4944-8e49-618aca9bfa2a None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:33.593556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234d8c4-e6ed-42fd-9a5e-b560de75597f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:33.593861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac06d6-578b-4944-8e49-618aca9bfa2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:33.595671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac06d6-578b-4944-8e49-618aca9bfa2a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:33.611689 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:33.633009 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 237/470] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 10:33:33 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:33:33.634121 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac06d6-578b-4944-8e49-618aca9bfa2a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:33.751919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234d8c4-e6ed-42fd-9a5e-b560de75597f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:33.769785 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac06d6-578b-4944-8e49-618aca9bfa2a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:33.801157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:33.809418 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88de8e-23a5-4f2d-a51b-bcfe908a093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:33.810493 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88de8e-23a5-4f2d-a51b-bcfe908a093d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:33.810877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88de8e-23a5-4f2d-a51b-bcfe908a093d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:33.811218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88de8e-23a5-4f2d-a51b-bcfe908a093d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:33.826136 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88de8e-23a5-4f2d-a51b-bcfe908a093d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:33.826323 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fe47c-c5da-4c87-9628-b1e3ca237fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:33.826963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fe47c-c5da-4c87-9628-b1e3ca237fc6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:33.827352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fe47c-c5da-4c87-9628-b1e3ca237fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:33.827690 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fe47c-c5da-4c87-9628-b1e3ca237fc6 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:33.828457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fe47c-c5da-4c87-9628-b1e3ca237fc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:33.828858 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88de8e-23a5-4f2d-a51b-bcfe908a093d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:33.828975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fe47c-c5da-4c87-9628-b1e3ca237fc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:33.830603 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fe47c-c5da-4c87-9628-b1e3ca237fc6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:33.845372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-2c88de8e-23a5-4f2d-a51b-bcfe908a093d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:33.845372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:33.845372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:33.845372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:33.845372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:33.845372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:33.845372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:33.845372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:33.845372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:33.845372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:33.845372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:33.845372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:33.845372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:33.845372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:33.845372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:33.845372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:33.847141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:33.847141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:33.847141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:33.847141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:33.847141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:33.847141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:33.847141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:33.847141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:33.847141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:33.847141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:33.847141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:33.847141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:33.847141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:33.847141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:33.847141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:33.847141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:33.847141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:33.847981 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:33.847981 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:33.847981 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:33.848156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 238/471] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:33.849854 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 234/472] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:33.852536 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fe47c-c5da-4c87-9628-b1e3ca237fc6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:33.856021 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88de8e-23a5-4f2d-a51b-bcfe908a093d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:33.925430 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:33.976254 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fe47c-c5da-4c87-9628-b1e3ca237fc6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:33.998357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88de8e-23a5-4f2d-a51b-bcfe908a093d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:34.012677 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cc43c-82f5-43a8-829d-7ec7685c895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:34.013287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cc43c-82f5-43a8-829d-7ec7685c895c None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:34.013637 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cc43c-82f5-43a8-829d-7ec7685c895c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:34.013829 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cc43c-82f5-43a8-829d-7ec7685c895c None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:34.014540 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cc43c-82f5-43a8-829d-7ec7685c895c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:34.017072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cc43c-82f5-43a8-829d-7ec7685c895c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:34.043756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd472cb-f655-490f-8b27-5689107a0531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:34.044048 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 239/473] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 10:33:33 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:33:34.045033 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd472cb-f655-490f-8b27-5689107a0531 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:34.045630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd472cb-f655-490f-8b27-5689107a0531 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:34.046096 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd472cb-f655-490f-8b27-5689107a0531 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:34.046996 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd472cb-f655-490f-8b27-5689107a0531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:34.047593 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd472cb-f655-490f-8b27-5689107a0531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:34.049317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd472cb-f655-490f-8b27-5689107a0531 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:34.049872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815277bc-0e4d-454a-af53-02c3fbb12fd8 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:34.050158 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815277bc-0e4d-454a-af53-02c3fbb12fd8 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:34.050432 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815277bc-0e4d-454a-af53-02c3fbb12fd8 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:34.057094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 240/474] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:34 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:34.062515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b43642-c2c0-44ff-a53b-a86d0dbeaabc None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:34.062812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b43642-c2c0-44ff-a53b-a86d0dbeaabc None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:34.063063 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b43642-c2c0-44ff-a53b-a86d0dbeaabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:34.066420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 235/475] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:34.072661 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd472cb-f655-490f-8b27-5689107a0531 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:34.103144 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-55b43642-c2c0-44ff-a53b-a86d0dbeaabc None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:34.104357 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-55b43642-c2c0-44ff-a53b-a86d0dbeaabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:34.111209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:34.206819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd472cb-f655-490f-8b27-5689107a0531 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:34.236698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 241/476] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:34.250492 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cca83-ad9f-46d6-89c9-5dff1ff1e277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:34.251274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cca83-ad9f-46d6-89c9-5dff1ff1e277 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:34.251647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cca83-ad9f-46d6-89c9-5dff1ff1e277 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:34.252017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cca83-ad9f-46d6-89c9-5dff1ff1e277 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:34.252893 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cca83-ad9f-46d6-89c9-5dff1ff1e277 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:34.254434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cca83-ad9f-46d6-89c9-5dff1ff1e277 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:34.285788 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 236/477] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 10:33:34 2022] POST /identity/v3/users => generated 249 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:33:34.524948 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b43642-c2c0-44ff-a53b-a86d0dbeaabc None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:34.583463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:34.661289 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b43642-c2c0-44ff-a53b-a86d0dbeaabc None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:34.704034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a3de5-759f-45d3-a565-c784f6e59471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:34.704943 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a3de5-759f-45d3-a565-c784f6e59471 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:34.705365 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a3de5-759f-45d3-a565-c784f6e59471 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:34.705846 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a3de5-759f-45d3-a565-c784f6e59471 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:34.706657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a3de5-759f-45d3-a565-c784f6e59471 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:34.708160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a3de5-759f-45d3-a565-c784f6e59471 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:34.718092 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.sql.core [None req-c06a3de5-759f-45d3-a565-c784f6e59471 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 10:33:34.718092 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 11 10:33:34.718092 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [parameters: {'id': '636d82ba36b244f5a690ca144537bae9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 11 10:33:34.718092 dv-cinder-856460-3-smb devstack@keystone.service[88077]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88077) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 10:33:34.739580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-c06a3de5-759f-45d3-a565-c784f6e59471 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 11 10:33:34.739580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:34.739580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 10:33:34.739580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 10:33:34.739580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 10:33:34.739580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 10:33:34.739580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 10:33:34.739580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 10:33:34.739580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 10:33:34.739580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application conn.query(q) Sep 11 10:33:34.739580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 10:33:34.739580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 10:33:34.739580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 10:33:34.739580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result.read() Sep 11 10:33:34.739580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 10:33:34.740697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 10:33:34.740697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 10:33:34.740697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 10:33:34.740697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 10:33:34.740697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 10:33:34.740697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 10:33:34.740697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 10:33:34.740697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 10:33:34.740697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:34.740697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 10:33:34.740697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:34.740697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:34.740697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 10:33:34.740697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 10:33:34.740697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 11 10:33:34.740697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return ref.to_dict() Sep 11 10:33:34.740697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 10:33:34.740697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application next(self.gen) Sep 11 10:33:34.741790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 10:33:34.741790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application yield resource Sep 11 10:33:34.741790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 10:33:34.741790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application next(self.gen) Sep 11 10:33:34.741790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 10:33:34.741790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 10:33:34.741790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 10:33:34.741790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 10:33:34.741790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 10:33:34.741790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise self.value Sep 11 10:33:34.741790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 10:33:34.741790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 10:33:34.741790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 10:33:34.741790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application session.commit() Sep 11 10:33:34.741790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 10:33:34.741790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 10:33:34.741790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 10:33:34.742812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 10:33:34.742812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 10:33:34.742812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.session.flush() Sep 11 10:33:34.742812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 10:33:34.742812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 10:33:34.742812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 10:33:34.742812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 10:33:34.742812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 10:33:34.742812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application compat.raise_( Sep 11 10:33:34.742812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 10:33:34.742812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception Sep 11 10:33:34.742812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 10:33:34.742812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 10:33:34.742812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 10:33:34.742812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 10:33:34.742812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 10:33:34.742812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 10:33:34.743727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 10:33:34.743727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 10:33:34.743727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 11 10:33:34.743727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 11 10:33:34.743727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 10:33:34.743727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 10:33:34.743727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 10:33:34.743727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 10:33:34.743727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 10:33:34.743727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 10:33:34.743727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 10:33:34.743727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 10:33:34.743727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 10:33:34.743727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 10:33:34.743727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 10:33:34.743727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception Sep 11 10:33:34.744520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 10:33:34.744520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 10:33:34.744520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 10:33:34.744520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 10:33:34.744520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 10:33:34.744520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 10:33:34.744520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 10:33:34.744520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application conn.query(q) Sep 11 10:33:34.744520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 10:33:34.744520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 10:33:34.744520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 10:33:34.744520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result.read() Sep 11 10:33:34.744520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 10:33:34.744520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 10:33:34.744520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 10:33:34.744520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 10:33:34.745408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 10:33:34.745408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 10:33:34.745408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 10:33:34.745408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 10:33:34.745408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 10:33:34.745408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 11 10:33:34.745408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [parameters: {'id': '636d82ba36b244f5a690ca144537bae9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 11 10:33:34.745408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 10:33:34.745408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:34.745408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:33:34.745408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:34.745408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:34.745408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:34.745408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:34.745408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:34.745408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:34.746333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:34.746333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:34.746333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:34.746333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:34.746333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:34.746333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:34.746333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 11 10:33:34.746333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 11 10:33:34.746333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:34.746333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:34.746333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 11 10:33:34.746333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 11 10:33:34.746333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 10:33:34.746333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 10:33:34.746333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 11 10:33:34.746333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:34.747367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 242/478] 10.222.0.20 () {60 vars in 1131 bytes} [Sun Sep 11 10:33:34 2022] POST /identity/v3/roles => generated 144 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:34.748586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cca83-ad9f-46d6-89c9-5dff1ff1e277 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:34.890739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:34.902619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cca83-ad9f-46d6-89c9-5dff1ff1e277 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:34.950690 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f18222-4187-4715-b3c0-700add75bcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:34.951387 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f18222-4187-4715-b3c0-700add75bcd4 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:34.951669 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f18222-4187-4715-b3c0-700add75bcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:34.951997 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f18222-4187-4715-b3c0-700add75bcd4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:34.963266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f18222-4187-4715-b3c0-700add75bcd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:34.968586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-99f18222-4187-4715-b3c0-700add75bcd4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:33:34.968586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:34.968586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:34.968586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:34.968586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:34.968586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:34.968586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:34.968586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:34.968586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:34.968586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:34.968586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:34.968586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:34.968586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:34.968586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:34.968586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:34.968586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:34.969428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:34.969428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:34.969428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:34.969428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:34.969428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:34.969428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:34.969428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:34.969428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:34.969428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:34.969428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:34.969428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:34.969428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:34.969428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:34.969428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:34.969428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:34.969428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:34.970832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:34.970832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:34.970832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:34.970832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:34.970832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:34.970832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:34.970832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:34.970832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:34.970832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:34.970832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:34.970832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 10:33:34.970832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:34.970832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 237/479] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:33:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:34.975799 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a3de5-759f-45d3-a565-c784f6e59471 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:35.079211 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a3de5-759f-45d3-a565-c784f6e59471 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:35.092922 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:35.118443 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e443f-5655-4432-a05a-788faa74bc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:35.119354 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e443f-5655-4432-a05a-788faa74bc5c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:35.119638 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e443f-5655-4432-a05a-788faa74bc5c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:35.119914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e443f-5655-4432-a05a-788faa74bc5c None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:35.120610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e443f-5655-4432-a05a-788faa74bc5c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:35.120917 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e443f-5655-4432-a05a-788faa74bc5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:35.122288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e443f-5655-4432-a05a-788faa74bc5c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:35.131258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 243/480] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:36.184073 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527f4cf-573e-4bbb-b5f5-8b3fda7a1e84 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:36.184860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527f4cf-573e-4bbb-b5f5-8b3fda7a1e84 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:36.184860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527f4cf-573e-4bbb-b5f5-8b3fda7a1e84 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:36.186255 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 238/481] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:36.191807 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c163a5-f545-4713-9526-2d76862e05d7 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:36.192329 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c163a5-f545-4713-9526-2d76862e05d7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:36.192487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c163a5-f545-4713-9526-2d76862e05d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:36.216261 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-37c163a5-f545-4713-9526-2d76862e05d7 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:36.217546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-37c163a5-f545-4713-9526-2d76862e05d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:36.244672 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e4c51-d7f5-4a73-a5f2-ae40a174358c None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:36.244963 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e4c51-d7f5-4a73-a5f2-ae40a174358c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:36.245203 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e4c51-d7f5-4a73-a5f2-ae40a174358c None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:36.246791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 239/482] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:36.251811 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef2566-ecdb-4592-9ac9-b8dcdfb20d29 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:36.252101 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef2566-ecdb-4592-9ac9-b8dcdfb20d29 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:36.252408 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef2566-ecdb-4592-9ac9-b8dcdfb20d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:36.286981 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-c5ef2566-ecdb-4592-9ac9-b8dcdfb20d29 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:36.291175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c5ef2566-ecdb-4592-9ac9-b8dcdfb20d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:36.324956 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 244/483] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:36.410885 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 240/484] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:36.675408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c163a5-f545-4713-9526-2d76862e05d7 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:36.728819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef2566-ecdb-4592-9ac9-b8dcdfb20d29 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:36.840384 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:36.844801 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c163a5-f545-4713-9526-2d76862e05d7 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:36.885204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:36.900841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca7cf8-855a-43b7-959d-66298ff32f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:36.901580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca7cf8-855a-43b7-959d-66298ff32f7c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:36.901863 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca7cf8-855a-43b7-959d-66298ff32f7c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:36.902137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca7cf8-855a-43b7-959d-66298ff32f7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:36.907442 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef2566-ecdb-4592-9ac9-b8dcdfb20d29 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:36.914631 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca7cf8-855a-43b7-959d-66298ff32f7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:36.919887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ceca7cf8-855a-43b7-959d-66298ff32f7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:36.919887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:36.919887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:36.919887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:36.919887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:36.919887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:36.919887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:36.919887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:36.919887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:36.919887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:36.919887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:36.919887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:36.919887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:36.919887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:36.919887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:36.919887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:36.922007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:36.922007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:36.922007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:36.922007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:36.922007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:36.922007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:36.922007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:36.922007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:36.922007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:36.922007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:36.922007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:36.922007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:36.922007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:36.922007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:36.922007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:36.922007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:36.923269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:36.923269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:36.923269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:36.923269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:36.923269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:36.923269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:36.923269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:36.923269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:36.923269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:36.923269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:36.923269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:36.923269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:36.926813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 245/485] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:33:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:36.926813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81c9ca-d169-4ab0-9c01-86ad1dc4715b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:36.927524 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81c9ca-d169-4ab0-9c01-86ad1dc4715b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:36.927809 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81c9ca-d169-4ab0-9c01-86ad1dc4715b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:36.929420 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 246/486] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:36.930145 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81c9ca-d169-4ab0-9c01-86ad1dc4715b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:36.962010 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97945d7e-8e77-4c1b-ba72-395a000deb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:36.962650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97945d7e-8e77-4c1b-ba72-395a000deb26 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:36.962931 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97945d7e-8e77-4c1b-ba72-395a000deb26 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:36.963205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97945d7e-8e77-4c1b-ba72-395a000deb26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:36.978379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97945d7e-8e77-4c1b-ba72-395a000deb26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:36.984902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-97945d7e-8e77-4c1b-ba72-395a000deb26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:36.984902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:36.984902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:36.984902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:36.984902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:36.984902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:36.984902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:36.984902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:36.984902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:36.984902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:36.984902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:36.984902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:36.984902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:36.984902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:36.984902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:36.984902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:36.987084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:36.987084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:36.987084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:36.987084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:36.987084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:36.987084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:36.987084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:36.987084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:36.987084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:36.987084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:36.987084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:36.987084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:36.987084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:36.987084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:36.987084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:36.987084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:36.989081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:36.989081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:36.989081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:36.989081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:36.989081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:36.989081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:36.989081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:36.989081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:36.989081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:36.989081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:36.989081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:36.989081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:36.989081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 241/487] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:33:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:36.989081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31054b71-c392-4855-b01a-8016f485f107 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:36.990753 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31054b71-c392-4855-b01a-8016f485f107 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:36.990753 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31054b71-c392-4855-b01a-8016f485f107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:37.016462 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-31054b71-c392-4855-b01a-8016f485f107 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:37.019380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-31054b71-c392-4855-b01a-8016f485f107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:37.056534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81c9ca-d169-4ab0-9c01-86ad1dc4715b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:37.094963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397e0b1-b958-4ec3-8830-81c0461fa379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:37.095910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397e0b1-b958-4ec3-8830-81c0461fa379 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:37.096234 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397e0b1-b958-4ec3-8830-81c0461fa379 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:37.096802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397e0b1-b958-4ec3-8830-81c0461fa379 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:37.097532 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397e0b1-b958-4ec3-8830-81c0461fa379 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:37.097858 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397e0b1-b958-4ec3-8830-81c0461fa379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:37.099209 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397e0b1-b958-4ec3-8830-81c0461fa379 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:37.114577 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 247/488] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:33:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:37.114577 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397e0b1-b958-4ec3-8830-81c0461fa379 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:37.115282 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 242/489] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:37.117315 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31054b71-c392-4855-b01a-8016f485f107 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:37.161504 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:37.245319 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:37.285540 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397e0b1-b958-4ec3-8830-81c0461fa379 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:37.313649 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31054b71-c392-4855-b01a-8016f485f107 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:37.358637 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b7e7f-77f2-4135-b59b-b31188dc4b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:37.359469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b7e7f-77f2-4135-b59b-b31188dc4b78 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:37.359587 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b7e7f-77f2-4135-b59b-b31188dc4b78 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:37.359777 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b7e7f-77f2-4135-b59b-b31188dc4b78 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:37.360459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b7e7f-77f2-4135-b59b-b31188dc4b78 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:37.360773 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b7e7f-77f2-4135-b59b-b31188dc4b78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:37.362701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b7e7f-77f2-4135-b59b-b31188dc4b78 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:37.371893 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8c376-04a3-4fca-acd3-9f724b384e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:37.372757 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8c376-04a3-4fca-acd3-9f724b384e11 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:37.373625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8c376-04a3-4fca-acd3-9f724b384e11 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:37.374046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8c376-04a3-4fca-acd3-9f724b384e11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:37.382847 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 248/490] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:33:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:37.388887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b7e7f-77f2-4135-b59b-b31188dc4b78 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:37.390790 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8c376-04a3-4fca-acd3-9f724b384e11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:37.392260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8c376-04a3-4fca-acd3-9f724b384e11 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:37.412046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-60f8c376-04a3-4fca-acd3-9f724b384e11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:37.412046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:37.412046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:37.412046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:37.412046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:37.412046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:37.412046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:37.412046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:37.412046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:37.412046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:37.412046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:37.412046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:37.412046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:37.412046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:37.412046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:37.412046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:37.413007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:37.413007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:37.413007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:37.413007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:37.413007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:37.413007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:37.413007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:37.413007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:37.413007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:37.413007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:37.413007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:37.413007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:37.413007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:37.413007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:37.413007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:37.413007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:37.413007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:37.413830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:37.413830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:37.413830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:37.417019 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 243/491] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:37.422680 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8c376-04a3-4fca-acd3-9f724b384e11 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:37.495942 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:37.515572 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b7e7f-77f2-4135-b59b-b31188dc4b78 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:37.529809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8c376-04a3-4fca-acd3-9f724b384e11 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:37.552182 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3bf308-fb93-4529-aad9-d500af62ce9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:37.553054 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bf308-fb93-4529-aad9-d500af62ce9f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:37.553193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:37.553284 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bf308-fb93-4529-aad9-d500af62ce9f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:37.553366 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bf308-fb93-4529-aad9-d500af62ce9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:37.565007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3bf308-fb93-4529-aad9-d500af62ce9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:37.566443 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3522aa-1879-4e6d-93a7-9887ca7debf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:37.566586 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3bf308-fb93-4529-aad9-d500af62ce9f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:37.567053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3522aa-1879-4e6d-93a7-9887ca7debf9 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:37.567336 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3522aa-1879-4e6d-93a7-9887ca7debf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:37.567613 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3522aa-1879-4e6d-93a7-9887ca7debf9 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:37.568264 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3522aa-1879-4e6d-93a7-9887ca7debf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:37.568595 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3522aa-1879-4e6d-93a7-9887ca7debf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:37.569980 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3522aa-1879-4e6d-93a7-9887ca7debf9 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:37.581654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ba3bf308-fb93-4529-aad9-d500af62ce9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:37.581654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:37.581654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:37.581654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:37.581654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:37.581654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:37.581654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:37.581654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:37.581654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:37.581654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:37.581654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:37.581654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:37.581654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:37.581654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:37.581654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:37.581654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:37.582606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:37.582606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:37.582606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:37.582606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:37.582606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:37.582606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:37.582606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:37.582606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:37.582606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:37.582606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:37.582606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:37.582606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:37.582606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:37.582606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:37.582606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:37.582606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:37.582606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:37.583525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:37.583525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:37.583525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:37.583525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 249/492] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:33:37.584338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d76e4-07a8-4204-aebb-ee00e26bf4f0 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:37.584639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d76e4-07a8-4204-aebb-ee00e26bf4f0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:37.584912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d76e4-07a8-4204-aebb-ee00e26bf4f0 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:37.588614 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 250/493] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:37.588614 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d76e4-07a8-4204-aebb-ee00e26bf4f0 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:37.594929 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 244/494] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:37.596826 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3522aa-1879-4e6d-93a7-9887ca7debf9 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:37.702139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3522aa-1879-4e6d-93a7-9887ca7debf9 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:37.703790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d76e4-07a8-4204-aebb-ee00e26bf4f0 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:37.742820 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcabc3a-0284-49ae-9e73-516a8ba5a6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:37.743454 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcabc3a-0284-49ae-9e73-516a8ba5a6a9 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:37.743738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcabc3a-0284-49ae-9e73-516a8ba5a6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:37.744022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcabc3a-0284-49ae-9e73-516a8ba5a6a9 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:37.744721 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcabc3a-0284-49ae-9e73-516a8ba5a6a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:37.745042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcabc3a-0284-49ae-9e73-516a8ba5a6a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:37.746515 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcabc3a-0284-49ae-9e73-516a8ba5a6a9 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:37.748507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9b239-f655-4952-8ff3-7df5a64311a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:37.749463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9b239-f655-4952-8ff3-7df5a64311a7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:37.749745 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9b239-f655-4952-8ff3-7df5a64311a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:37.750018 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9b239-f655-4952-8ff3-7df5a64311a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:37.753011 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:37.760422 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 245/495] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:37.761776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c35a1-8973-4c8e-9835-52ac11425688 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:37.762062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c35a1-8973-4c8e-9835-52ac11425688 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:37.762339 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c35a1-8973-4c8e-9835-52ac11425688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:37.770908 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9b239-f655-4952-8ff3-7df5a64311a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:37.776251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-c1d9b239-f655-4952-8ff3-7df5a64311a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:37.776251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:37.776251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:37.776251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:37.776251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:37.776251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:37.776251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:37.776251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:37.776251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:37.776251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:37.776251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:37.776251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:37.776251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:37.776251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:37.776251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:37.776251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:37.777191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:37.777191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:37.777191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:37.777191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:37.777191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:37.777191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:37.777191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:37.777191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:37.777191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:37.777191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:37.777191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:37.777191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:37.777191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:37.777191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:37.777191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:37.777191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:37.777959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:37.777959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:37.777959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:37.777959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:37.777959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:37.777959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:37.777959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:37.777959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:37.777959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:37.777959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:37.777959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:37.777959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:37.780787 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-bb7c35a1-8973-4c8e-9835-52ac11425688 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:37.782036 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-bb7c35a1-8973-4c8e-9835-52ac11425688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:37.782620 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 251/496] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:33:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:37.783245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9b239-f655-4952-8ff3-7df5a64311a7 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:37.818721 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:37.854431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 246/497] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:37.855287 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c35a1-8973-4c8e-9835-52ac11425688 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:37.890402 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9b239-f655-4952-8ff3-7df5a64311a7 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:37.929830 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215dde9-7657-4732-8c8f-6b1c8c1c4f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:37.930457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215dde9-7657-4732-8c8f-6b1c8c1c4f69 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:37.930854 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215dde9-7657-4732-8c8f-6b1c8c1c4f69 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:37.931126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215dde9-7657-4732-8c8f-6b1c8c1c4f69 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:37.941059 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215dde9-7657-4732-8c8f-6b1c8c1c4f69 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:37.942547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215dde9-7657-4732-8c8f-6b1c8c1c4f69 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:37.956205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c35a1-8973-4c8e-9835-52ac11425688 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:37.958101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-9215dde9-7657-4732-8c8f-6b1c8c1c4f69 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 10:33:37.958101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:37.958101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:37.958101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:37.958101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:37.958101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:37.958101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:37.958101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:37.958101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:37.958101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:37.958101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:37.958101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:37.958101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:33:37.958101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:33:37.958101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:33:37.958101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:33:37.958990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:37.958990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:37.958990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:33:37.958990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:37.958990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:33:37.958990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:37.958990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:37.958990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:37.958990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:37.958990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:37.958990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:37.958990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:37.958990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:37.958990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:37.958990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:37.958990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:37.958990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:37.958990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:37.959872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:37.959872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:37.959872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:33:37.959872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:33:37.959872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:33:37.959872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:33:37.959872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:33:37.959872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:33:37.959872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 10:33:37.959872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:37.959872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 252/498] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:37.960435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215dde9-7657-4732-8c8f-6b1c8c1c4f69 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:37.996946 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fd8ea-5641-4ef4-b261-e584d8faa78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:37.997487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fd8ea-5641-4ef4-b261-e584d8faa78d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:37.997768 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fd8ea-5641-4ef4-b261-e584d8faa78d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:37.998038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fd8ea-5641-4ef4-b261-e584d8faa78d None admin] PATH_INFO: `/v3/users/nova` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:38.005575 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fd8ea-5641-4ef4-b261-e584d8faa78d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:38.007017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fd8ea-5641-4ef4-b261-e584d8faa78d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:38.020420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-0c8fd8ea-5641-4ef4-b261-e584d8faa78d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 10:33:38.020420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:38.020420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:38.020420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:38.020420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:38.020420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:38.020420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:38.020420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:38.020420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:38.020420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:38.020420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:38.020420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:38.020420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:33:38.020420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:33:38.020420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:33:38.020420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:33:38.021485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:38.021485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:38.021485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:33:38.021485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:38.021485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:33:38.021485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:38.021485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:38.021485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:38.021485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:38.021485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:38.021485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:38.021485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:38.021485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:38.021485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:38.021485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:38.021485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:38.021485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:38.021485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:38.022374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:38.022374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:38.022374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:33:38.022374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:33:38.022374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:33:38.022374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:33:38.022374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:33:38.022374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:33:38.022374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 10:33:38.022374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:38.022374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 247/499] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Sep 11 10:33:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:38.022935 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db669d5-06f9-40ba-9b6e-f51fff12acbe None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:38.023000 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db669d5-06f9-40ba-9b6e-f51fff12acbe None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:38.023627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db669d5-06f9-40ba-9b6e-f51fff12acbe None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:38.024633 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 248/500] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:38.025155 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db669d5-06f9-40ba-9b6e-f51fff12acbe None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:38.032045 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:38.058613 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:38.083411 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215dde9-7657-4732-8c8f-6b1c8c1c4f69 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:38.118936 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dfbff-7909-416c-b642-c72c39833efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:38.119533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dfbff-7909-416c-b642-c72c39833efd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:38.119809 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dfbff-7909-416c-b642-c72c39833efd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:38.120078 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dfbff-7909-416c-b642-c72c39833efd None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:38.120762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dfbff-7909-416c-b642-c72c39833efd None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:38.121061 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dfbff-7909-416c-b642-c72c39833efd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:38.122416 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dfbff-7909-416c-b642-c72c39833efd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:38.130747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 253/501] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:33:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:38.132083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc8f8-ed0c-4214-9967-a36c97fd474c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:38.132359 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc8f8-ed0c-4214-9967-a36c97fd474c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:38.132662 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc8f8-ed0c-4214-9967-a36c97fd474c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:38.140151 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db669d5-06f9-40ba-9b6e-f51fff12acbe None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:38.150465 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c4bbc8f8-ed0c-4214-9967-a36c97fd474c None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:38.151654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c4bbc8f8-ed0c-4214-9967-a36c97fd474c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:38.174154 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddb8b0-868a-4563-b2a4-72ddc3221fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:38.174755 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddb8b0-868a-4563-b2a4-72ddc3221fab None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:38.175035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddb8b0-868a-4563-b2a4-72ddc3221fab None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:38.175304 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddb8b0-868a-4563-b2a4-72ddc3221fab None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:38.176016 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ddb8b0-868a-4563-b2a4-72ddc3221fab None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:38.176316 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ddb8b0-868a-4563-b2a4-72ddc3221fab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:38.177769 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ddb8b0-868a-4563-b2a4-72ddc3221fab None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:38.214892 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 249/502] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Sep 11 10:33:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:38.215738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddb8b0-868a-4563-b2a4-72ddc3221fab None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:38.225430 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 254/503] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:38.226272 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbc8f8-ed0c-4214-9967-a36c97fd474c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:38.274636 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:38.323905 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:38.334483 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddb8b0-868a-4563-b2a4-72ddc3221fab None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:38.334607 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbc8f8-ed0c-4214-9967-a36c97fd474c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:38.370454 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd930acf-9715-4bde-87a9-917483a40a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:38.371092 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377461c-59a3-463d-86a8-74e94a16c14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:38.371253 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd930acf-9715-4bde-87a9-917483a40a02 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:38.371587 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd930acf-9715-4bde-87a9-917483a40a02 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:38.371697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377461c-59a3-463d-86a8-74e94a16c14c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:38.371851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd930acf-9715-4bde-87a9-917483a40a02 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:38.372002 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377461c-59a3-463d-86a8-74e94a16c14c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:38.372249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377461c-59a3-463d-86a8-74e94a16c14c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:38.372661 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd930acf-9715-4bde-87a9-917483a40a02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:38.373027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd930acf-9715-4bde-87a9-917483a40a02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:38.374656 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd930acf-9715-4bde-87a9-917483a40a02 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:38.382701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377461c-59a3-463d-86a8-74e94a16c14c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:38.387656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-9377461c-59a3-463d-86a8-74e94a16c14c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:38.387656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:38.387656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:38.387656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:38.387656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:38.387656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:38.387656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:38.387656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:38.387656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:38.387656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:38.387656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:38.387656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:38.387656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:38.387656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:38.387656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:38.387656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:38.388491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:38.388491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:38.388491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:38.388491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:38.388491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:38.388491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:38.388491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:38.388491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:38.388491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:38.388491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:38.388491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:38.388491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:38.388491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:38.388491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:38.388491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:38.388491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:38.394710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:38.394710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:38.394710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:38.394710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:38.394710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:38.394710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:38.394710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:38.394710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:38.394710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:38.394710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:38.394710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:38.394710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:38.394710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 255/504] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:33:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:38.394710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377461c-59a3-463d-86a8-74e94a16c14c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:38.395463 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 250/505] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Sep 11 10:33:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:38.395463 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd930acf-9715-4bde-87a9-917483a40a02 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:38.498863 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377461c-59a3-463d-86a8-74e94a16c14c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:38.504929 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd930acf-9715-4bde-87a9-917483a40a02 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:38.506950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:38.535014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbecab3-81ee-40bf-81aa-1c1e74e1bd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:38.535558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbecab3-81ee-40bf-81aa-1c1e74e1bd0d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:38.535831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbecab3-81ee-40bf-81aa-1c1e74e1bd0d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:38.536099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbecab3-81ee-40bf-81aa-1c1e74e1bd0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:38.539300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ac9f1-3358-4a05-aa8a-39b5fff50ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:38.539897 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ac9f1-3358-4a05-aa8a-39b5fff50ddc None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:38.540174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ac9f1-3358-4a05-aa8a-39b5fff50ddc None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:38.540758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ac9f1-3358-4a05-aa8a-39b5fff50ddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:38.545828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbecab3-81ee-40bf-81aa-1c1e74e1bd0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:38.547292 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbecab3-81ee-40bf-81aa-1c1e74e1bd0d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:38.557948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:38.561833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-bcbecab3-81ee-40bf-81aa-1c1e74e1bd0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:38.561833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:38.561833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:38.561833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:38.561833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:38.561833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:38.561833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:38.561833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:38.561833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:38.561833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:38.561833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:38.561833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:38.561833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:38.561833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:38.561833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:38.561833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:38.562724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:38.562724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:38.562724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:38.562724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:38.562724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:38.562724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:38.562724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:38.562724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:38.562724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:38.562724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:38.562724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:38.562724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:38.562724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:38.562724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:38.562724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:38.562724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:38.562724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:38.563707 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:38.563707 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:38.563707 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:38.563707 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 256/506] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:38.563707 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbecab3-81ee-40bf-81aa-1c1e74e1bd0d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:38.612872 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ac9f1-3358-4a05-aa8a-39b5fff50ddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:38.614328 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ac9f1-3358-4a05-aa8a-39b5fff50ddc None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:38.663501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbecab3-81ee-40bf-81aa-1c1e74e1bd0d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:38.696648 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799130e3-d1ca-4f0e-9c3d-98a354d6aa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:38.697235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799130e3-d1ca-4f0e-9c3d-98a354d6aa6a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:38.697510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799130e3-d1ca-4f0e-9c3d-98a354d6aa6a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:38.697781 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799130e3-d1ca-4f0e-9c3d-98a354d6aa6a None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:38.698442 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799130e3-d1ca-4f0e-9c3d-98a354d6aa6a None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:38.698729 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799130e3-d1ca-4f0e-9c3d-98a354d6aa6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:38.700078 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799130e3-d1ca-4f0e-9c3d-98a354d6aa6a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:38.707807 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 257/507] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:33:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:38.712952 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799130e3-d1ca-4f0e-9c3d-98a354d6aa6a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:38.713600 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 251/508] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:38.713600 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ac9f1-3358-4a05-aa8a-39b5fff50ddc None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:38.738020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:38.763960 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:38.812956 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799130e3-d1ca-4f0e-9c3d-98a354d6aa6a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:38.813129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ac9f1-3358-4a05-aa8a-39b5fff50ddc None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:38.845234 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cfc1c-c058-4015-94b9-af4bcaef1b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:38.845851 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cfc1c-c058-4015-94b9-af4bcaef1b29 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:38.846002 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19105727-7f4b-424f-afa3-766a40368d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:38.846149 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cfc1c-c058-4015-94b9-af4bcaef1b29 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:38.846448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cfc1c-c058-4015-94b9-af4bcaef1b29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:38.846787 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19105727-7f4b-424f-afa3-766a40368d81 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:38.847047 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19105727-7f4b-424f-afa3-766a40368d81 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:38.847319 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19105727-7f4b-424f-afa3-766a40368d81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:38.857179 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19105727-7f4b-424f-afa3-766a40368d81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:38.858637 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19105727-7f4b-424f-afa3-766a40368d81 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:38.873487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-19105727-7f4b-424f-afa3-766a40368d81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:38.873487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:38.873487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:38.873487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:38.873487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:38.873487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:38.873487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:38.873487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:38.873487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:38.873487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:38.873487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:38.873487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:38.873487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:38.873487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:38.873487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:38.873487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:38.874449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:38.874449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:38.874449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:38.874449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:38.874449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:38.874449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:38.874449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:38.874449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:38.874449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:38.874449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:38.874449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:38.874449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:38.874449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:38.874449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:38.874449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:38.874449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:38.874449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:38.875264 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:38.875264 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:38.875264 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:38.875264 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 252/509] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:38.875483 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19105727-7f4b-424f-afa3-766a40368d81 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:38.920360 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cfc1c-c058-4015-94b9-af4bcaef1b29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:38.921854 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cfc1c-c058-4015-94b9-af4bcaef1b29 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:38.942140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:38.973495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:38.978565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19105727-7f4b-424f-afa3-766a40368d81 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:39.016400 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2eb6e-ab36-498b-8806-7641498d9a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:39.017033 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2eb6e-ab36-498b-8806-7641498d9a5a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:39.017317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2eb6e-ab36-498b-8806-7641498d9a5a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:39.017595 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2eb6e-ab36-498b-8806-7641498d9a5a None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:39.018822 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2eb6e-ab36-498b-8806-7641498d9a5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:39.019129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2eb6e-ab36-498b-8806-7641498d9a5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:39.020492 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2eb6e-ab36-498b-8806-7641498d9a5a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:39.032034 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 253/510] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:39.037134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2eb6e-ab36-498b-8806-7641498d9a5a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:39.037286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 258/511] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:39.037286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cfc1c-c058-4015-94b9-af4bcaef1b29 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:39.131915 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cfc1c-c058-4015-94b9-af4bcaef1b29 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:39.132385 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2eb6e-ab36-498b-8806-7641498d9a5a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:39.152780 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:39.165557 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb043599-0379-40bc-946c-d6ef2884a82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:39.166183 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb043599-0379-40bc-946c-d6ef2884a82e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:39.166464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb043599-0379-40bc-946c-d6ef2884a82e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:39.166552 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e48e2-def1-4bab-aa97-4e381bca50a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:39.166738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb043599-0379-40bc-946c-d6ef2884a82e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:39.167133 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e48e2-def1-4bab-aa97-4e381bca50a8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:39.167410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e48e2-def1-4bab-aa97-4e381bca50a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:39.167679 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e48e2-def1-4bab-aa97-4e381bca50a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:39.176749 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb043599-0379-40bc-946c-d6ef2884a82e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:39.177387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e48e2-def1-4bab-aa97-4e381bca50a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:39.178212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb043599-0379-40bc-946c-d6ef2884a82e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:39.178804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e48e2-def1-4bab-aa97-4e381bca50a8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:39.193050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-eb043599-0379-40bc-946c-d6ef2884a82e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:39.193050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:39.193050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:39.193050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:39.193050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:39.193050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:39.193050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:39.193050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:39.193050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:39.193050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:39.193050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:39.193050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:39.193050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:39.193050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:39.193050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:39.193050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:39.193995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:39.193995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:39.193995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:39.193995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:39.193995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:39.193995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:39.193995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:39.193995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:39.193995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:39.193995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:39.193995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:39.193995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:39.193995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:39.193995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:39.193995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:39.193995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:39.193995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:39.194835 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:39.194835 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:39.194835 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:39.195003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-3e2e48e2-def1-4bab-aa97-4e381bca50a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:39.195003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:39.195003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:39.195003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:39.195003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:39.195003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:39.195003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:39.195003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:39.195003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:39.195003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:39.195003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:39.195003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:39.195003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:39.195003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:39.195003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:39.195003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:39.195774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:39.195774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:39.195774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:39.195774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:39.195774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:39.195774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:39.195774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:39.195774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:39.195774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:39.195774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:39.195774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:39.195774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:39.195774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:39.195774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:39.195774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:39.195774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:39.195774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:39.196712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:39.196712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:39.196712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:39.196868 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 254/512] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:39.196932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 259/513] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:39.196932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e48e2-def1-4bab-aa97-4e381bca50a8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:39.197653 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb043599-0379-40bc-946c-d6ef2884a82e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:39.212529 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:39.296564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e48e2-def1-4bab-aa97-4e381bca50a8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:39.301813 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb043599-0379-40bc-946c-d6ef2884a82e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:39.332133 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c48cf2-78ac-42a8-968c-f96aaee3239c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:39.332765 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c48cf2-78ac-42a8-968c-f96aaee3239c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:39.333045 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c48cf2-78ac-42a8-968c-f96aaee3239c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:39.333315 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c48cf2-78ac-42a8-968c-f96aaee3239c None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:39.333954 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c48cf2-78ac-42a8-968c-f96aaee3239c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:39.334254 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c48cf2-78ac-42a8-968c-f96aaee3239c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:39.335622 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c48cf2-78ac-42a8-968c-f96aaee3239c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:39.336670 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446b80e-24c8-4aaf-a8c1-294096721552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:39.337298 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446b80e-24c8-4aaf-a8c1-294096721552 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:39.337575 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446b80e-24c8-4aaf-a8c1-294096721552 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:39.337852 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446b80e-24c8-4aaf-a8c1-294096721552 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:39.345289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446b80e-24c8-4aaf-a8c1-294096721552 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:39.347615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446b80e-24c8-4aaf-a8c1-294096721552 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:39.348886 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 260/514] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:39.349692 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c48cf2-78ac-42a8-968c-f96aaee3239c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:39.363982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-e446b80e-24c8-4aaf-a8c1-294096721552 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 10:33:39.363982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:39.363982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:39.363982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:39.363982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:39.363982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:39.363982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:39.363982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:39.363982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:39.363982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:39.363982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:39.363982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:39.363982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:33:39.363982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:33:39.363982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:33:39.363982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:33:39.365055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:39.365055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:39.365055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:33:39.365055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:39.365055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:33:39.365055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:39.365055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:39.365055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:39.365055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:39.365055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:39.365055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:39.365055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:39.365055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:39.365055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:39.365055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:39.365055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:39.365055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:39.365055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:39.365934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:39.365934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:39.365934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:33:39.365934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:33:39.365934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:33:39.365934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:33:39.365934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:33:39.365934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:33:39.365934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 10:33:39.365934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:39.365934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 255/515] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:33:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:39.366472 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446b80e-24c8-4aaf-a8c1-294096721552 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:39.383872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:39.434898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:39.450883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c48cf2-78ac-42a8-968c-f96aaee3239c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:39.465137 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446b80e-24c8-4aaf-a8c1-294096721552 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:39.486667 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb896e3c-1b91-4f7d-b6d4-b5a9fe2b6ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:39.487280 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb896e3c-1b91-4f7d-b6d4-b5a9fe2b6ad6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:39.487553 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb896e3c-1b91-4f7d-b6d4-b5a9fe2b6ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:39.487820 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb896e3c-1b91-4f7d-b6d4-b5a9fe2b6ad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:39.497430 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb896e3c-1b91-4f7d-b6d4-b5a9fe2b6ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:39.498202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67f646-5698-44c4-9b0b-69032706e802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:39.498803 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67f646-5698-44c4-9b0b-69032706e802 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:39.499086 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67f646-5698-44c4-9b0b-69032706e802 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:39.499190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb896e3c-1b91-4f7d-b6d4-b5a9fe2b6ad6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:39.499364 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67f646-5698-44c4-9b0b-69032706e802 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:39.500009 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67f646-5698-44c4-9b0b-69032706e802 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:39.500315 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67f646-5698-44c4-9b0b-69032706e802 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:39.501709 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67f646-5698-44c4-9b0b-69032706e802 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:39.513065 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 256/516] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:39.513426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-cb896e3c-1b91-4f7d-b6d4-b5a9fe2b6ad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:39.513426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:39.513426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:39.513426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:39.513426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:39.513426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:39.513426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:39.513426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:39.513426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:39.513426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:39.513426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:39.513426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:39.513426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:39.513426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:39.513426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:39.513426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:39.514267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:39.514267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:39.514267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:39.514267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:39.514267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:39.514267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:39.514267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:39.514267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:39.514267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:39.514267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:39.514267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:39.514267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:39.514267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:39.514267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:39.514267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:39.514267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:39.514267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:39.515119 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:39.515119 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:39.515119 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:39.515279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67f646-5698-44c4-9b0b-69032706e802 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:39.515353 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 261/517] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:39.515884 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb896e3c-1b91-4f7d-b6d4-b5a9fe2b6ad6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:39.599858 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:39.613298 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67f646-5698-44c4-9b0b-69032706e802 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:39.616088 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb896e3c-1b91-4f7d-b6d4-b5a9fe2b6ad6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:39.641651 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:39.648289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd968d8-247c-4993-9f17-2c2e995375a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:39.649013 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd968d8-247c-4993-9f17-2c2e995375a0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:39.649217 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4bd52-89ba-4088-a742-106c2df054ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:39.649331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd968d8-247c-4993-9f17-2c2e995375a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:39.649604 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd968d8-247c-4993-9f17-2c2e995375a0 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:39.649816 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4bd52-89ba-4088-a742-106c2df054ac None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:39.650096 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4bd52-89ba-4088-a742-106c2df054ac None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:39.650288 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd968d8-247c-4993-9f17-2c2e995375a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:39.650372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4bd52-89ba-4088-a742-106c2df054ac None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:39.650597 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd968d8-247c-4993-9f17-2c2e995375a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:39.651000 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4bd52-89ba-4088-a742-106c2df054ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:39.652770 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4bd52-89ba-4088-a742-106c2df054ac None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:39.652897 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd968d8-247c-4993-9f17-2c2e995375a0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:39.669424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 257/518] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:39.670287 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd968d8-247c-4993-9f17-2c2e995375a0 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:39.687006 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 262/519] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 10:33:39 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:33:39.687006 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4bd52-89ba-4088-a742-106c2df054ac None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:39.797190 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd968d8-247c-4993-9f17-2c2e995375a0 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:39.804264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4bd52-89ba-4088-a742-106c2df054ac None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:39.834346 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a5dc4-2271-467d-b3ee-3f13a6d4c989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:39.834969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a5dc4-2271-467d-b3ee-3f13a6d4c989 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:39.835251 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a5dc4-2271-467d-b3ee-3f13a6d4c989 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:39.835526 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a5dc4-2271-467d-b3ee-3f13a6d4c989 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:39.836262 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a5dc4-2271-467d-b3ee-3f13a6d4c989 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:39.836594 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a5dc4-2271-467d-b3ee-3f13a6d4c989 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:39.838037 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a5dc4-2271-467d-b3ee-3f13a6d4c989 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:39.844055 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17242f3e-100c-40f5-b823-b0fb4ebdafbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:39.844815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17242f3e-100c-40f5-b823-b0fb4ebdafbb None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:39.845161 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17242f3e-100c-40f5-b823-b0fb4ebdafbb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:39.845545 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17242f3e-100c-40f5-b823-b0fb4ebdafbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:39.854648 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17242f3e-100c-40f5-b823-b0fb4ebdafbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:39.856113 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17242f3e-100c-40f5-b823-b0fb4ebdafbb None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:39.858835 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 258/520] 10.222.0.20 () {56 vars in 1139 bytes} [Sun Sep 11 10:33:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:39.859315 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a5dc4-2271-467d-b3ee-3f13a6d4c989 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:39.864331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:39.873558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-17242f3e-100c-40f5-b823-b0fb4ebdafbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:39.873558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:39.873558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:39.873558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:39.873558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:39.873558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:39.873558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:39.873558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:39.873558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:39.873558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:39.873558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:39.873558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:39.873558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:33:39.873558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:33:39.873558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:33:39.874483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:33:39.874483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:39.874483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:39.874483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:39.874483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:39.874483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:39.874483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:39.874483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:39.874483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:39.874483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:39.874483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:39.874483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:39.874483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:39.874483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:39.874483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:39.874483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:39.874483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:39.875326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:33:39.875326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:33:39.875326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:33:39.875326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:33:39.875326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:33:39.875326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:33:39.875326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:39.875326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:39.875326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 263/521] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:39.876507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17242f3e-100c-40f5-b823-b0fb4ebdafbb None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:39.930009 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:39.985627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a5dc4-2271-467d-b3ee-3f13a6d4c989 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:39.995772 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17242f3e-100c-40f5-b823-b0fb4ebdafbb None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:40.022688 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8ae3d-b0e3-483f-a04b-604da5bb9abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:40.023295 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8ae3d-b0e3-483f-a04b-604da5bb9abc None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:40.023573 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8ae3d-b0e3-483f-a04b-604da5bb9abc None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:40.023909 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8ae3d-b0e3-483f-a04b-604da5bb9abc None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:40.024474 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8ae3d-b0e3-483f-a04b-604da5bb9abc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:40.024805 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8ae3d-b0e3-483f-a04b-604da5bb9abc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:40.026386 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8ae3d-b0e3-483f-a04b-604da5bb9abc None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:40.031082 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407650dd-7be5-40b9-81e0-3b568ef5b469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:40.031719 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407650dd-7be5-40b9-81e0-3b568ef5b469 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:40.032000 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407650dd-7be5-40b9-81e0-3b568ef5b469 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:40.032273 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407650dd-7be5-40b9-81e0-3b568ef5b469 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:40.038577 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 259/522] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:40.039237 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8ae3d-b0e3-483f-a04b-604da5bb9abc None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:40.045136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407650dd-7be5-40b9-81e0-3b568ef5b469 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:40.046591 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407650dd-7be5-40b9-81e0-3b568ef5b469 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:40.058049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-407650dd-7be5-40b9-81e0-3b568ef5b469 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 10:33:40.058049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:40.058049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:40.058049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:40.058049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:40.058049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:40.058049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:40.058049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:40.058049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:40.058049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:40.058049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:40.058049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:40.058049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:33:40.058049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:33:40.058049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:33:40.058049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:33:40.058974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:40.058974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:40.058974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:33:40.058974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:40.058974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:33:40.058974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:40.058974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:40.058974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:40.058974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:40.058974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:40.058974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:40.058974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:40.058974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:40.058974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:40.058974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:40.058974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:40.058974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:40.058974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:40.059883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:40.059883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:40.059883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:33:40.059883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:33:40.059883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:33:40.059883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:33:40.059883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:33:40.059883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:33:40.059883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 10:33:40.059883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:40.059883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 264/523] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:40.060431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407650dd-7be5-40b9-81e0-3b568ef5b469 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:40.125352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:40.148705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8ae3d-b0e3-483f-a04b-604da5bb9abc None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:40.160263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:40.173740 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407650dd-7be5-40b9-81e0-3b568ef5b469 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:40.188643 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283acc2-ed6d-4091-a728-cfe3d55b4fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:40.191644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283acc2-ed6d-4091-a728-cfe3d55b4fbf None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:40.191644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283acc2-ed6d-4091-a728-cfe3d55b4fbf None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:40.191644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283acc2-ed6d-4091-a728-cfe3d55b4fbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:40.215175 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449b45a-e225-4e3d-97c9-da80d9c60d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:40.215926 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449b45a-e225-4e3d-97c9-da80d9c60d4e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:40.216299 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449b45a-e225-4e3d-97c9-da80d9c60d4e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:40.216737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449b45a-e225-4e3d-97c9-da80d9c60d4e None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:40.217447 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449b45a-e225-4e3d-97c9-da80d9c60d4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:40.217839 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449b45a-e225-4e3d-97c9-da80d9c60d4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:40.219371 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449b45a-e225-4e3d-97c9-da80d9c60d4e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:40.240456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 265/524] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:33:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:40.246522 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449b45a-e225-4e3d-97c9-da80d9c60d4e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:40.269987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283acc2-ed6d-4091-a728-cfe3d55b4fbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:40.271713 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283acc2-ed6d-4091-a728-cfe3d55b4fbf None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:40.351542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449b45a-e225-4e3d-97c9-da80d9c60d4e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:40.372589 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:40.381901 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 260/525] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:40.382729 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283acc2-ed6d-4091-a728-cfe3d55b4fbf None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:40.393115 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3a170-a6a5-4a16-8724-8c24ef2556be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:40.393943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:40.394758 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3a170-a6a5-4a16-8724-8c24ef2556be None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:40.395127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3a170-a6a5-4a16-8724-8c24ef2556be None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:40.395511 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3a170-a6a5-4a16-8724-8c24ef2556be None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:40.403035 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3a170-a6a5-4a16-8724-8c24ef2556be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:40.404482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3a170-a6a5-4a16-8724-8c24ef2556be None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:40.416570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-deb3a170-a6a5-4a16-8724-8c24ef2556be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:40.416570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:40.416570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:40.416570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:40.416570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:40.416570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:40.416570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:40.416570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:40.416570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:40.416570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:40.416570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:40.416570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:40.416570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:33:40.416570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:33:40.416570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:33:40.417435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:33:40.417435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:40.417435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:40.417435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:40.417435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:40.417435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:40.417435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:40.417435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:40.417435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:40.417435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:40.417435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:40.417435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:40.417435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:40.417435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:40.417435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:40.417435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:40.417435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:40.418278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:33:40.418278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:33:40.418278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:33:40.418278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:33:40.418278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:33:40.418278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:33:40.418278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:40.418278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:40.418278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 266/526] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:40.418725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3a170-a6a5-4a16-8724-8c24ef2556be None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:40.492493 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283acc2-ed6d-4091-a728-cfe3d55b4fbf None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:40.524413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3a170-a6a5-4a16-8724-8c24ef2556be None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:40.527841 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0882e-738a-446f-bcf0-d09118a073ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:40.528517 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0882e-738a-446f-bcf0-d09118a073ae None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:40.528887 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0882e-738a-446f-bcf0-d09118a073ae None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:40.529232 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0882e-738a-446f-bcf0-d09118a073ae None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:40.530021 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a0882e-738a-446f-bcf0-d09118a073ae None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:40.530395 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a0882e-738a-446f-bcf0-d09118a073ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:40.531881 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a0882e-738a-446f-bcf0-d09118a073ae None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:40.549983 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 261/527] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Sep 11 10:33:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:40.550847 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0882e-738a-446f-bcf0-d09118a073ae None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:40.566490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8503a97-e56a-4cf1-91a5-fca0d7c9f5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:40.567298 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8503a97-e56a-4cf1-91a5-fca0d7c9f5a0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:40.567750 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8503a97-e56a-4cf1-91a5-fca0d7c9f5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:40.568169 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8503a97-e56a-4cf1-91a5-fca0d7c9f5a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:40.568933 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8503a97-e56a-4cf1-91a5-fca0d7c9f5a0 None admin] RBAC: Adding query filter params (role.id=295de8f316124ccdac36a50e50531148, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=28614526d50d4201b93b20df45465d32) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:40.569246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8503a97-e56a-4cf1-91a5-fca0d7c9f5a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:40.570686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8503a97-e56a-4cf1-91a5-fca0d7c9f5a0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:40.584942 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 267/528] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:33:40 2022] GET /identity/v3/role_assignments?user.id=28614526d50d4201b93b20df45465d32&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=295de8f316124ccdac36a50e50531148 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:40.585769 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8503a97-e56a-4cf1-91a5-fca0d7c9f5a0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:40.628995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:40.663228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:40.667966 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0882e-738a-446f-bcf0-d09118a073ae None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:40.708169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277395d7-7dc0-477c-83ea-ddbca5f9b5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:40.708872 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277395d7-7dc0-477c-83ea-ddbca5f9b5d7 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:40.709149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277395d7-7dc0-477c-83ea-ddbca5f9b5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:40.709420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277395d7-7dc0-477c-83ea-ddbca5f9b5d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:40.720850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277395d7-7dc0-477c-83ea-ddbca5f9b5d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:40.723105 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277395d7-7dc0-477c-83ea-ddbca5f9b5d7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:40.739300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-277395d7-7dc0-477c-83ea-ddbca5f9b5d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:40.739300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:40.739300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:40.739300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:40.739300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:40.739300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:40.739300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:40.739300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:40.739300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:40.739300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:40.739300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:40.739300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:40.739300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:40.739300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:40.739300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:40.739300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:40.740286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:40.740286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:40.740286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:40.740286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:40.740286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:40.740286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:40.740286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:40.740286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:40.740286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:40.740286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:40.740286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:40.740286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:40.740286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:40.740286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:40.740286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:40.740286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:40.740286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:40.741163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:40.741163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:40.741163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:40.745038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 262/529] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:40.745917 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277395d7-7dc0-477c-83ea-ddbca5f9b5d7 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:40.751774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8503a97-e56a-4cf1-91a5-fca0d7c9f5a0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:40.791288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4aa7c0-cf99-4ece-bffa-985cc1026529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:40.791997 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4aa7c0-cf99-4ece-bffa-985cc1026529 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:40.792272 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4aa7c0-cf99-4ece-bffa-985cc1026529 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:40.792681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4aa7c0-cf99-4ece-bffa-985cc1026529 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:40.793372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4aa7c0-cf99-4ece-bffa-985cc1026529 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:40.793670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4aa7c0-cf99-4ece-bffa-985cc1026529 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:40.795190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4aa7c0-cf99-4ece-bffa-985cc1026529 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:40.813317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 268/530] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:33:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:40.813317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4aa7c0-cf99-4ece-bffa-985cc1026529 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:40.886840 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277395d7-7dc0-477c-83ea-ddbca5f9b5d7 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:40.908126 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:40.924313 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31289e00-2e5a-4f9e-bd73-7a0081c368f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:40.925293 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31289e00-2e5a-4f9e-bd73-7a0081c368f8 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:40.925770 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31289e00-2e5a-4f9e-bd73-7a0081c368f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:40.926263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31289e00-2e5a-4f9e-bd73-7a0081c368f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:40.936689 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4aa7c0-cf99-4ece-bffa-985cc1026529 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:40.939488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:40.979849 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b15a8b-a38a-44af-b01a-30892d13c57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:40.980597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b15a8b-a38a-44af-b01a-30892d13c57b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:40.981101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b15a8b-a38a-44af-b01a-30892d13c57b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:40.981377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b15a8b-a38a-44af-b01a-30892d13c57b None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:40.982284 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b15a8b-a38a-44af-b01a-30892d13c57b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:40.982457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b15a8b-a38a-44af-b01a-30892d13c57b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:40.983766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b15a8b-a38a-44af-b01a-30892d13c57b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:41.002176 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 269/531] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:41.002979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31289e00-2e5a-4f9e-bd73-7a0081c368f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:41.003141 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b15a8b-a38a-44af-b01a-30892d13c57b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:41.006477 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31289e00-2e5a-4f9e-bd73-7a0081c368f8 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:41.116996 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 263/532] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:41.118226 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31289e00-2e5a-4f9e-bd73-7a0081c368f8 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:41.122761 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b15a8b-a38a-44af-b01a-30892d13c57b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:41.144984 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:41.159759 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b91f8-0f41-4a33-bf64-ccdcfe370443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:41.160363 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b91f8-0f41-4a33-bf64-ccdcfe370443 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:41.160667 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b91f8-0f41-4a33-bf64-ccdcfe370443 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:41.160939 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b91f8-0f41-4a33-bf64-ccdcfe370443 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:41.161660 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b91f8-0f41-4a33-bf64-ccdcfe370443 None admin] RBAC: Adding query filter params (role.id=295de8f316124ccdac36a50e50531148, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=b642a1d00de940429fc1cc6131ac22b1) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:41.161965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b91f8-0f41-4a33-bf64-ccdcfe370443 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:41.163382 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b91f8-0f41-4a33-bf64-ccdcfe370443 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:41.176676 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 270/533] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:33:41 2022] GET /identity/v3/role_assignments?user.id=b642a1d00de940429fc1cc6131ac22b1&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=295de8f316124ccdac36a50e50531148 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:41.176676 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b91f8-0f41-4a33-bf64-ccdcfe370443 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:41.247565 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:41.288589 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31289e00-2e5a-4f9e-bd73-7a0081c368f8 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:41.375948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3dfb45-3178-45bb-94ff-e6a6380052f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:41.376980 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dfb45-3178-45bb-94ff-e6a6380052f9 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:41.378046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dfb45-3178-45bb-94ff-e6a6380052f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:41.379518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dfb45-3178-45bb-94ff-e6a6380052f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:41.389518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3dfb45-3178-45bb-94ff-e6a6380052f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:41.391661 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3dfb45-3178-45bb-94ff-e6a6380052f9 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:41.395038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b91f8-0f41-4a33-bf64-ccdcfe370443 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:41.404938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-fb3dfb45-3178-45bb-94ff-e6a6380052f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:41.404938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:41.404938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:41.404938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:41.404938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:41.404938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:41.404938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:41.404938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:41.404938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:41.404938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:41.404938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:41.404938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:41.404938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:33:41.404938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:33:41.404938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:33:41.405809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:33:41.405809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:41.405809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:41.405809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:41.405809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:41.405809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:41.405809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:41.405809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:41.405809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:41.405809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:41.405809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:41.405809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:41.405809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:41.405809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:41.405809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:41.405809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:41.405809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:41.406639 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:33:41.406639 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:33:41.406639 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:33:41.406639 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:33:41.406639 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:33:41.406639 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:33:41.406639 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:41.406639 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:41.409571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 264/534] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:41.418343 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3dfb45-3178-45bb-94ff-e6a6380052f9 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:41.450627 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea136e4a-6e96-44ad-87fe-c21929e4ca0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:41.451260 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea136e4a-6e96-44ad-87fe-c21929e4ca0b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:41.451533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea136e4a-6e96-44ad-87fe-c21929e4ca0b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:41.451798 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea136e4a-6e96-44ad-87fe-c21929e4ca0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:41.473510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea136e4a-6e96-44ad-87fe-c21929e4ca0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:41.474965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea136e4a-6e96-44ad-87fe-c21929e4ca0b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:41.504194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ea136e4a-6e96-44ad-87fe-c21929e4ca0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:41.504194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:41.504194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:41.504194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:41.504194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:41.504194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:41.504194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:41.504194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:41.504194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:41.504194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:41.504194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:41.504194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:41.504194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:41.504194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:41.504194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:41.504194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:41.505201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:41.505201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:41.505201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:41.505201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:41.505201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:41.505201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:41.505201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:41.505201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:41.505201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:41.505201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:41.505201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:41.505201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:41.505201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:41.505201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:41.505201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:41.505201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:41.505201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:41.506017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:41.506017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:41.506017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:41.506017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 271/535] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:41.516044 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea136e4a-6e96-44ad-87fe-c21929e4ca0b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:41.578312 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:41.618820 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3dfb45-3178-45bb-94ff-e6a6380052f9 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:41.681961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:41.691051 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d9c87-0848-459f-986f-b1c716a9e0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:41.695032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d9c87-0848-459f-986f-b1c716a9e0d8 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:41.695471 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d9c87-0848-459f-986f-b1c716a9e0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:41.695880 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d9c87-0848-459f-986f-b1c716a9e0d8 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:41.696746 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d9c87-0848-459f-986f-b1c716a9e0d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:41.697214 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d9c87-0848-459f-986f-b1c716a9e0d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:41.699001 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d9c87-0848-459f-986f-b1c716a9e0d8 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:41.723123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 265/536] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:41.727059 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d9c87-0848-459f-986f-b1c716a9e0d8 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:41.732984 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea136e4a-6e96-44ad-87fe-c21929e4ca0b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:41.786567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c238f-88c5-4de8-afc8-84b69e707f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:41.787195 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c238f-88c5-4de8-afc8-84b69e707f54 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:41.787472 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c238f-88c5-4de8-afc8-84b69e707f54 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:41.787741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c238f-88c5-4de8-afc8-84b69e707f54 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:41.788411 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c238f-88c5-4de8-afc8-84b69e707f54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:41.788739 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c238f-88c5-4de8-afc8-84b69e707f54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:41.790173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c238f-88c5-4de8-afc8-84b69e707f54 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:41.821125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 272/537] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:41.825554 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c238f-88c5-4de8-afc8-84b69e707f54 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:41.907506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d9c87-0848-459f-986f-b1c716a9e0d8 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:41.952352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d702b-fa8b-40c5-b33a-7d1883eabfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:41.952990 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d702b-fa8b-40c5-b33a-7d1883eabfa6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:41.953267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d702b-fa8b-40c5-b33a-7d1883eabfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:41.953542 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d702b-fa8b-40c5-b33a-7d1883eabfa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:41.954267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d702b-fa8b-40c5-b33a-7d1883eabfa6 None admin] RBAC: Adding query filter params (role.id=295de8f316124ccdac36a50e50531148, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=133c5864d9544973a30ff77866522f15) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:41.954571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d702b-fa8b-40c5-b33a-7d1883eabfa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:41.956929 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d702b-fa8b-40c5-b33a-7d1883eabfa6 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:41.965420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 266/538] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:33:41 2022] GET /identity/v3/role_assignments?user.id=133c5864d9544973a30ff77866522f15&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=295de8f316124ccdac36a50e50531148 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:41.966711 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4d291-26c6-47b7-85ee-e4a7114b78b1 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:41.966997 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4d291-26c6-47b7-85ee-e4a7114b78b1 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:41.967274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4d291-26c6-47b7-85ee-e4a7114b78b1 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:41.973880 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 267/539] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:41.975665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f6e82-3eef-40fa-a78b-b99e26e41bc1 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:41.976015 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f6e82-3eef-40fa-a78b-b99e26e41bc1 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:41.976141 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c238f-88c5-4de8-afc8-84b69e707f54 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:41.976291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f6e82-3eef-40fa-a78b-b99e26e41bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:41.986107 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:41.998655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e67f6e82-3eef-40fa-a78b-b99e26e41bc1 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:42.000513 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e67f6e82-3eef-40fa-a78b-b99e26e41bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:42.061284 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c57d30-223e-4026-8ae9-da051dd51c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:42.061939 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c57d30-223e-4026-8ae9-da051dd51c5e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:42.062216 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c57d30-223e-4026-8ae9-da051dd51c5e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:42.062480 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c57d30-223e-4026-8ae9-da051dd51c5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:42.075620 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c57d30-223e-4026-8ae9-da051dd51c5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:42.077136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c57d30-223e-4026-8ae9-da051dd51c5e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:42.088930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:42.101233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-15c57d30-223e-4026-8ae9-da051dd51c5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:42.101233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:42.101233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:42.101233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:42.101233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:42.101233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:42.101233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:42.101233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:42.101233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:42.101233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:42.101233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:42.101233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:42.101233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:33:42.101233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:33:42.101233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:33:42.103258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:33:42.103258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:42.103258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:42.103258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:42.103258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:42.103258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:42.103258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:42.103258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:42.103258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:42.103258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:42.103258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:42.103258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:42.103258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:42.103258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:42.103258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:42.103258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:42.103258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:42.104738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:33:42.104738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:33:42.104738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:33:42.104738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:33:42.104738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:33:42.104738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:33:42.104738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:42.104738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:42.104738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 273/540] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:42.113879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c57d30-223e-4026-8ae9-da051dd51c5e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:42.123918 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 268/541] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:33:42.247025 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c57d30-223e-4026-8ae9-da051dd51c5e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:42.281821 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300c318-82a5-4f3a-92cf-9d78d4d22837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:42.282415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300c318-82a5-4f3a-92cf-9d78d4d22837 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:42.282690 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300c318-82a5-4f3a-92cf-9d78d4d22837 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:42.282958 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300c318-82a5-4f3a-92cf-9d78d4d22837 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:42.283748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300c318-82a5-4f3a-92cf-9d78d4d22837 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:42.284216 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300c318-82a5-4f3a-92cf-9d78d4d22837 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:42.285680 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300c318-82a5-4f3a-92cf-9d78d4d22837 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:42.298322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 274/542] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:33:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:42.304697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f6e82-3eef-40fa-a78b-b99e26e41bc1 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:42.438352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f6e82-3eef-40fa-a78b-b99e26e41bc1 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:42.464382 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300c318-82a5-4f3a-92cf-9d78d4d22837 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:42.498462 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432102b-30ca-4854-ab9d-6bd85d464148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:42.498992 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432102b-30ca-4854-ab9d-6bd85d464148 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:42.499270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432102b-30ca-4854-ab9d-6bd85d464148 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:42.499539 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432102b-30ca-4854-ab9d-6bd85d464148 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:42.500266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432102b-30ca-4854-ab9d-6bd85d464148 None admin] RBAC: Adding query filter params (role.id=295de8f316124ccdac36a50e50531148, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=caa0d9fe3d4942be8901876e57d1e561) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:42.500830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432102b-30ca-4854-ab9d-6bd85d464148 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:42.503524 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432102b-30ca-4854-ab9d-6bd85d464148 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:42.506154 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:42.520984 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 269/543] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:33:42 2022] GET /identity/v3/role_assignments?user.id=caa0d9fe3d4942be8901876e57d1e561&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=295de8f316124ccdac36a50e50531148 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:42.577011 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:42.629036 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300c318-82a5-4f3a-92cf-9d78d4d22837 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:42.673198 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd48f0e-9237-4fd7-ad3c-ba6b8089a85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:42.673839 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd48f0e-9237-4fd7-ad3c-ba6b8089a85d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:42.674155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd48f0e-9237-4fd7-ad3c-ba6b8089a85d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:42.674422 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd48f0e-9237-4fd7-ad3c-ba6b8089a85d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:42.688017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd48f0e-9237-4fd7-ad3c-ba6b8089a85d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:42.693613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-acd48f0e-9237-4fd7-ad3c-ba6b8089a85d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:42.693613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:42.693613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:42.693613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:42.693613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:42.693613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:42.693613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:42.693613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:42.693613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:42.693613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:42.693613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:42.693613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:42.693613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:42.693613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:42.693613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:42.693613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:42.695687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:42.695687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:42.695687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:42.695687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:42.695687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:42.695687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:42.695687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:42.695687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:42.695687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:42.695687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:42.695687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:42.695687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:42.695687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:42.695687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:42.695687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:42.695687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:42.697610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:42.697610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:42.697610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:42.697610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:42.697610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:42.697610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:42.697610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:42.697610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:42.697610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:42.697610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:42.697610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:42.697610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:42.697610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 275/544] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:33:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:33:42.701184 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432102b-30ca-4854-ab9d-6bd85d464148 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:42.815920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432102b-30ca-4854-ab9d-6bd85d464148 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:42.854820 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8690137-7875-4e0b-b9b6-9ff07160fc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:42.855435 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8690137-7875-4e0b-b9b6-9ff07160fc66 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:42.855758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8690137-7875-4e0b-b9b6-9ff07160fc66 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:42.856032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8690137-7875-4e0b-b9b6-9ff07160fc66 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:42.856727 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8690137-7875-4e0b-b9b6-9ff07160fc66 None admin] RBAC: Adding query filter params (name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:42.857027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8690137-7875-4e0b-b9b6-9ff07160fc66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:42.858493 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8690137-7875-4e0b-b9b6-9ff07160fc66 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:42.867338 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 270/545] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:33:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:42.873586 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd48f0e-9237-4fd7-ad3c-ba6b8089a85d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:42.994655 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd48f0e-9237-4fd7-ad3c-ba6b8089a85d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:43.020934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:43.036131 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5248bd-81db-4c4d-a228-45cbc9e2faf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:43.036819 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5248bd-81db-4c4d-a228-45cbc9e2faf6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:43.037096 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5248bd-81db-4c4d-a228-45cbc9e2faf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:43.037415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5248bd-81db-4c4d-a228-45cbc9e2faf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:43.053663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5248bd-81db-4c4d-a228-45cbc9e2faf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:43.055173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5248bd-81db-4c4d-a228-45cbc9e2faf6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:43.078264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-db5248bd-81db-4c4d-a228-45cbc9e2faf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:43.078264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:43.078264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:43.078264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:43.078264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:43.078264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:43.078264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:43.078264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:43.078264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:43.078264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:43.078264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:43.078264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:43.078264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:43.078264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:43.078264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:43.078264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:43.080456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:43.080456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:43.080456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:43.080456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:43.080456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:43.080456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:43.080456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:43.080456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:43.080456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:43.080456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:43.080456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:43.080456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:43.080456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:43.080456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:43.080456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:43.080456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:43.080456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:43.082582 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:43.082582 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:43.082582 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:43.082582 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 276/546] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:43.086086 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8690137-7875-4e0b-b9b6-9ff07160fc66 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:43.183300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:43.236168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8690137-7875-4e0b-b9b6-9ff07160fc66 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:43.266884 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3198d-0be2-4150-9ba3-30722c158b7b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:43.267185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3198d-0be2-4150-9ba3-30722c158b7b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:43.267429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3198d-0be2-4150-9ba3-30722c158b7b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:43.270522 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 277/547] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:43.274459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88558528-fe92-455e-9466-92a686530f80 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:43.274733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88558528-fe92-455e-9466-92a686530f80 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:43.275004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88558528-fe92-455e-9466-92a686530f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:43.287118 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edf2d9-a199-4618-b063-8b0d7eadd335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:43.288041 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edf2d9-a199-4618-b063-8b0d7eadd335 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:43.288521 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edf2d9-a199-4618-b063-8b0d7eadd335 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:43.289121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edf2d9-a199-4618-b063-8b0d7eadd335 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:43.289971 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edf2d9-a199-4618-b063-8b0d7eadd335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:43.290483 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edf2d9-a199-4618-b063-8b0d7eadd335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:43.292057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edf2d9-a199-4618-b063-8b0d7eadd335 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:43.298416 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-88558528-fe92-455e-9466-92a686530f80 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:43.299641 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-88558528-fe92-455e-9466-92a686530f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:43.320100 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 271/548] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:43.325179 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edf2d9-a199-4618-b063-8b0d7eadd335 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:43.446235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 278/549] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:33:43.481643 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edf2d9-a199-4618-b063-8b0d7eadd335 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:43.520023 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:43.539087 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f5f8e-bbae-45a0-ae21-bfdbf76e0636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:43.539723 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f5f8e-bbae-45a0-ae21-bfdbf76e0636 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:43.539999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f5f8e-bbae-45a0-ae21-bfdbf76e0636 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:43.540270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f5f8e-bbae-45a0-ae21-bfdbf76e0636 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:43.553479 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f5f8e-bbae-45a0-ae21-bfdbf76e0636 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:43.554936 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f5f8e-bbae-45a0-ae21-bfdbf76e0636 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:43.570506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-1e4f5f8e-bbae-45a0-ae21-bfdbf76e0636 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 10:33:43.570506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:43.570506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:43.570506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:43.570506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:43.570506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:43.570506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:43.570506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:43.570506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:43.570506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:43.570506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:43.570506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:43.570506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:33:43.570506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:33:43.570506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:33:43.570506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:33:43.571954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:43.571954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:43.571954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:33:43.571954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:43.571954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:33:43.571954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:43.571954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:43.571954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:43.571954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:43.571954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:43.571954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:43.571954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:43.571954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:43.571954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:43.571954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:43.571954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:43.571954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:43.571954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:43.574056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:43.574056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:43.574056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:33:43.574056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:33:43.574056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:33:43.574056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:33:43.574056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:33:43.574056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:33:43.574056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 10:33:43.574056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:43.574056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 272/550] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:33:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:33:43.577293 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88558528-fe92-455e-9466-92a686530f80 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:43.697267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88558528-fe92-455e-9466-92a686530f80 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:43.698768 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:43.732359 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69e772-b282-45c1-bb7a-03b6d013ec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:43.733003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69e772-b282-45c1-bb7a-03b6d013ec84 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:43.733279 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69e772-b282-45c1-bb7a-03b6d013ec84 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:43.733549 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69e772-b282-45c1-bb7a-03b6d013ec84 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:43.734273 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69e772-b282-45c1-bb7a-03b6d013ec84 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:43.734579 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69e772-b282-45c1-bb7a-03b6d013ec84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:43.735991 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69e772-b282-45c1-bb7a-03b6d013ec84 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:43.749131 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d44774-7951-4d16-903c-70cd5afebc12 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:43.749501 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d44774-7951-4d16-903c-70cd5afebc12 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:43.749658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d44774-7951-4d16-903c-70cd5afebc12 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:43.751536 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 273/551] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:43.757400 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5613e-d6f4-4fc0-94e3-f4e1794b3d2f None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:43.757773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5613e-d6f4-4fc0-94e3-f4e1794b3d2f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:43.757942 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5613e-d6f4-4fc0-94e3-f4e1794b3d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:43.783143 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 279/552] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Sep 11 10:33:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:43.794612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69e772-b282-45c1-bb7a-03b6d013ec84 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:43.808283 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-22b5613e-d6f4-4fc0-94e3-f4e1794b3d2f None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:43.809558 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-22b5613e-d6f4-4fc0-94e3-f4e1794b3d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:43.929531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 274/553] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:43.930631 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5613e-d6f4-4fc0-94e3-f4e1794b3d2f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:43.970619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69e772-b282-45c1-bb7a-03b6d013ec84 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:44.038621 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5613e-d6f4-4fc0-94e3-f4e1794b3d2f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:44.072911 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:44.081339 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da48a1-4918-4b7d-87a6-191e7c366496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:44.082239 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da48a1-4918-4b7d-87a6-191e7c366496 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:44.083211 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da48a1-4918-4b7d-87a6-191e7c366496 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:44.084211 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da48a1-4918-4b7d-87a6-191e7c366496 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:44.088117 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e93977-bb3b-4154-9953-99e91a43ddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:44.088924 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e93977-bb3b-4154-9953-99e91a43ddfc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:44.090412 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e93977-bb3b-4154-9953-99e91a43ddfc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:44.092089 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e93977-bb3b-4154-9953-99e91a43ddfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:44.110932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da48a1-4918-4b7d-87a6-191e7c366496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:44.116277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-51da48a1-4918-4b7d-87a6-191e7c366496 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:44.116277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:44.116277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:44.116277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:44.116277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:44.116277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:44.116277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:44.116277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:44.116277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:44.116277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:44.116277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:44.116277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:44.116277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:44.116277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:44.116277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:44.116277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:44.117825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:44.117825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:44.117825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:44.117825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:44.117825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:44.117825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:44.117825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:44.117825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:44.117825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:44.117825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:44.117825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:44.117825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:44.117825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:44.117825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:44.117825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:44.117825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:44.119700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:44.119700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:44.119700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:44.119700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:44.119700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:44.119700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:44.119700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:44.119700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:44.119700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:44.119700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:44.119700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:44.119700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:44.130876 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 275/554] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:33:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:44.133739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da48a1-4918-4b7d-87a6-191e7c366496 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:44.164932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:44.240616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e93977-bb3b-4154-9953-99e91a43ddfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:44.243959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e93977-bb3b-4154-9953-99e91a43ddfc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:44.284690 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da48a1-4918-4b7d-87a6-191e7c366496 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:44.320237 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786984d1-f1d4-4346-ae0a-78ae7df5d035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:44.321189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786984d1-f1d4-4346-ae0a-78ae7df5d035 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:44.321666 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786984d1-f1d4-4346-ae0a-78ae7df5d035 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:44.322120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786984d1-f1d4-4346-ae0a-78ae7df5d035 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:44.322959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786984d1-f1d4-4346-ae0a-78ae7df5d035 None admin] RBAC: Adding query filter params (name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:44.323443 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786984d1-f1d4-4346-ae0a-78ae7df5d035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:44.325190 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786984d1-f1d4-4346-ae0a-78ae7df5d035 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:44.338155 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 276/555] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:33:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:44.339268 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786984d1-f1d4-4346-ae0a-78ae7df5d035 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:44.371851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:44.375039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 280/556] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 10:33:44.376131 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e93977-bb3b-4154-9953-99e91a43ddfc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:44.452383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786984d1-f1d4-4346-ae0a-78ae7df5d035 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:44.465053 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:44.499876 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546ee1d-38be-4024-a122-24130b12c043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:44.501458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546ee1d-38be-4024-a122-24130b12c043 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:44.501742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546ee1d-38be-4024-a122-24130b12c043 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:44.502565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546ee1d-38be-4024-a122-24130b12c043 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:44.518712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e93977-bb3b-4154-9953-99e91a43ddfc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:44.522682 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546ee1d-38be-4024-a122-24130b12c043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:44.530162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-5546ee1d-38be-4024-a122-24130b12c043 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:44.530162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:44.530162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:44.530162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:44.530162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:44.530162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:44.530162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:44.530162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:44.530162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:44.530162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:44.530162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:44.530162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:44.530162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:44.530162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:44.530162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:44.530162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:44.531169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:44.531169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:44.531169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:44.531169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:44.531169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:44.531169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:44.531169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:44.531169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:44.531169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:44.531169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:44.531169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:44.531169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:44.531169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:44.531169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:44.531169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:44.531169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:44.531979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:44.531979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:44.531979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:44.531979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:44.531979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:44.531979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:44.531979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:44.531979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:44.531979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:44.531979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:44.531979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:44.531979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:44.536087 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 277/557] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:33:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:44.536087 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546ee1d-38be-4024-a122-24130b12c043 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:44.573533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0046e1-8059-478a-9a37-15094960cf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:44.574424 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0046e1-8059-478a-9a37-15094960cf46 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:44.574707 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0046e1-8059-478a-9a37-15094960cf46 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:44.575261 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0046e1-8059-478a-9a37-15094960cf46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:44.588733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0046e1-8059-478a-9a37-15094960cf46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:44.590395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0046e1-8059-478a-9a37-15094960cf46 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:44.612681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-6d0046e1-8059-478a-9a37-15094960cf46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:44.612681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:44.612681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:44.612681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:44.612681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:44.612681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:44.612681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:44.612681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:44.612681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:44.612681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:44.612681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:44.612681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:44.612681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:44.612681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:44.612681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:44.612681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:44.613686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:44.613686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:44.613686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:44.613686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:44.613686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:44.613686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:44.613686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:44.613686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:44.613686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:44.613686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:44.613686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:44.613686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:44.613686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:44.613686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:44.613686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:44.613686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:44.613686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:44.614559 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:44.614559 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:44.614559 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:44.616696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 281/558] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:44.617680 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0046e1-8059-478a-9a37-15094960cf46 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:44.652216 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:44.664477 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546ee1d-38be-4024-a122-24130b12c043 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:44.701854 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b40860-09a4-421d-b372-40b0f43bd3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:44.702593 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b40860-09a4-421d-b372-40b0f43bd3ea None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:44.702943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b40860-09a4-421d-b372-40b0f43bd3ea None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:44.703455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b40860-09a4-421d-b372-40b0f43bd3ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:44.716729 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b40860-09a4-421d-b372-40b0f43bd3ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:44.718671 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b40860-09a4-421d-b372-40b0f43bd3ea None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:44.733758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-06b40860-09a4-421d-b372-40b0f43bd3ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:44.733758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:44.733758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:44.733758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:44.733758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:44.733758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:44.733758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:44.733758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:44.733758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:44.733758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:44.733758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:44.733758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:44.733758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:44.733758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:44.733758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:44.733758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:44.734779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:44.734779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:44.734779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:44.734779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:44.734779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:44.734779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:44.734779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:44.734779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:44.734779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:44.734779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:44.734779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:44.734779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:44.734779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:44.734779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:44.734779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:44.734779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:44.734779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:44.735636 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:44.735636 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:44.735636 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:44.735836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0046e1-8059-478a-9a37-15094960cf46 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:44.740214 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 278/559] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:44.740973 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b40860-09a4-421d-b372-40b0f43bd3ea None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:44.749113 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:44.775205 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df60b5-bbdf-4998-be35-53c7e609ee6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:44.775792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df60b5-bbdf-4998-be35-53c7e609ee6a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:44.776073 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df60b5-bbdf-4998-be35-53c7e609ee6a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:44.776348 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df60b5-bbdf-4998-be35-53c7e609ee6a None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:44.777056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df60b5-bbdf-4998-be35-53c7e609ee6a None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:44.777624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df60b5-bbdf-4998-be35-53c7e609ee6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:44.779884 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df60b5-bbdf-4998-be35-53c7e609ee6a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:44.790384 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 282/560] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:33:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:44.791617 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5786c6-807a-40f8-a4b6-a0b45238a558 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:44.791957 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5786c6-807a-40f8-a4b6-a0b45238a558 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:44.792240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5786c6-807a-40f8-a4b6-a0b45238a558 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:44.796606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 283/561] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:44.796606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5786c6-807a-40f8-a4b6-a0b45238a558 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:44.852052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b40860-09a4-421d-b372-40b0f43bd3ea None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:44.885405 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed355c-e98e-4ef0-905e-eca9bf1ee80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:44.886012 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed355c-e98e-4ef0-905e-eca9bf1ee80a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:44.886292 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed355c-e98e-4ef0-905e-eca9bf1ee80a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:44.886569 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed355c-e98e-4ef0-905e-eca9bf1ee80a None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:44.887217 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed355c-e98e-4ef0-905e-eca9bf1ee80a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:44.887523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed355c-e98e-4ef0-905e-eca9bf1ee80a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:44.888938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed355c-e98e-4ef0-905e-eca9bf1ee80a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:44.901288 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 279/562] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:44.902113 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed355c-e98e-4ef0-905e-eca9bf1ee80a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:44.906824 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:44.917659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5786c6-807a-40f8-a4b6-a0b45238a558 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:44.953413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f4031-d804-4c4b-96cd-7db9abbb9ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:44.954019 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f4031-d804-4c4b-96cd-7db9abbb9ac7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:44.954471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f4031-d804-4c4b-96cd-7db9abbb9ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:44.954749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f4031-d804-4c4b-96cd-7db9abbb9ac7 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:44.956022 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f4031-d804-4c4b-96cd-7db9abbb9ac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:44.956570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f4031-d804-4c4b-96cd-7db9abbb9ac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:44.959193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f4031-d804-4c4b-96cd-7db9abbb9ac7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:44.975010 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 284/563] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:44.976129 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285280fa-b941-47d1-982f-52a15232f049 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:44.976418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285280fa-b941-47d1-982f-52a15232f049 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:44.976729 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285280fa-b941-47d1-982f-52a15232f049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:44.997254 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-285280fa-b941-47d1-982f-52a15232f049 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:44.998457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-285280fa-b941-47d1-982f-52a15232f049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:45.013394 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed355c-e98e-4ef0-905e-eca9bf1ee80a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:45.034026 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:45.053609 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a20c2-3d1c-41d1-9d10-470f617308f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:45.054624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a20c2-3d1c-41d1-9d10-470f617308f0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:45.054904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a20c2-3d1c-41d1-9d10-470f617308f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:45.055174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a20c2-3d1c-41d1-9d10-470f617308f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:45.066061 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a20c2-3d1c-41d1-9d10-470f617308f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:45.067490 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a20c2-3d1c-41d1-9d10-470f617308f0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:45.082201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-e95a20c2-3d1c-41d1-9d10-470f617308f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:45.082201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:45.082201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:45.082201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:45.082201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:45.082201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:45.082201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:45.082201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:45.082201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:45.082201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:45.082201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:45.082201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:45.082201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:45.082201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:45.082201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:45.082201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:45.083331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:45.083331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:45.083331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:45.083331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:45.083331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:45.083331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:45.083331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:45.083331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:45.083331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:45.083331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:45.083331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:45.083331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:45.083331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:45.083331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:45.083331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:45.083331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:45.083331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:45.084204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:45.084204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:45.084204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:45.084204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 280/564] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:45.084491 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a20c2-3d1c-41d1-9d10-470f617308f0 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:45.096846 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 285/565] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:45.096846 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285280fa-b941-47d1-982f-52a15232f049 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:45.165062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:45.199932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285280fa-b941-47d1-982f-52a15232f049 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:45.213256 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a20c2-3d1c-41d1-9d10-470f617308f0 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:45.236425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903b94d-9383-4ae7-9df2-77cef0b5aff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:45.237363 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903b94d-9383-4ae7-9df2-77cef0b5aff3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:45.237649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903b94d-9383-4ae7-9df2-77cef0b5aff3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:45.237926 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903b94d-9383-4ae7-9df2-77cef0b5aff3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:45.245907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903b94d-9383-4ae7-9df2-77cef0b5aff3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:45.246365 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9332f0a-356b-475b-acf0-91141880c816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:45.246985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9332f0a-356b-475b-acf0-91141880c816 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:45.247259 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9332f0a-356b-475b-acf0-91141880c816 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:45.247418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903b94d-9383-4ae7-9df2-77cef0b5aff3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:45.247511 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9332f0a-356b-475b-acf0-91141880c816 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:45.255221 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9332f0a-356b-475b-acf0-91141880c816 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:45.257043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9332f0a-356b-475b-acf0-91141880c816 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:45.261507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-a903b94d-9383-4ae7-9df2-77cef0b5aff3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:45.261507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:45.261507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:45.261507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:45.261507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:45.261507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:45.261507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:45.261507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:45.261507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:45.261507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:45.261507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:45.261507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:45.261507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:33:45.261507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:33:45.261507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:33:45.262326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:33:45.262326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:45.262326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:45.262326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:45.262326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:45.262326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:45.262326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:45.262326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:45.262326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:45.262326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:45.262326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:45.262326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:45.262326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:45.262326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:45.262326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:45.262326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:45.262326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:45.263190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:33:45.263190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:33:45.263190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:33:45.263190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:33:45.263190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:33:45.263190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:33:45.263190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:45.263190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:45.264852 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 286/566] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:45.265822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903b94d-9383-4ae7-9df2-77cef0b5aff3 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:45.269809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-a9332f0a-356b-475b-acf0-91141880c816 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 10:33:45.269809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:45.269809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:45.269809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:45.269809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:45.269809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:45.269809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:45.269809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:45.269809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:45.269809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:45.269809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:45.269809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:45.269809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:33:45.269809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:33:45.269809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:33:45.269809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:33:45.270738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:45.270738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:45.270738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:33:45.270738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:45.270738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:33:45.270738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:45.270738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:45.270738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:45.270738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:45.270738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:45.270738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:45.270738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:45.270738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:45.270738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:45.270738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:45.270738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:45.270738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:45.270738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:45.271648 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:45.271648 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:45.271648 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:33:45.271648 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:33:45.271648 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:33:45.271648 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:33:45.271648 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:33:45.271648 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:33:45.271648 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 10:33:45.271648 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:45.275605 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 281/567] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:45.276823 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bac96f-3222-4af1-8016-76a193d08494 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:45.277107 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bac96f-3222-4af1-8016-76a193d08494 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:45.277381 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bac96f-3222-4af1-8016-76a193d08494 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:45.278754 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 282/568] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:45.279352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bac96f-3222-4af1-8016-76a193d08494 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:45.295212 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:45.378101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903b94d-9383-4ae7-9df2-77cef0b5aff3 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:45.386898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bac96f-3222-4af1-8016-76a193d08494 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:45.403070 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:45.412503 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a735329-ecbb-4642-976c-4e4f5c8656e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:45.413146 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a735329-ecbb-4642-976c-4e4f5c8656e1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:45.413426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a735329-ecbb-4642-976c-4e4f5c8656e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:45.413698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a735329-ecbb-4642-976c-4e4f5c8656e1 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:45.414345 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a735329-ecbb-4642-976c-4e4f5c8656e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:45.414647 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a735329-ecbb-4642-976c-4e4f5c8656e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:45.416017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a735329-ecbb-4642-976c-4e4f5c8656e1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:45.422059 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c5ff6-12d6-480b-ba36-a9c653550532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:45.423120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c5ff6-12d6-480b-ba36-a9c653550532 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:45.423409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c5ff6-12d6-480b-ba36-a9c653550532 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:45.423689 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c5ff6-12d6-480b-ba36-a9c653550532 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:45.424480 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c5ff6-12d6-480b-ba36-a9c653550532 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:45.424828 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c5ff6-12d6-480b-ba36-a9c653550532 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:45.426293 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c5ff6-12d6-480b-ba36-a9c653550532 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:45.427051 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 287/569] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:45.427840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a735329-ecbb-4642-976c-4e4f5c8656e1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:45.442778 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 283/570] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:33:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:45.443998 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db0f5d-4af2-492d-821b-3041eb925236 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:45.444283 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db0f5d-4af2-492d-821b-3041eb925236 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:45.444576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db0f5d-4af2-492d-821b-3041eb925236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:45.461992 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-69db0f5d-4af2-492d-821b-3041eb925236 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:45.463179 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-69db0f5d-4af2-492d-821b-3041eb925236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:45.517983 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:45.532220 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 284/571] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:45.532888 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db0f5d-4af2-492d-821b-3041eb925236 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:45.546553 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a735329-ecbb-4642-976c-4e4f5c8656e1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:45.582478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2ccce-b370-439c-9e24-372d8fdf1a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:45.583077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2ccce-b370-439c-9e24-372d8fdf1a90 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:45.583358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2ccce-b370-439c-9e24-372d8fdf1a90 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:45.583826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2ccce-b370-439c-9e24-372d8fdf1a90 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:45.584352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2ccce-b370-439c-9e24-372d8fdf1a90 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:45.584705 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2ccce-b370-439c-9e24-372d8fdf1a90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:45.586119 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2ccce-b370-439c-9e24-372d8fdf1a90 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:45.604084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 288/572] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Sep 11 10:33:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:45.605010 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2ccce-b370-439c-9e24-372d8fdf1a90 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:45.644588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db0f5d-4af2-492d-821b-3041eb925236 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:45.652406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:45.680928 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1e3af-6baa-4f6d-965d-014548879a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:45.681568 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1e3af-6baa-4f6d-965d-014548879a3d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:45.681851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1e3af-6baa-4f6d-965d-014548879a3d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:45.682123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1e3af-6baa-4f6d-965d-014548879a3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:45.692616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1e3af-6baa-4f6d-965d-014548879a3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:45.697447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-96d1e3af-6baa-4f6d-965d-014548879a3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:45.697447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:45.697447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:45.697447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:45.697447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:45.697447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:45.697447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:45.697447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:45.697447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:45.697447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:45.697447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:45.697447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:45.697447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:45.697447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:45.697447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:45.697447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:45.698347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:45.698347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:45.698347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:45.698347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:45.698347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:45.698347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:45.698347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:45.698347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:45.698347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:45.698347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:45.698347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:45.698347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:45.698347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:45.698347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:45.698347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:45.698347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:45.699260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:45.699260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:45.699260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:45.699260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:45.699260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:45.699260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:45.699260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:45.699260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:45.699260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:45.699260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:45.699260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:45.699260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:45.699260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 285/573] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:33:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:45.699936 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1e3af-6baa-4f6d-965d-014548879a3d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:45.723363 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2ccce-b370-439c-9e24-372d8fdf1a90 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:45.761560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95391a9-58f2-4fa7-b1ad-20772e0e94db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:45.762180 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95391a9-58f2-4fa7-b1ad-20772e0e94db None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:45.762455 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95391a9-58f2-4fa7-b1ad-20772e0e94db None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:45.762722 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95391a9-58f2-4fa7-b1ad-20772e0e94db None admin] PATH_INFO: `/v3/users/nova` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:45.769825 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95391a9-58f2-4fa7-b1ad-20772e0e94db None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:45.771243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95391a9-58f2-4fa7-b1ad-20772e0e94db None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:45.782668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-e95391a9-58f2-4fa7-b1ad-20772e0e94db None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 10:33:45.782668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:45.782668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:45.782668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:45.782668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:45.782668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:45.782668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:45.782668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:45.782668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:45.782668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:45.782668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:45.782668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:45.782668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:33:45.782668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:33:45.782668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:33:45.782668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:33:45.784139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:45.784139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:45.784139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:33:45.784139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:45.784139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:33:45.784139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:45.784139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:45.784139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:45.784139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:45.784139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:45.784139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:45.784139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:45.784139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:45.784139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:45.784139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:45.784139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:45.784139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:45.784139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:45.785127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:45.785127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:45.785127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:33:45.785127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:33:45.785127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:33:45.785127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:33:45.785127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:33:45.785127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:33:45.785127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 10:33:45.785127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:45.788904 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 289/574] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Sep 11 10:33:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:45.789718 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95391a9-58f2-4fa7-b1ad-20772e0e94db None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:45.794135 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:45.804914 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1e3af-6baa-4f6d-965d-014548879a3d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:45.839516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41029c8-624f-4efc-8db5-28e022660668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:45.840111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41029c8-624f-4efc-8db5-28e022660668 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:45.840392 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41029c8-624f-4efc-8db5-28e022660668 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:45.840696 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41029c8-624f-4efc-8db5-28e022660668 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:45.841420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41029c8-624f-4efc-8db5-28e022660668 None admin] RBAC: Adding query filter params (role.id=295de8f316124ccdac36a50e50531148, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=28ff72290fd14ddaba6ed757051e182b) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:45.841725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41029c8-624f-4efc-8db5-28e022660668 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:45.843164 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41029c8-624f-4efc-8db5-28e022660668 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:45.848673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 286/575] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:33:45 2022] GET /identity/v3/role_assignments?user.id=28ff72290fd14ddaba6ed757051e182b&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=295de8f316124ccdac36a50e50531148 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:45.857102 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41029c8-624f-4efc-8db5-28e022660668 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:45.893549 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95391a9-58f2-4fa7-b1ad-20772e0e94db None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:45.894851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:45.931986 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375331c-5c40-40bc-bac3-3d969b801136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:45.932654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375331c-5c40-40bc-bac3-3d969b801136 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:45.932937 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375331c-5c40-40bc-bac3-3d969b801136 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:45.933215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375331c-5c40-40bc-bac3-3d969b801136 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:45.947686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375331c-5c40-40bc-bac3-3d969b801136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:45.949596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375331c-5c40-40bc-bac3-3d969b801136 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:45.967071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-3375331c-5c40-40bc-bac3-3d969b801136 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:45.967071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:45.967071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:45.967071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:45.967071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:45.967071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:45.967071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:45.967071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:45.967071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:45.967071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:45.967071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:45.967071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:45.967071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:45.967071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:45.967071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:45.967071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:45.973867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:45.973867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:45.973867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:45.973867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:45.973867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:45.973867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:45.973867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:45.973867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:45.973867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:45.973867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:45.973867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:45.973867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:45.973867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:45.973867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:45.973867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:45.973867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:45.973867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:45.974898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:45.974898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:45.974898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:45.974898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 290/576] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:45.974898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375331c-5c40-40bc-bac3-3d969b801136 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:45.983195 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41029c8-624f-4efc-8db5-28e022660668 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:46.022157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a4ba3-13de-4752-be1e-722be718d8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:46.023030 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a4ba3-13de-4752-be1e-722be718d8b7 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:46.023481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a4ba3-13de-4752-be1e-722be718d8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:46.023771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a4ba3-13de-4752-be1e-722be718d8b7 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:46.024450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a4ba3-13de-4752-be1e-722be718d8b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:46.024783 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a4ba3-13de-4752-be1e-722be718d8b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:46.026144 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a4ba3-13de-4752-be1e-722be718d8b7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:46.036340 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 287/577] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:33:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:46.036340 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a4ba3-13de-4752-be1e-722be718d8b7 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:46.043898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:46.092113 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375331c-5c40-40bc-bac3-3d969b801136 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:46.129517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb07319-4cbb-4e47-841d-319691926aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:46.130115 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb07319-4cbb-4e47-841d-319691926aa1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:46.130395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb07319-4cbb-4e47-841d-319691926aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:46.130659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb07319-4cbb-4e47-841d-319691926aa1 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:46.131380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb07319-4cbb-4e47-841d-319691926aa1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:46.131682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb07319-4cbb-4e47-841d-319691926aa1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:46.131904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:46.133496 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb07319-4cbb-4e47-841d-319691926aa1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:46.141835 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a4ba3-13de-4752-be1e-722be718d8b7 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:46.157413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 291/578] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Sep 11 10:33:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:46.157413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb07319-4cbb-4e47-841d-319691926aa1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:46.180796 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a49e18-0ce1-43e9-bca7-0d8c36baf760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:46.181521 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a49e18-0ce1-43e9-bca7-0d8c36baf760 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:46.181804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a49e18-0ce1-43e9-bca7-0d8c36baf760 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:46.182076 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a49e18-0ce1-43e9-bca7-0d8c36baf760 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:46.192841 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a49e18-0ce1-43e9-bca7-0d8c36baf760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:46.198153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-49a49e18-0ce1-43e9-bca7-0d8c36baf760 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:46.198153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:46.198153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:46.198153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:46.198153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:46.198153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:46.198153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:46.198153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:46.198153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:46.198153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:46.198153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:46.198153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:46.198153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:46.198153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:46.198153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:46.198153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:46.199075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:46.199075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:46.199075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:46.199075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:46.199075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:46.199075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:46.199075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:46.199075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:46.199075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:46.199075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:46.199075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:46.199075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:46.199075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:46.199075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:46.199075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:46.199075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:46.199907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:46.199907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:46.199907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:46.199907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:46.199907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:46.199907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:46.199907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:46.199907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:46.199907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:46.199907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:46.199907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:46.199907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:46.199907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 288/579] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:33:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:46.200637 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a49e18-0ce1-43e9-bca7-0d8c36baf760 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:46.269610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb07319-4cbb-4e47-841d-319691926aa1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:46.282893 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:46.308900 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629f76a-7293-4b52-b273-d081ef546092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:46.309512 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629f76a-7293-4b52-b273-d081ef546092 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:46.311422 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a49e18-0ce1-43e9-bca7-0d8c36baf760 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:46.311534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629f76a-7293-4b52-b273-d081ef546092 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:46.311534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629f76a-7293-4b52-b273-d081ef546092 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:46.311534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629f76a-7293-4b52-b273-d081ef546092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:46.311534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629f76a-7293-4b52-b273-d081ef546092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:46.312540 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629f76a-7293-4b52-b273-d081ef546092 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:46.328791 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 292/580] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:46.328791 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629f76a-7293-4b52-b273-d081ef546092 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:46.349919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef94d9a-dd91-4b84-a0e6-b248436d9e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:46.350473 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef94d9a-dd91-4b84-a0e6-b248436d9e72 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:46.350792 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef94d9a-dd91-4b84-a0e6-b248436d9e72 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:46.351065 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef94d9a-dd91-4b84-a0e6-b248436d9e72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:46.362546 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef94d9a-dd91-4b84-a0e6-b248436d9e72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:46.364011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef94d9a-dd91-4b84-a0e6-b248436d9e72 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:46.378452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-cef94d9a-dd91-4b84-a0e6-b248436d9e72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:46.378452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:46.378452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:46.378452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:46.378452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:46.378452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:46.378452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:46.378452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:46.378452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:46.378452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:46.378452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:46.378452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:46.378452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:46.378452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:46.378452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:46.378452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:46.379487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:46.379487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:46.379487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:46.379487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:46.379487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:46.379487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:46.379487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:46.379487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:46.379487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:46.379487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:46.379487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:46.379487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:46.379487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:46.379487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:46.379487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:46.379487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:46.379487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:46.380351 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:46.380351 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:46.380351 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:46.380351 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 289/581] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:46.380351 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef94d9a-dd91-4b84-a0e6-b248436d9e72 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:46.387793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:46.437111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629f76a-7293-4b52-b273-d081ef546092 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:46.472195 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc029189-9170-4af8-bace-565c4d4c672d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:46.473155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc029189-9170-4af8-bace-565c4d4c672d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:46.473155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc029189-9170-4af8-bace-565c4d4c672d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:46.473431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc029189-9170-4af8-bace-565c4d4c672d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:46.484034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc029189-9170-4af8-bace-565c4d4c672d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:46.485495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc029189-9170-4af8-bace-565c4d4c672d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:46.491636 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef94d9a-dd91-4b84-a0e6-b248436d9e72 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:46.499887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-cc029189-9170-4af8-bace-565c4d4c672d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:46.499887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:46.499887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:46.499887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:46.499887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:46.499887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:46.499887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:46.499887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:46.499887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:46.499887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:46.499887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:46.499887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:46.499887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:46.499887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:46.499887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:46.499887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:46.501139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:46.501139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:46.501139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:46.501139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:46.501139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:46.501139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:46.501139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:46.501139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:46.501139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:46.501139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:46.501139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:46.501139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:46.501139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:46.501139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:46.501139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:46.501139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:46.501139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:46.502996 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:46.502996 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:46.502996 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:46.502996 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 293/582] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:46.502996 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc029189-9170-4af8-bace-565c4d4c672d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:46.528153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:46.534943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d55bf-bc93-45ff-999e-ece8be1ab052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:46.536401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d55bf-bc93-45ff-999e-ece8be1ab052 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:46.536961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d55bf-bc93-45ff-999e-ece8be1ab052 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:46.537467 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d55bf-bc93-45ff-999e-ece8be1ab052 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:46.538594 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d55bf-bc93-45ff-999e-ece8be1ab052 None admin] RBAC: Adding query filter params (name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:46.539153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d55bf-bc93-45ff-999e-ece8be1ab052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:46.540782 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d55bf-bc93-45ff-999e-ece8be1ab052 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:46.554551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 290/583] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:33:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:46.554551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d55bf-bc93-45ff-999e-ece8be1ab052 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:46.617037 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc029189-9170-4af8-bace-565c4d4c672d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:46.623212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:46.659136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c571b62-d6c3-4c39-8e51-bbf4f47cb4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:46.659833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c571b62-d6c3-4c39-8e51-bbf4f47cb4a0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:46.660113 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c571b62-d6c3-4c39-8e51-bbf4f47cb4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:46.660384 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c571b62-d6c3-4c39-8e51-bbf4f47cb4a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:46.661666 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d55bf-bc93-45ff-999e-ece8be1ab052 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:46.667020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c571b62-d6c3-4c39-8e51-bbf4f47cb4a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:46.668480 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c571b62-d6c3-4c39-8e51-bbf4f47cb4a0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:46.682405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-8c571b62-d6c3-4c39-8e51-bbf4f47cb4a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:46.682405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:46.682405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:46.682405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:46.682405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:46.682405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:46.682405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:46.682405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:46.682405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:46.682405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:46.682405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:46.682405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:46.682405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:33:46.682405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:33:46.682405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:33:46.683491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:33:46.683491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:46.683491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:46.683491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:46.683491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:46.683491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:46.683491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:46.683491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:46.683491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:46.683491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:46.683491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:46.683491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:46.683491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:46.683491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:46.683491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:46.683491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:46.683491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:46.685009 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:33:46.685009 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:33:46.685009 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:33:46.685009 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:33:46.685009 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:33:46.685009 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:33:46.685009 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:46.685009 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:46.690952 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 294/584] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:46.690952 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c571b62-d6c3-4c39-8e51-bbf4f47cb4a0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:46.704305 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83bf4c-ac11-46d5-acf9-3aa3ecbefa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:46.707875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83bf4c-ac11-46d5-acf9-3aa3ecbefa35 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:46.707875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83bf4c-ac11-46d5-acf9-3aa3ecbefa35 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:46.707875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83bf4c-ac11-46d5-acf9-3aa3ecbefa35 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:46.707875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83bf4c-ac11-46d5-acf9-3aa3ecbefa35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:46.707875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83bf4c-ac11-46d5-acf9-3aa3ecbefa35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:46.708359 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83bf4c-ac11-46d5-acf9-3aa3ecbefa35 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:46.725485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 291/585] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:46.730822 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83bf4c-ac11-46d5-acf9-3aa3ecbefa35 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:46.779844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:46.797669 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c571b62-d6c3-4c39-8e51-bbf4f47cb4a0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:46.833140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5c361-76f8-40a7-96dc-c4ace4beac3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:46.833752 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5c361-76f8-40a7-96dc-c4ace4beac3e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:46.834031 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5c361-76f8-40a7-96dc-c4ace4beac3e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:46.834302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5c361-76f8-40a7-96dc-c4ace4beac3e None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:46.834945 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5c361-76f8-40a7-96dc-c4ace4beac3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:46.835392 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5c361-76f8-40a7-96dc-c4ace4beac3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:46.837091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5c361-76f8-40a7-96dc-c4ace4beac3e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:46.838881 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83bf4c-ac11-46d5-acf9-3aa3ecbefa35 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:46.849059 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 295/586] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:46.849641 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5c361-76f8-40a7-96dc-c4ace4beac3e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:46.871974 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:46.883462 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa27f9-ffa1-4172-b704-ab642302d850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:46.884085 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa27f9-ffa1-4172-b704-ab642302d850 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:46.884367 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa27f9-ffa1-4172-b704-ab642302d850 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:46.884684 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa27f9-ffa1-4172-b704-ab642302d850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:46.896066 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa27f9-ffa1-4172-b704-ab642302d850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:46.897663 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa27f9-ffa1-4172-b704-ab642302d850 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:46.912733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-88aa27f9-ffa1-4172-b704-ab642302d850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:46.912733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:46.912733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:46.912733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:46.912733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:46.912733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:46.912733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:46.912733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:46.912733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:46.912733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:46.912733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:46.912733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:46.912733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:46.912733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:46.912733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:46.912733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:46.913842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:46.913842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:46.913842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:46.913842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:46.913842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:46.913842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:46.913842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:46.913842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:46.913842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:46.913842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:46.913842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:46.913842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:46.913842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:46.913842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:46.913842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:46.913842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:46.913842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:46.914916 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:46.914916 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:46.914916 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:46.920462 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 292/587] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:46.920462 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa27f9-ffa1-4172-b704-ab642302d850 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:46.959684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5c361-76f8-40a7-96dc-c4ace4beac3e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:46.996562 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbe622-7b1d-45c7-a3a2-554c3180b704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:46.997185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbe622-7b1d-45c7-a3a2-554c3180b704 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:46.997463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbe622-7b1d-45c7-a3a2-554c3180b704 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:46.997731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbe622-7b1d-45c7-a3a2-554c3180b704 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:46.998419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dbe622-7b1d-45c7-a3a2-554c3180b704 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:46.998957 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dbe622-7b1d-45c7-a3a2-554c3180b704 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:47.000121 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dbe622-7b1d-45c7-a3a2-554c3180b704 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:47.017156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 296/588] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:33:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:47.017156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbe622-7b1d-45c7-a3a2-554c3180b704 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:47.022595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:47.028619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa27f9-ffa1-4172-b704-ab642302d850 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:47.067074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fdab2-1a7a-4a22-b9ec-42d472ab8957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:47.067708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fdab2-1a7a-4a22-b9ec-42d472ab8957 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:47.068049 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fdab2-1a7a-4a22-b9ec-42d472ab8957 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:47.068330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fdab2-1a7a-4a22-b9ec-42d472ab8957 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:47.077073 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fdab2-1a7a-4a22-b9ec-42d472ab8957 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:47.078525 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fdab2-1a7a-4a22-b9ec-42d472ab8957 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:47.090732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-e19fdab2-1a7a-4a22-b9ec-42d472ab8957 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 10:33:47.090732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:47.090732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:47.090732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:47.090732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:47.090732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:47.090732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:47.090732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:47.090732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:47.090732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:47.090732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:47.090732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:47.090732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:33:47.090732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:33:47.090732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:33:47.090732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:33:47.091705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:47.091705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:47.091705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:33:47.091705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:47.091705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:33:47.091705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:47.091705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:47.091705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:47.091705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:47.091705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:47.091705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:47.091705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:47.091705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:47.091705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:47.091705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:47.091705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:47.091705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:47.091705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:47.092739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:47.092739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:47.092739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:33:47.092739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:33:47.092739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:33:47.092739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:33:47.092739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:33:47.092739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:33:47.092739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 10:33:47.092739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:47.092739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 293/589] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:33:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:47.092739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fdab2-1a7a-4a22-b9ec-42d472ab8957 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:47.133701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:47.134008 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbe622-7b1d-45c7-a3a2-554c3180b704 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:47.171358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc32334-d9b1-4a72-b0e9-0245b2abe6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:47.171991 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc32334-d9b1-4a72-b0e9-0245b2abe6d2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:47.172264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc32334-d9b1-4a72-b0e9-0245b2abe6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:47.172530 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc32334-d9b1-4a72-b0e9-0245b2abe6d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:47.180410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc32334-d9b1-4a72-b0e9-0245b2abe6d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:47.181866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc32334-d9b1-4a72-b0e9-0245b2abe6d2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:47.193452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-2dc32334-d9b1-4a72-b0e9-0245b2abe6d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:47.193452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:47.193452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:47.193452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:47.193452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:47.193452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:47.193452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:47.193452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:47.193452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:47.193452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:47.193452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:47.193452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:47.193452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:33:47.193452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:33:47.193452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:33:47.194332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:33:47.194332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:47.194332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:47.194332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:47.194332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:47.194332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:47.194332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:47.194332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:47.194332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:47.194332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:47.194332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:47.194332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:47.194332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:47.194332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:47.194332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:47.194332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:47.194332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:47.195221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:33:47.195221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:33:47.195221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:33:47.195221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:33:47.195221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:33:47.195221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:33:47.195221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:47.195221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:47.195221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 297/590] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:47.195221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc32334-d9b1-4a72-b0e9-0245b2abe6d2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:47.207053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fdab2-1a7a-4a22-b9ec-42d472ab8957 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:47.243570 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72184949-f6f1-4a5c-a0e6-641af9194805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:47.244174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72184949-f6f1-4a5c-a0e6-641af9194805 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:47.244452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72184949-f6f1-4a5c-a0e6-641af9194805 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:47.244754 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72184949-f6f1-4a5c-a0e6-641af9194805 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:47.245432 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72184949-f6f1-4a5c-a0e6-641af9194805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:47.245739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72184949-f6f1-4a5c-a0e6-641af9194805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:47.247088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72184949-f6f1-4a5c-a0e6-641af9194805 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:47.259203 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:47.259844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 294/591] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:47.261601 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72184949-f6f1-4a5c-a0e6-641af9194805 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:47.302181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc32334-d9b1-4a72-b0e9-0245b2abe6d2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:47.338908 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d5712-8106-4415-a300-059655605b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:47.339553 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d5712-8106-4415-a300-059655605b9c None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:47.339825 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d5712-8106-4415-a300-059655605b9c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:47.340209 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d5712-8106-4415-a300-059655605b9c None admin] PATH_INFO: `/v3/projects/cd477d464e9f48149879362d04db9b9e/users/28614526d50d4201b93b20df45465d32/roles/295de8f316124ccdac36a50e50531148` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:47.356062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d5712-8106-4415-a300-059655605b9c None admin] RBAC: Authorizing `identity:create_grant(project_id=cd477d464e9f48149879362d04db9b9e, user_id=28614526d50d4201b93b20df45465d32, role_id=295de8f316124ccdac36a50e50531148)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:47.357767 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d5712-8106-4415-a300-059655605b9c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:47.359588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:47.364385 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72184949-f6f1-4a5c-a0e6-641af9194805 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:47.373324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 298/592] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:33:47 2022] PUT /identity/v3/projects/cd477d464e9f48149879362d04db9b9e/users/28614526d50d4201b93b20df45465d32/roles/295de8f316124ccdac36a50e50531148 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:33:47.374178 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d5712-8106-4415-a300-059655605b9c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:47.429842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb3f41-fb3d-440d-b4f0-db66a0752ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:47.431113 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb3f41-fb3d-440d-b4f0-db66a0752ce8 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:47.431406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb3f41-fb3d-440d-b4f0-db66a0752ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:47.431687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb3f41-fb3d-440d-b4f0-db66a0752ce8 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:47.432476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb3f41-fb3d-440d-b4f0-db66a0752ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:47.433040 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb3f41-fb3d-440d-b4f0-db66a0752ce8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:47.434527 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb3f41-fb3d-440d-b4f0-db66a0752ce8 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:47.461942 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 295/593] 10.222.0.20 () {56 vars in 1139 bytes} [Sun Sep 11 10:33:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:47.463336 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb3f41-fb3d-440d-b4f0-db66a0752ce8 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:47.510467 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d5712-8106-4415-a300-059655605b9c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:47.530038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:47.557607 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a62472-4c67-4245-9468-1e0391d02d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:47.558576 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a62472-4c67-4245-9468-1e0391d02d8a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:47.559004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a62472-4c67-4245-9468-1e0391d02d8a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:47.559681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a62472-4c67-4245-9468-1e0391d02d8a None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:47.560999 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a62472-4c67-4245-9468-1e0391d02d8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:47.561737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a62472-4c67-4245-9468-1e0391d02d8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:47.563368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a62472-4c67-4245-9468-1e0391d02d8a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:47.578958 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 299/594] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:33:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:47.581405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a62472-4c67-4245-9468-1e0391d02d8a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:47.607069 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb3f41-fb3d-440d-b4f0-db66a0752ce8 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:47.648031 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e8651-37c0-40ae-8d73-47c02bbfda32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:47.648771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e8651-37c0-40ae-8d73-47c02bbfda32 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:47.649054 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e8651-37c0-40ae-8d73-47c02bbfda32 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:47.649504 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e8651-37c0-40ae-8d73-47c02bbfda32 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:47.657451 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e8651-37c0-40ae-8d73-47c02bbfda32 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:47.658963 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e8651-37c0-40ae-8d73-47c02bbfda32 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:47.671894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-d56e8651-37c0-40ae-8d73-47c02bbfda32 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 10:33:47.671894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:47.671894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:47.671894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:47.671894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:47.671894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:47.671894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:47.671894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:47.671894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:47.671894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:47.671894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:47.671894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:47.671894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:33:47.671894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:33:47.671894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:33:47.671894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:33:47.673138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:47.673138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:47.673138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:33:47.673138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:47.673138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:33:47.673138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:47.673138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:47.673138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:47.673138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:47.673138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:47.673138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:47.673138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:47.673138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:47.673138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:47.673138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:47.673138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:47.673138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:47.673138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:47.674816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:47.674816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:47.674816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:33:47.674816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:33:47.674816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:33:47.674816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:33:47.674816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:33:47.674816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:33:47.674816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 10:33:47.674816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:47.674816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 296/595] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:47.674816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e8651-37c0-40ae-8d73-47c02bbfda32 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:47.707225 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:47.713109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a62472-4c67-4245-9468-1e0391d02d8a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:47.755887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d7145-ef78-42dc-a593-8c33e896b4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:47.756954 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d7145-ef78-42dc-a593-8c33e896b4e2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:47.757700 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d7145-ef78-42dc-a593-8c33e896b4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:47.758214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d7145-ef78-42dc-a593-8c33e896b4e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:47.773735 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d7145-ef78-42dc-a593-8c33e896b4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:47.775843 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d7145-ef78-42dc-a593-8c33e896b4e2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:47.793726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-431d7145-ef78-42dc-a593-8c33e896b4e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:47.793726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:47.793726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:47.793726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:47.793726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:47.793726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:47.793726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:47.793726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:47.793726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:47.793726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:47.793726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:47.793726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:47.793726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:47.793726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:47.793726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:47.793726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:47.794701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:47.794701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:47.794701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:47.794701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:47.794701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:47.794701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:47.794701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:47.794701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:47.794701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:47.794701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:47.794701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:47.794701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:47.794701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:47.794701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:47.794701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:47.794701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:47.794701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:47.795582 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:47.795582 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:47.795582 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:47.795582 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 300/596] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:47.800590 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d7145-ef78-42dc-a593-8c33e896b4e2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:47.808222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e8651-37c0-40ae-8d73-47c02bbfda32 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:47.825374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:47.854133 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7079a05-a6c9-4b98-97d2-15135ba850c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:47.854808 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7079a05-a6c9-4b98-97d2-15135ba850c0 None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:47.855092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7079a05-a6c9-4b98-97d2-15135ba850c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:47.855377 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7079a05-a6c9-4b98-97d2-15135ba850c0 None admin] PATH_INFO: `/v3/projects/cd477d464e9f48149879362d04db9b9e/users/b642a1d00de940429fc1cc6131ac22b1/roles/295de8f316124ccdac36a50e50531148` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:47.878299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7079a05-a6c9-4b98-97d2-15135ba850c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd477d464e9f48149879362d04db9b9e, user_id=b642a1d00de940429fc1cc6131ac22b1, role_id=295de8f316124ccdac36a50e50531148)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:47.879793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7079a05-a6c9-4b98-97d2-15135ba850c0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:47.908577 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 297/597] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:33:47 2022] PUT /identity/v3/projects/cd477d464e9f48149879362d04db9b9e/users/b642a1d00de940429fc1cc6131ac22b1/roles/295de8f316124ccdac36a50e50531148 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:33:47.908577 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7079a05-a6c9-4b98-97d2-15135ba850c0 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:47.930985 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d7145-ef78-42dc-a593-8c33e896b4e2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:48.004975 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:48.007795 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21671e0-5c59-4a73-85f9-0d055f3610a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:48.008436 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21671e0-5c59-4a73-85f9-0d055f3610a0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:48.009017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21671e0-5c59-4a73-85f9-0d055f3610a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:48.010050 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21671e0-5c59-4a73-85f9-0d055f3610a0 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:48.010674 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21671e0-5c59-4a73-85f9-0d055f3610a0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:48.010983 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21671e0-5c59-4a73-85f9-0d055f3610a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:48.013899 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21671e0-5c59-4a73-85f9-0d055f3610a0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:48.040986 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 301/598] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Sep 11 10:33:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:48.042595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542acaf8-0b93-4c74-a3ef-8e708a769f6f None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:48.042880 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542acaf8-0b93-4c74-a3ef-8e708a769f6f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:48.043149 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542acaf8-0b93-4c74-a3ef-8e708a769f6f None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:48.049615 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 302/599] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:48.050953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542acaf8-0b93-4c74-a3ef-8e708a769f6f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:48.057046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7079a05-a6c9-4b98-97d2-15135ba850c0 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:48.108202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdb35c-c721-4198-a16b-0766dc9ae120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:48.108843 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdb35c-c721-4198-a16b-0766dc9ae120 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:48.109122 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdb35c-c721-4198-a16b-0766dc9ae120 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:48.109392 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdb35c-c721-4198-a16b-0766dc9ae120 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:48.110041 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdb35c-c721-4198-a16b-0766dc9ae120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:48.110344 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdb35c-c721-4198-a16b-0766dc9ae120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:48.112287 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdb35c-c721-4198-a16b-0766dc9ae120 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:48.126307 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 298/600] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:48.128464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c820c-63b4-49a7-ae21-409eee43d917 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:48.128848 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c820c-63b4-49a7-ae21-409eee43d917 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:48.129323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c820c-63b4-49a7-ae21-409eee43d917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:48.148130 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-fc1c820c-63b4-49a7-ae21-409eee43d917 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:48.149527 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fc1c820c-63b4-49a7-ae21-409eee43d917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:48.164938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:48.187563 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542acaf8-0b93-4c74-a3ef-8e708a769f6f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:48.224687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60fe5f-d137-4523-8dac-85873b4539f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:48.225149 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60fe5f-d137-4523-8dac-85873b4539f8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:48.225434 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60fe5f-d137-4523-8dac-85873b4539f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:48.225707 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60fe5f-d137-4523-8dac-85873b4539f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:48.237386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60fe5f-d137-4523-8dac-85873b4539f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:48.238914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60fe5f-d137-4523-8dac-85873b4539f8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:48.243810 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 299/601] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:48.245623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c820c-63b4-49a7-ae21-409eee43d917 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:48.264291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-0d60fe5f-d137-4523-8dac-85873b4539f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:48.264291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:48.264291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:48.264291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:48.264291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:48.264291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:48.264291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:48.264291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:48.264291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:48.264291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:48.264291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:48.264291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:48.264291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:48.264291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:48.264291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:48.264291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:48.265266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:48.265266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:48.265266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:48.265266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:48.265266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:48.265266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:48.265266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:48.265266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:48.265266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:48.265266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:48.265266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:48.265266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:48.265266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:48.265266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:48.265266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:48.265266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:48.265266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:48.266125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:48.266125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:48.266125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:48.267198 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 303/602] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:48.271999 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60fe5f-d137-4523-8dac-85873b4539f8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:48.367931 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:48.407994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60fe5f-d137-4523-8dac-85873b4539f8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:48.446166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c690b6-4241-4e74-aeab-0bc553902fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:48.446828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c690b6-4241-4e74-aeab-0bc553902fff None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:48.447107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c690b6-4241-4e74-aeab-0bc553902fff None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:48.447380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c690b6-4241-4e74-aeab-0bc553902fff None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:48.448105 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c690b6-4241-4e74-aeab-0bc553902fff None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:48.448421 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c690b6-4241-4e74-aeab-0bc553902fff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:48.450234 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c690b6-4241-4e74-aeab-0bc553902fff None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:48.453038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:48.473170 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 304/603] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:48.475164 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c820c-63b4-49a7-ae21-409eee43d917 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:48.479291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c690b6-4241-4e74-aeab-0bc553902fff None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:48.542079 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5498d9-fee6-45f7-8977-1ebda0767501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:48.542637 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5498d9-fee6-45f7-8977-1ebda0767501 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:48.542920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5498d9-fee6-45f7-8977-1ebda0767501 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:48.543194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5498d9-fee6-45f7-8977-1ebda0767501 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:48.557109 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5498d9-fee6-45f7-8977-1ebda0767501 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:48.558556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5498d9-fee6-45f7-8977-1ebda0767501 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:48.576362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-8b5498d9-fee6-45f7-8977-1ebda0767501 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:48.576362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:48.576362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:48.576362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:48.576362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:48.576362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:48.576362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:48.576362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:48.576362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:48.576362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:48.576362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:48.576362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:48.576362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:33:48.576362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:33:48.576362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:33:48.577257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:33:48.577257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:48.577257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:48.577257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:48.577257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:48.577257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:48.577257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:48.577257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:48.577257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:48.577257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:48.577257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:48.577257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:48.577257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:48.577257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:48.577257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:48.577257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:48.577257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:48.578123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:33:48.578123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:33:48.578123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:33:48.578123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:33:48.578123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:33:48.578123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:33:48.578123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:48.578123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:48.578123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 300/604] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:48.587993 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5498d9-fee6-45f7-8977-1ebda0767501 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:48.644757 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c690b6-4241-4e74-aeab-0bc553902fff None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:48.682157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4c883-43aa-4736-907f-5122fcee8f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:48.683253 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4c883-43aa-4736-907f-5122fcee8f18 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:48.683759 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4c883-43aa-4736-907f-5122fcee8f18 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:48.684220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4c883-43aa-4736-907f-5122fcee8f18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:48.692124 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4c883-43aa-4736-907f-5122fcee8f18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:48.694078 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4c883-43aa-4736-907f-5122fcee8f18 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:48.703627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5498d9-fee6-45f7-8977-1ebda0767501 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:48.707215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-d9c4c883-43aa-4736-907f-5122fcee8f18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:48.707215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:48.707215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:48.707215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:48.707215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:48.707215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:48.707215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:48.707215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:48.707215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:48.707215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:48.707215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:48.707215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:48.707215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:33:48.707215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:33:48.707215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:33:48.708080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:33:48.708080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:48.708080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:48.708080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:48.708080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:48.708080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:48.708080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:48.708080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:48.708080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:48.708080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:48.708080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:48.708080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:48.708080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:48.708080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:48.708080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:48.708080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:48.708080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:48.709043 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:33:48.709043 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:33:48.709043 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:33:48.709043 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:33:48.709043 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:33:48.709043 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:33:48.709043 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:48.709043 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:48.711229 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 305/605] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:48.712292 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4c883-43aa-4736-907f-5122fcee8f18 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:48.735960 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:48.756616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4392d38-754c-4ec9-8c8d-bcbab1026d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:48.757230 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4392d38-754c-4ec9-8c8d-bcbab1026d54 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:48.757510 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4392d38-754c-4ec9-8c8d-bcbab1026d54 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:48.757784 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4392d38-754c-4ec9-8c8d-bcbab1026d54 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:48.758481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4392d38-754c-4ec9-8c8d-bcbab1026d54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:48.758784 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4392d38-754c-4ec9-8c8d-bcbab1026d54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:48.760328 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4392d38-754c-4ec9-8c8d-bcbab1026d54 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:48.774559 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 301/606] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:33:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:48.775488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4392d38-754c-4ec9-8c8d-bcbab1026d54 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:48.789292 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:48.851770 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4c883-43aa-4736-907f-5122fcee8f18 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:48.881472 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4392d38-754c-4ec9-8c8d-bcbab1026d54 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:48.900644 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1212135-73c5-4d98-973d-1082aa3f3d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:48.901883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1212135-73c5-4d98-973d-1082aa3f3d97 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:48.902308 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1212135-73c5-4d98-973d-1082aa3f3d97 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:48.902722 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1212135-73c5-4d98-973d-1082aa3f3d97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:48.919482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1212135-73c5-4d98-973d-1082aa3f3d97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:48.924740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e818e35-0b10-410c-b546-67214295ee38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:48.925512 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e818e35-0b10-410c-b546-67214295ee38 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:48.925934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e818e35-0b10-410c-b546-67214295ee38 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:48.926245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-a1212135-73c5-4d98-973d-1082aa3f3d97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:48.926245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:48.926245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:48.926245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:48.926245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:48.926245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:48.926245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:48.926245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:48.926245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:48.926245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:48.926245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:48.926245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:48.926245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:48.926245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:48.926245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:48.926245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:48.927339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:48.927339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:48.927339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:48.927339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:48.927339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:48.927339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:48.927339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:48.927339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:48.927339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:48.927339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:48.927339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:48.927339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:48.927339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:48.927339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:48.927339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:48.927339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:48.928380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:48.928380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:48.928380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:48.928380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:48.928380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:48.928380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:48.928380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:48.928380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:48.928380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:48.928380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:48.928380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:48.928380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:48.929503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e818e35-0b10-410c-b546-67214295ee38 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:48.930339 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e818e35-0b10-410c-b546-67214295ee38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:48.930836 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e818e35-0b10-410c-b546-67214295ee38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:48.932457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e818e35-0b10-410c-b546-67214295ee38 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:48.935036 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 306/607] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:33:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:48.935954 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1212135-73c5-4d98-973d-1082aa3f3d97 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:48.954070 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 302/608] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:33:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:48.954070 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e818e35-0b10-410c-b546-67214295ee38 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:48.995876 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:49.046850 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1212135-73c5-4d98-973d-1082aa3f3d97 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:49.063524 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:49.070365 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e818e35-0b10-410c-b546-67214295ee38 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:49.082705 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220341d-fb8a-41fc-b160-a0d5f8fee46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:49.083483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220341d-fb8a-41fc-b160-a0d5f8fee46e None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:49.083860 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220341d-fb8a-41fc-b160-a0d5f8fee46e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:49.084280 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220341d-fb8a-41fc-b160-a0d5f8fee46e None admin] PATH_INFO: `/v3/projects/cd477d464e9f48149879362d04db9b9e/users/133c5864d9544973a30ff77866522f15/roles/295de8f316124ccdac36a50e50531148` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:49.100194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220341d-fb8a-41fc-b160-a0d5f8fee46e None admin] RBAC: Authorizing `identity:create_grant(project_id=cd477d464e9f48149879362d04db9b9e, user_id=133c5864d9544973a30ff77866522f15, role_id=295de8f316124ccdac36a50e50531148)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:49.101937 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220341d-fb8a-41fc-b160-a0d5f8fee46e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:49.111948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ea05a-fa24-4196-bc49-015c04a164e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:49.112921 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ea05a-fa24-4196-bc49-015c04a164e1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:49.113440 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ea05a-fa24-4196-bc49-015c04a164e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:49.113961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ea05a-fa24-4196-bc49-015c04a164e1 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:49.114973 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ea05a-fa24-4196-bc49-015c04a164e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:49.115532 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ea05a-fa24-4196-bc49-015c04a164e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:49.117259 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ea05a-fa24-4196-bc49-015c04a164e1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:49.118000 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 307/609] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:33:48 2022] PUT /identity/v3/projects/cd477d464e9f48149879362d04db9b9e/users/133c5864d9544973a30ff77866522f15/roles/295de8f316124ccdac36a50e50531148 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:33:49.118905 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220341d-fb8a-41fc-b160-a0d5f8fee46e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:49.128788 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 303/610] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:33:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:49.134854 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ea05a-fa24-4196-bc49-015c04a164e1 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:49.231135 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220341d-fb8a-41fc-b160-a0d5f8fee46e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:49.252194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:49.256775 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ea05a-fa24-4196-bc49-015c04a164e1 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:49.269236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7c184-629a-4b4d-86c5-deb45716a73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:49.270001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7c184-629a-4b4d-86c5-deb45716a73b None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:49.270345 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7c184-629a-4b4d-86c5-deb45716a73b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:49.270688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7c184-629a-4b4d-86c5-deb45716a73b None admin] PATH_INFO: `/v3/projects/cd477d464e9f48149879362d04db9b9e/users/caa0d9fe3d4942be8901876e57d1e561/roles/295de8f316124ccdac36a50e50531148` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:49.287113 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7c184-629a-4b4d-86c5-deb45716a73b None admin] RBAC: Authorizing `identity:create_grant(project_id=cd477d464e9f48149879362d04db9b9e, user_id=caa0d9fe3d4942be8901876e57d1e561, role_id=295de8f316124ccdac36a50e50531148)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:49.288662 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7c184-629a-4b4d-86c5-deb45716a73b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:49.304881 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205eb47-9a6f-4312-b861-fb2f9539d72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:49.306725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205eb47-9a6f-4312-b861-fb2f9539d72d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:49.307108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205eb47-9a6f-4312-b861-fb2f9539d72d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:49.308129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205eb47-9a6f-4312-b861-fb2f9539d72d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:49.319639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 308/611] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:33:49 2022] PUT /identity/v3/projects/cd477d464e9f48149879362d04db9b9e/users/caa0d9fe3d4942be8901876e57d1e561/roles/295de8f316124ccdac36a50e50531148 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:33:49.341854 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205eb47-9a6f-4312-b861-fb2f9539d72d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:49.343360 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205eb47-9a6f-4312-b861-fb2f9539d72d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:49.366765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-e205eb47-9a6f-4312-b861-fb2f9539d72d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:49.366765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:49.366765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:49.366765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:49.366765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:49.366765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:49.366765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:49.366765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:49.366765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:49.366765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:49.366765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:49.366765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:49.366765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:49.366765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:49.366765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:49.366765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:49.367758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:49.367758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:49.367758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:49.367758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:49.367758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:49.367758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:49.367758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:49.367758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:49.367758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:49.367758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:49.367758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:49.367758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:49.367758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:49.367758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:49.367758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:49.367758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:49.367758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:49.369283 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:49.369283 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:49.369283 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:49.369283 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 304/612] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:49.374027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7c184-629a-4b4d-86c5-deb45716a73b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:49.401382 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:49.514307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7c184-629a-4b4d-86c5-deb45716a73b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:49.551645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f300f-3fb8-4512-b54a-a769f74e37ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:49.552675 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f300f-3fb8-4512-b54a-a769f74e37ec None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:49.553160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f300f-3fb8-4512-b54a-a769f74e37ec None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:49.553630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f300f-3fb8-4512-b54a-a769f74e37ec None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:49.554511 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f300f-3fb8-4512-b54a-a769f74e37ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:49.555051 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f300f-3fb8-4512-b54a-a769f74e37ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:49.556626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f300f-3fb8-4512-b54a-a769f74e37ec None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:49.570020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 309/613] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:49.576608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205eb47-9a6f-4312-b861-fb2f9539d72d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:49.709881 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205eb47-9a6f-4312-b861-fb2f9539d72d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:49.756022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ce69f-96e1-4c65-995b-8241a5d4bd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:49.757061 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ce69f-96e1-4c65-995b-8241a5d4bd1c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:49.757567 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ce69f-96e1-4c65-995b-8241a5d4bd1c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:49.758059 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ce69f-96e1-4c65-995b-8241a5d4bd1c None admin] PATH_INFO: `/v3/users/swift` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:49.770468 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ce69f-96e1-4c65-995b-8241a5d4bd1c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:49.772192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ce69f-96e1-4c65-995b-8241a5d4bd1c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:49.788108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-e22ce69f-96e1-4c65-995b-8241a5d4bd1c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 10:33:49.788108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:49.788108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:49.788108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:49.788108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:49.788108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:49.788108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:49.788108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:49.788108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:49.788108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:49.788108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:49.788108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:49.788108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:33:49.788108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:33:49.788108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:33:49.788108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:33:49.789134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:49.789134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:49.789134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:33:49.789134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:49.789134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:33:49.789134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:49.789134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:49.789134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:49.789134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:49.789134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:49.789134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:49.789134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:49.789134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:49.789134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:49.789134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:49.789134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:49.789134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:49.789134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:49.790075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:49.790075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:49.790075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:33:49.790075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:33:49.790075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:33:49.790075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:33:49.790075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:33:49.790075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:33:49.790075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 10:33:49.790075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:49.792255 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 305/614] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:33:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:49.797895 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f300f-3fb8-4512-b54a-a769f74e37ec None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:49.823230 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86e67e-0e1a-490a-8d66-0b7895fe8c59 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:49.823553 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86e67e-0e1a-490a-8d66-0b7895fe8c59 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:49.823785 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86e67e-0e1a-490a-8d66-0b7895fe8c59 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:49.825454 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 306/615] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:33:49.831393 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d7a92-e434-4645-82de-826932be8789 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:49.831933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d7a92-e434-4645-82de-826932be8789 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:49.832395 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d7a92-e434-4645-82de-826932be8789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:49.853121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-780d7a92-e434-4645-82de-826932be8789 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:49.854941 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-780d7a92-e434-4645-82de-826932be8789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:49.858263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:49.934884 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:49.975853 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f300f-3fb8-4512-b54a-a769f74e37ec None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:49.978251 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 307/616] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:33:50.043593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595c978-661c-4a03-aec9-da757731e086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:50.044612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595c978-661c-4a03-aec9-da757731e086 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:50.045086 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595c978-661c-4a03-aec9-da757731e086 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:50.045563 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595c978-661c-4a03-aec9-da757731e086 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:50.046495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595c978-661c-4a03-aec9-da757731e086 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:50.047013 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595c978-661c-4a03-aec9-da757731e086 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:50.056781 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595c978-661c-4a03-aec9-da757731e086 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:50.081703 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 310/617] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Sep 11 10:33:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:50.088245 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d7a92-e434-4645-82de-826932be8789 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:50.240506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d7a92-e434-4645-82de-826932be8789 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:50.287028 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53546de4-8640-414c-9f25-cab5f0c48580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:50.287680 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53546de4-8640-414c-9f25-cab5f0c48580 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:50.287962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53546de4-8640-414c-9f25-cab5f0c48580 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:50.288238 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53546de4-8640-414c-9f25-cab5f0c48580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:50.297466 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:50.302629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53546de4-8640-414c-9f25-cab5f0c48580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:50.304290 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53546de4-8640-414c-9f25-cab5f0c48580 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:50.324296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-53546de4-8640-414c-9f25-cab5f0c48580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:50.324296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:50.324296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:50.324296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:50.324296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:50.324296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:50.324296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:50.324296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:50.324296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:50.324296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:50.324296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:50.324296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:50.324296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:50.324296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:50.324296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:50.324296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:50.325342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:50.325342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:50.325342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:50.325342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:50.325342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:50.325342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:50.325342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:50.325342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:50.325342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:50.325342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:50.325342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:50.325342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:50.325342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:50.325342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:50.325342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:50.325342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:50.325342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:50.326265 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:50.326265 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:50.326265 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:50.329966 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 308/618] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:50.333230 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595c978-661c-4a03-aec9-da757731e086 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:50.335025 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53546de4-8640-414c-9f25-cab5f0c48580 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:50.485829 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595c978-661c-4a03-aec9-da757731e086 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:50.530248 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa16f0-7a2e-4692-b493-d20795d167cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:50.530895 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53546de4-8640-414c-9f25-cab5f0c48580 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:50.531502 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa16f0-7a2e-4692-b493-d20795d167cc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:50.532013 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa16f0-7a2e-4692-b493-d20795d167cc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:50.532654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa16f0-7a2e-4692-b493-d20795d167cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:50.541294 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:50.549741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa16f0-7a2e-4692-b493-d20795d167cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:50.555645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-82fa16f0-7a2e-4692-b493-d20795d167cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:50.555645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:50.555645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:50.555645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:50.555645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:50.555645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:50.555645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:50.555645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:50.555645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:50.555645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:50.555645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:50.555645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:50.555645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:50.555645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:50.555645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:50.555645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:50.556790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:50.556790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:50.556790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:50.556790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:50.556790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:50.556790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:50.556790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:50.556790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:50.556790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:50.556790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:50.556790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:50.556790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:50.556790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:50.556790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:50.556790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:50.556790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:50.557613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:50.557613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:50.557613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:50.557613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:50.557613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:50.557613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:50.557613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:50.557613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:50.557613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:50.557613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:50.557613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:50.557613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:50.560210 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 311/619] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:33:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:50.567150 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa16f0-7a2e-4692-b493-d20795d167cc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:50.638702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd21195-aa23-4d94-b069-a404b118733e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:50.639843 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd21195-aa23-4d94-b069-a404b118733e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:50.641473 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd21195-aa23-4d94-b069-a404b118733e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:50.641962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd21195-aa23-4d94-b069-a404b118733e None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:50.643583 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd21195-aa23-4d94-b069-a404b118733e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:50.644902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd21195-aa23-4d94-b069-a404b118733e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:50.649075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd21195-aa23-4d94-b069-a404b118733e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:50.663024 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 309/620] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:50.664528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b88c78-8135-4152-91af-285dacf61f9b None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:50.664979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b88c78-8135-4152-91af-285dacf61f9b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:50.665356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b88c78-8135-4152-91af-285dacf61f9b None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:50.670921 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 310/621] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:50.671740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b88c78-8135-4152-91af-285dacf61f9b None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:50.679812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa16f0-7a2e-4692-b493-d20795d167cc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:50.731346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf91cd-c64d-47c5-beb7-fc96011fcb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:50.731961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf91cd-c64d-47c5-beb7-fc96011fcb0e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:50.732289 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf91cd-c64d-47c5-beb7-fc96011fcb0e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:50.732594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf91cd-c64d-47c5-beb7-fc96011fcb0e None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:50.733269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf91cd-c64d-47c5-beb7-fc96011fcb0e None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:50.733572 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf91cd-c64d-47c5-beb7-fc96011fcb0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:50.735726 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:50.736177 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf91cd-c64d-47c5-beb7-fc96011fcb0e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:50.745916 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 312/622] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:33:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:50.751867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204ad3b-cc67-45cb-8b59-f6da2b9ea443 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:50.752382 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204ad3b-cc67-45cb-8b59-f6da2b9ea443 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:50.753002 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204ad3b-cc67-45cb-8b59-f6da2b9ea443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:50.771743 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4204ad3b-cc67-45cb-8b59-f6da2b9ea443 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:50.772976 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4204ad3b-cc67-45cb-8b59-f6da2b9ea443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:50.790704 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b88c78-8135-4152-91af-285dacf61f9b None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:50.828755 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384591d-b3cd-42b4-bbd0-842308074210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:50.829441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384591d-b3cd-42b4-bbd0-842308074210 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:50.829724 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384591d-b3cd-42b4-bbd0-842308074210 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:50.830587 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384591d-b3cd-42b4-bbd0-842308074210 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:50.838138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384591d-b3cd-42b4-bbd0-842308074210 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:50.839814 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384591d-b3cd-42b4-bbd0-842308074210 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:50.840052 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 313/623] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:50.841013 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:50.849938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204ad3b-cc67-45cb-8b59-f6da2b9ea443 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:50.869057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-f384591d-b3cd-42b4-bbd0-842308074210 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:50.869057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:50.869057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:50.869057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:50.869057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:50.869057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:50.869057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:50.869057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:50.869057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:50.869057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:50.869057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:50.869057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:50.869057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:33:50.869057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:33:50.869057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:33:50.870003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:33:50.870003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:50.870003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:50.870003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:50.870003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:50.870003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:50.870003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:50.870003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:50.870003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:50.870003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:50.870003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:50.870003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:50.870003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:50.870003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:50.870003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:50.870003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:50.870003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:50.870882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:33:50.870882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:33:50.870882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:33:50.870882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:33:50.870882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:33:50.870882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:33:50.870882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:50.870882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:50.874607 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 311/624] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:50.875636 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384591d-b3cd-42b4-bbd0-842308074210 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:50.957394 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204ad3b-cc67-45cb-8b59-f6da2b9ea443 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:51.018161 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d905d-e8e3-41a1-820c-860d87ac3c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:51.019183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d905d-e8e3-41a1-820c-860d87ac3c9d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:51.019999 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d905d-e8e3-41a1-820c-860d87ac3c9d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:51.020853 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d905d-e8e3-41a1-820c-860d87ac3c9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:51.041306 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d905d-e8e3-41a1-820c-860d87ac3c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:51.043266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d905d-e8e3-41a1-820c-860d87ac3c9d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:51.061850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384591d-b3cd-42b4-bbd0-842308074210 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:51.072650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-549d905d-e8e3-41a1-820c-860d87ac3c9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:51.072650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:51.072650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:51.072650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:51.072650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:51.072650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:51.072650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:51.072650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:51.072650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:51.072650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:51.072650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:51.072650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:51.072650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:51.072650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:51.072650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:51.072650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:51.073658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:51.073658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:51.073658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:51.073658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:51.073658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:51.073658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:51.073658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:51.073658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:51.073658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:51.073658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:51.073658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:51.073658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:51.073658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:51.073658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:51.073658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:51.073658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:51.073658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:51.074530 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:51.074530 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:51.074530 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:51.079102 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 314/625] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:51.084673 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d905d-e8e3-41a1-820c-860d87ac3c9d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:51.088870 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:51.116360 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a39a36-b99c-4ff6-800f-a11bd114dac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:51.117354 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a39a36-b99c-4ff6-800f-a11bd114dac3 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:51.117854 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a39a36-b99c-4ff6-800f-a11bd114dac3 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:51.118203 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a39a36-b99c-4ff6-800f-a11bd114dac3 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:51.118980 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a39a36-b99c-4ff6-800f-a11bd114dac3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:51.119349 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a39a36-b99c-4ff6-800f-a11bd114dac3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:51.121126 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a39a36-b99c-4ff6-800f-a11bd114dac3 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:51.136269 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 312/626] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:33:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:51.142244 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a39a36-b99c-4ff6-800f-a11bd114dac3 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:51.153364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:51.259420 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d905d-e8e3-41a1-820c-860d87ac3c9d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:51.277645 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a39a36-b99c-4ff6-800f-a11bd114dac3 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:51.300533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49fee0-2119-4179-8fc3-32651b0987b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:51.301089 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49fee0-2119-4179-8fc3-32651b0987b0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:51.301365 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49fee0-2119-4179-8fc3-32651b0987b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:51.301633 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49fee0-2119-4179-8fc3-32651b0987b0 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:51.302277 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49fee0-2119-4179-8fc3-32651b0987b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:51.302575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49fee0-2119-4179-8fc3-32651b0987b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:51.304088 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49fee0-2119-4179-8fc3-32651b0987b0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:51.317818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 315/627] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:51.318654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49fee0-2119-4179-8fc3-32651b0987b0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:51.319717 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a1648-e239-457e-86f3-9da7b32c93f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:51.320445 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a1648-e239-457e-86f3-9da7b32c93f2 None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:51.320814 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a1648-e239-457e-86f3-9da7b32c93f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:51.321414 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a1648-e239-457e-86f3-9da7b32c93f2 None admin] PATH_INFO: `/v3/projects/cd477d464e9f48149879362d04db9b9e/users/28ff72290fd14ddaba6ed757051e182b/roles/295de8f316124ccdac36a50e50531148` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:51.342381 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a1648-e239-457e-86f3-9da7b32c93f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd477d464e9f48149879362d04db9b9e, user_id=28ff72290fd14ddaba6ed757051e182b, role_id=295de8f316124ccdac36a50e50531148)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:51.344195 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a1648-e239-457e-86f3-9da7b32c93f2 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:51.362240 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 313/628] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:33:51 2022] PUT /identity/v3/projects/cd477d464e9f48149879362d04db9b9e/users/28ff72290fd14ddaba6ed757051e182b/roles/295de8f316124ccdac36a50e50531148 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:33:51.363624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a1648-e239-457e-86f3-9da7b32c93f2 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:51.393608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:51.482056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:51.489954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a1648-e239-457e-86f3-9da7b32c93f2 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:51.490501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49fee0-2119-4179-8fc3-32651b0987b0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:51.533517 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f903a-99e5-4ff5-97a9-cc7a9f8a095c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:51.534176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f903a-99e5-4ff5-97a9-cc7a9f8a095c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:51.534464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f903a-99e5-4ff5-97a9-cc7a9f8a095c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:51.534739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f903a-99e5-4ff5-97a9-cc7a9f8a095c None admin] PATH_INFO: `/v3/users/glance` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:51.543773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f903a-99e5-4ff5-97a9-cc7a9f8a095c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:51.545289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f903a-99e5-4ff5-97a9-cc7a9f8a095c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:51.560074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-259f903a-99e5-4ff5-97a9-cc7a9f8a095c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 10:33:51.560074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:51.560074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:51.560074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:51.560074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:51.560074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:51.560074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:51.560074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:51.560074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:51.560074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:51.560074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:51.560074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:51.560074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:33:51.560074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:33:51.560074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:33:51.560074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:33:51.561202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:51.561202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:51.561202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:33:51.561202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:51.561202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:33:51.561202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:51.561202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:51.561202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:51.561202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:51.561202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:51.561202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:51.561202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:51.561202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:51.561202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:51.561202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:51.561202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:51.561202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:51.561202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:51.562745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:51.562745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:51.562745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:33:51.562745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:33:51.562745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:33:51.562745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:33:51.562745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:33:51.562745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:33:51.562745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 10:33:51.562745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:51.562745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 314/629] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:51.567947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f903a-99e5-4ff5-97a9-cc7a9f8a095c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:51.588960 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e571d-7c2b-4963-bd9e-b42f6dc9cb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:51.589900 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e571d-7c2b-4963-bd9e-b42f6dc9cb8a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:51.590392 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e571d-7c2b-4963-bd9e-b42f6dc9cb8a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:51.590844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e571d-7c2b-4963-bd9e-b42f6dc9cb8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:51.623651 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e571d-7c2b-4963-bd9e-b42f6dc9cb8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:51.629034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-639e571d-7c2b-4963-bd9e-b42f6dc9cb8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:51.629034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:51.629034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:51.629034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:51.629034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:51.629034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:51.629034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:51.629034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:51.629034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:51.629034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:51.629034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:51.629034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:51.629034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:51.629034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:51.629034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:51.629034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:51.629950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:51.629950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:51.629950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:51.629950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:51.629950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:51.629950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:51.629950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:51.629950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:51.629950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:51.629950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:51.629950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:51.629950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:51.629950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:51.629950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:51.629950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:51.629950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:51.630766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:51.630766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:51.630766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:51.630766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:51.630766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:51.630766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:51.630766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:51.630766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:51.630766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:51.630766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:51.630766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:51.630766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:51.638120 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 316/630] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:33:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:51.647089 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e571d-7c2b-4963-bd9e-b42f6dc9cb8a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:51.668457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:51.695846 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f903a-99e5-4ff5-97a9-cc7a9f8a095c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:51.753290 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b0c77-6697-4423-bb6b-4c5688e1ca5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:51.753957 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b0c77-6697-4423-bb6b-4c5688e1ca5d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:51.754179 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b0c77-6697-4423-bb6b-4c5688e1ca5d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:51.754450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b0c77-6697-4423-bb6b-4c5688e1ca5d None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:51.755187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b0c77-6697-4423-bb6b-4c5688e1ca5d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:51.755492 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b0c77-6697-4423-bb6b-4c5688e1ca5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:51.756975 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b0c77-6697-4423-bb6b-4c5688e1ca5d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:51.777438 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e571d-7c2b-4963-bd9e-b42f6dc9cb8a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:51.811010 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 315/631] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Sep 11 10:33:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:51.817173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b0c77-6697-4423-bb6b-4c5688e1ca5d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:51.819035 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef45387-77b9-4852-a29b-e237f6801b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:51.819653 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef45387-77b9-4852-a29b-e237f6801b59 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:51.819931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef45387-77b9-4852-a29b-e237f6801b59 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:51.820205 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef45387-77b9-4852-a29b-e237f6801b59 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:51.821067 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef45387-77b9-4852-a29b-e237f6801b59 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:51.821377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef45387-77b9-4852-a29b-e237f6801b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:51.822748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef45387-77b9-4852-a29b-e237f6801b59 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:51.832487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 317/632] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:33:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:51.833966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd7f8e-81e0-4395-9d58-2509d64183a7 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:51.834258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd7f8e-81e0-4395-9d58-2509d64183a7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:51.834535 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd7f8e-81e0-4395-9d58-2509d64183a7 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:51.835991 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 318/633] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:51.839190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd7f8e-81e0-4395-9d58-2509d64183a7 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:51.870925 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:51.958966 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b0c77-6697-4423-bb6b-4c5688e1ca5d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:51.959214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd7f8e-81e0-4395-9d58-2509d64183a7 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:51.993170 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ec30e-cf76-42de-9041-222b4be996c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:51.993784 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ec30e-cf76-42de-9041-222b4be996c3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:51.994061 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ec30e-cf76-42de-9041-222b4be996c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:51.994486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ec30e-cf76-42de-9041-222b4be996c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:52.002420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5012f-3803-492f-9b7e-94b59a0d723c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:52.003023 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5012f-3803-492f-9b7e-94b59a0d723c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:52.003298 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5012f-3803-492f-9b7e-94b59a0d723c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:52.003565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5012f-3803-492f-9b7e-94b59a0d723c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:52.006221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ec30e-cf76-42de-9041-222b4be996c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:52.007652 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ec30e-cf76-42de-9041-222b4be996c3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:52.014597 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:52.023663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-629ec30e-cf76-42de-9041-222b4be996c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:52.023663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:52.023663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:52.023663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:52.023663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:52.023663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:52.023663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:52.023663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:52.023663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:52.023663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:52.023663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:52.023663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:52.023663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:52.023663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:52.023663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:52.023663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:52.024671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:52.024671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:52.024671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:52.024671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:52.024671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:52.024671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:52.024671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:52.024671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:52.024671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:52.024671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:52.024671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:52.024671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:52.024671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:52.024671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:52.024671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:52.024671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:52.024671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:52.025571 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:52.025571 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:52.025571 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:52.025571 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 319/634] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:52.026543 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb621ef-bf75-48e0-9504-c63728337bcb None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:52.026543 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb621ef-bf75-48e0-9504-c63728337bcb None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:52.026543 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb621ef-bf75-48e0-9504-c63728337bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:52.045831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-afb621ef-bf75-48e0-9504-c63728337bcb None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:52.046747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-afb621ef-bf75-48e0-9504-c63728337bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:52.081773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5012f-3803-492f-9b7e-94b59a0d723c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:52.083230 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5012f-3803-492f-9b7e-94b59a0d723c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:52.120370 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 320/635] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:52.121675 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a7893-ee25-4e36-a937-b8a4191eb569 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:52.121960 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a7893-ee25-4e36-a937-b8a4191eb569 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:52.122233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a7893-ee25-4e36-a937-b8a4191eb569 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:52.127700 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 321/636] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:52.127700 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a7893-ee25-4e36-a937-b8a4191eb569 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:52.133028 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:52.195452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 316/637] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 10:33:52.197119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e703a-f293-4ed7-b761-9309e189b406 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:52.197606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e703a-f293-4ed7-b761-9309e189b406 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:52.198105 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e703a-f293-4ed7-b761-9309e189b406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:52.216899 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-ce9e703a-f293-4ed7-b761-9309e189b406 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:52.218436 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ce9e703a-f293-4ed7-b761-9309e189b406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:52.250842 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a7893-ee25-4e36-a937-b8a4191eb569 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:52.265952 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:52.287768 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededa9a7-c1f6-423e-82aa-0970cf4c762b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:52.288777 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededa9a7-c1f6-423e-82aa-0970cf4c762b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:52.289272 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededa9a7-c1f6-423e-82aa-0970cf4c762b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:52.289827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededa9a7-c1f6-423e-82aa-0970cf4c762b None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:52.290686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededa9a7-c1f6-423e-82aa-0970cf4c762b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:52.291198 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededa9a7-c1f6-423e-82aa-0970cf4c762b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:52.292873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededa9a7-c1f6-423e-82aa-0970cf4c762b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:52.307101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 322/638] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:52.308205 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededa9a7-c1f6-423e-82aa-0970cf4c762b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:52.312679 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 317/639] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:52.313540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e703a-f293-4ed7-b761-9309e189b406 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:52.413505 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:52.451836 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e703a-f293-4ed7-b761-9309e189b406 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:52.469267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededa9a7-c1f6-423e-82aa-0970cf4c762b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:52.489868 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a30524-388b-4d3c-94a5-fc648170d817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:52.490471 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a30524-388b-4d3c-94a5-fc648170d817 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:52.490881 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a30524-388b-4d3c-94a5-fc648170d817 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:52.491279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a30524-388b-4d3c-94a5-fc648170d817 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:52.499727 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a30524-388b-4d3c-94a5-fc648170d817 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:52.502259 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a30524-388b-4d3c-94a5-fc648170d817 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:52.513319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f16bc-533d-4d65-a7d3-2b134473bd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:52.514264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f16bc-533d-4d65-a7d3-2b134473bd01 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:52.514928 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f16bc-533d-4d65-a7d3-2b134473bd01 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:52.515412 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f16bc-533d-4d65-a7d3-2b134473bd01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:52.515596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-30a30524-388b-4d3c-94a5-fc648170d817 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 10:33:52.515596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:52.515596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:52.515596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:52.515596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:52.515596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:52.515596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:52.515596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:52.515596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:52.515596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:52.515596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:52.515596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:52.515596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:33:52.515596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:33:52.515596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:33:52.515596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:33:52.516809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:52.516809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:52.516809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:33:52.516809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:52.516809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:33:52.516809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:52.516809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:52.516809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:52.516809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:52.516809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:52.516809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:52.516809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:52.516809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:52.516809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:52.516809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:52.516809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:52.516809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:52.516809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:52.517866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:52.517866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:52.517866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:33:52.517866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:33:52.517866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:33:52.517866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:33:52.517866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:33:52.517866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:33:52.517866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 10:33:52.517866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:52.517866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 318/640] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Sep 11 10:33:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:52.518466 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a30524-388b-4d3c-94a5-fc648170d817 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:52.532419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f16bc-533d-4d65-a7d3-2b134473bd01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:52.535259 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f16bc-533d-4d65-a7d3-2b134473bd01 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:52.553600 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:52.562356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-141f16bc-533d-4d65-a7d3-2b134473bd01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:52.562356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:52.562356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:52.562356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:52.562356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:52.562356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:52.562356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:52.562356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:52.562356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:52.562356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:52.562356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:52.562356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:52.562356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:52.562356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:52.562356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:52.562356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:52.563317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:52.563317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:52.563317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:52.563317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:52.563317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:52.563317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:52.563317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:52.563317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:52.563317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:52.563317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:52.563317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:52.563317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:52.563317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:52.563317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:52.563317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:52.563317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:52.563317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:52.564761 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:52.564761 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:52.564761 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:52.567885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 323/641] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:52.568731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f16bc-533d-4d65-a7d3-2b134473bd01 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:52.633457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a30524-388b-4d3c-94a5-fc648170d817 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:52.667263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f16bc-533d-4d65-a7d3-2b134473bd01 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:52.669123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa1a9e-71e7-4179-b72e-0b525af5172d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:52.669857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa1a9e-71e7-4179-b72e-0b525af5172d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:52.670273 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa1a9e-71e7-4179-b72e-0b525af5172d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:52.670653 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa1a9e-71e7-4179-b72e-0b525af5172d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:52.681183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:52.682672 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa1a9e-71e7-4179-b72e-0b525af5172d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:52.688205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-50aa1a9e-71e7-4179-b72e-0b525af5172d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:52.688205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:52.688205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:52.688205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:52.688205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:52.688205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:52.688205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:52.688205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:52.688205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:52.688205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:52.688205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:52.688205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:52.688205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:52.688205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:52.688205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:52.688205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:52.689932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:52.689932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:52.689932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:52.689932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:52.689932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:52.689932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:52.689932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:52.689932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:52.689932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:52.689932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:52.689932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:52.689932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:52.689932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:52.689932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:52.689932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:52.689932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:52.690774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:52.690774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:52.690774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:52.690774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:52.690774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:52.690774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:52.690774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:52.690774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:52.690774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:52.690774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:52.690774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:52.690774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:52.690774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 319/642] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:33:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:52.691565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa1a9e-71e7-4179-b72e-0b525af5172d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:52.714459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa3b98-d6de-479f-a5a1-b34223f01fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:52.715331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa3b98-d6de-479f-a5a1-b34223f01fd6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:52.715609 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa3b98-d6de-479f-a5a1-b34223f01fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:52.715904 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa3b98-d6de-479f-a5a1-b34223f01fd6 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:52.716674 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa3b98-d6de-479f-a5a1-b34223f01fd6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:52.716982 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa3b98-d6de-479f-a5a1-b34223f01fd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:52.718440 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa3b98-d6de-479f-a5a1-b34223f01fd6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:52.738944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 324/643] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Sep 11 10:33:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:52.740511 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa3b98-d6de-479f-a5a1-b34223f01fd6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:52.790103 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:52.804473 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa1a9e-71e7-4179-b72e-0b525af5172d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:52.845988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa3b98-d6de-479f-a5a1-b34223f01fd6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:52.849225 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4d2a0-0409-482b-91fa-8aae51731244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:52.849909 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4d2a0-0409-482b-91fa-8aae51731244 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:52.850251 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4d2a0-0409-482b-91fa-8aae51731244 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:52.850588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4d2a0-0409-482b-91fa-8aae51731244 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:52.851304 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4d2a0-0409-482b-91fa-8aae51731244 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:52.851675 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4d2a0-0409-482b-91fa-8aae51731244 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:52.853144 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4d2a0-0409-482b-91fa-8aae51731244 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:52.871960 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 320/644] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:52.871960 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4d2a0-0409-482b-91fa-8aae51731244 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:52.886374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878f078-cfa7-4321-a7a7-e1484356ba9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:52.887006 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878f078-cfa7-4321-a7a7-e1484356ba9e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:52.887284 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878f078-cfa7-4321-a7a7-e1484356ba9e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:52.887551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878f078-cfa7-4321-a7a7-e1484356ba9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:52.899350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878f078-cfa7-4321-a7a7-e1484356ba9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:52.904720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-c878f078-cfa7-4321-a7a7-e1484356ba9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:52.904720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:52.904720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:52.904720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:52.904720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:52.904720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:52.904720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:52.904720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:52.904720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:52.904720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:52.904720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:52.904720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:52.904720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:52.904720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:52.904720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:52.904720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:52.905812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:52.905812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:52.905812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:52.905812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:52.905812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:52.905812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:52.905812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:52.905812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:52.905812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:52.905812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:52.905812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:52.905812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:52.905812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:52.905812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:52.905812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:52.905812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:52.907263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:52.907263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:52.907263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:52.907263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:52.907263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:52.907263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:52.907263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:52.907263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:52.907263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:52.907263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:52.907263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:52.907263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:52.907263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 325/645] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:33:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:52.907263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878f078-cfa7-4321-a7a7-e1484356ba9e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:52.938098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:52.979354 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4d2a0-0409-482b-91fa-8aae51731244 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:53.008791 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878f078-cfa7-4321-a7a7-e1484356ba9e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:53.014330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb1c4b-adb9-48d7-8843-ba4a62a9f49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:53.015083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb1c4b-adb9-48d7-8843-ba4a62a9f49c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:53.015427 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb1c4b-adb9-48d7-8843-ba4a62a9f49c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:53.015850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb1c4b-adb9-48d7-8843-ba4a62a9f49c None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:53.016606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb1c4b-adb9-48d7-8843-ba4a62a9f49c None admin] RBAC: Adding query filter params (name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:53.016977 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb1c4b-adb9-48d7-8843-ba4a62a9f49c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:53.019150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb1c4b-adb9-48d7-8843-ba4a62a9f49c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:53.032287 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 321/646] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:33:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:53.032287 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb1c4b-adb9-48d7-8843-ba4a62a9f49c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:53.043242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:53.048137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e67e3-847a-4b60-a9af-4c3a52aa1006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:53.049390 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e67e3-847a-4b60-a9af-4c3a52aa1006 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:53.049767 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e67e3-847a-4b60-a9af-4c3a52aa1006 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:53.050141 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e67e3-847a-4b60-a9af-4c3a52aa1006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:53.123931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e67e3-847a-4b60-a9af-4c3a52aa1006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:53.125413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e67e3-847a-4b60-a9af-4c3a52aa1006 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:53.129689 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb1c4b-adb9-48d7-8843-ba4a62a9f49c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:53.154912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:53.167043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0228052-7cfb-41c6-8a8b-48b990887f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:53.167703 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0228052-7cfb-41c6-8a8b-48b990887f31 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:53.168419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0228052-7cfb-41c6-8a8b-48b990887f31 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:53.168892 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0228052-7cfb-41c6-8a8b-48b990887f31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:53.176778 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0228052-7cfb-41c6-8a8b-48b990887f31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:53.178234 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0228052-7cfb-41c6-8a8b-48b990887f31 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:53.190088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-d0228052-7cfb-41c6-8a8b-48b990887f31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:53.190088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:53.190088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:53.190088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:53.190088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:53.190088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:53.190088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:53.190088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:53.190088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:53.190088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:53.190088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:53.190088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:53.190088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:33:53.190088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:33:53.190088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:33:53.191199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:33:53.191199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:53.191199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:53.191199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:53.191199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:53.191199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:53.191199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:53.191199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:53.191199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:53.191199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:53.191199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:53.191199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:53.191199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:53.191199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:53.191199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:53.191199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:53.191199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:53.192579 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:33:53.192579 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:33:53.192579 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:33:53.192579 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:33:53.192579 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:33:53.192579 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:33:53.192579 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:53.192579 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:53.192579 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 322/647] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:53.192579 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0228052-7cfb-41c6-8a8b-48b990887f31 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:53.232703 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 326/648] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:53.233967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e67e3-847a-4b60-a9af-4c3a52aa1006 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:53.274094 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:53.305684 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0228052-7cfb-41c6-8a8b-48b990887f31 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:53.338418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e67e3-847a-4b60-a9af-4c3a52aa1006 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:53.340619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567d305-e8fb-4c8f-acb6-19bc4cc4edf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:53.341558 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567d305-e8fb-4c8f-acb6-19bc4cc4edf8 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:53.341558 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567d305-e8fb-4c8f-acb6-19bc4cc4edf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:53.341732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567d305-e8fb-4c8f-acb6-19bc4cc4edf8 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:53.342387 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567d305-e8fb-4c8f-acb6-19bc4cc4edf8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:53.342686 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567d305-e8fb-4c8f-acb6-19bc4cc4edf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:53.344037 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567d305-e8fb-4c8f-acb6-19bc4cc4edf8 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:53.356984 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 323/649] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:33:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:53.356984 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567d305-e8fb-4c8f-acb6-19bc4cc4edf8 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:53.372733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:53.378988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6f386-e8a0-47c5-ab5d-17fa9acf7f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:53.380158 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6f386-e8a0-47c5-ab5d-17fa9acf7f40 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:53.380444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6f386-e8a0-47c5-ab5d-17fa9acf7f40 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:53.380889 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6f386-e8a0-47c5-ab5d-17fa9acf7f40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:53.393175 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6f386-e8a0-47c5-ab5d-17fa9acf7f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:53.394627 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6f386-e8a0-47c5-ab5d-17fa9acf7f40 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:53.409625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-25c6f386-e8a0-47c5-ab5d-17fa9acf7f40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:53.409625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:53.409625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:53.409625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:53.409625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:53.409625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:53.409625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:53.409625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:53.409625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:53.409625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:53.409625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:53.409625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:53.409625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:53.409625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:53.409625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:53.409625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:53.410595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:53.410595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:53.410595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:53.410595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:53.410595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:53.410595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:53.410595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:53.410595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:53.410595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:53.410595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:53.410595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:53.410595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:53.410595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:53.410595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:53.410595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:53.410595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:53.410595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:53.411473 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:53.411473 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:53.411473 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:53.411473 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 327/650] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:53.411473 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6f386-e8a0-47c5-ab5d-17fa9acf7f40 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:53.466760 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567d305-e8fb-4c8f-acb6-19bc4cc4edf8 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:53.501171 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e134a8-9c24-4fdb-9070-c6bb86026afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:53.502586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e134a8-9c24-4fdb-9070-c6bb86026afb None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:53.502924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e134a8-9c24-4fdb-9070-c6bb86026afb None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:53.503200 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e134a8-9c24-4fdb-9070-c6bb86026afb None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:53.503928 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e134a8-9c24-4fdb-9070-c6bb86026afb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:53.504239 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e134a8-9c24-4fdb-9070-c6bb86026afb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:53.506149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e134a8-9c24-4fdb-9070-c6bb86026afb None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:53.508263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:53.516712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6f386-e8a0-47c5-ab5d-17fa9acf7f40 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:53.520947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 324/651] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:33:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:53.521762 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e134a8-9c24-4fdb-9070-c6bb86026afb None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:53.553689 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e07d8-2219-4faf-a5d8-5b89f7b717f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:53.554322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e07d8-2219-4faf-a5d8-5b89f7b717f9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:53.554598 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e07d8-2219-4faf-a5d8-5b89f7b717f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:53.554864 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e07d8-2219-4faf-a5d8-5b89f7b717f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:53.566483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e07d8-2219-4faf-a5d8-5b89f7b717f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:53.567961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e07d8-2219-4faf-a5d8-5b89f7b717f9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:53.584246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-124e07d8-2219-4faf-a5d8-5b89f7b717f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:53.584246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:53.584246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:53.584246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:53.584246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:53.584246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:53.584246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:53.584246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:53.584246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:53.584246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:53.584246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:53.584246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:53.584246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:53.584246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:53.584246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:53.584246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:53.589001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:53.589001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:53.589001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:53.589001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:53.589001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:53.589001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:53.589001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:53.589001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:53.589001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:53.589001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:53.589001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:53.589001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:53.589001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:53.589001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:53.589001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:53.589001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:53.589001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:53.589895 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:53.589895 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:53.589895 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:53.589895 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 328/652] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:53.589895 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e07d8-2219-4faf-a5d8-5b89f7b717f9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:53.629980 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:53.649680 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e134a8-9c24-4fdb-9070-c6bb86026afb None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:53.686417 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec3134-e0d8-419e-a658-7531141c201b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:53.687073 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec3134-e0d8-419e-a658-7531141c201b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:53.687370 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec3134-e0d8-419e-a658-7531141c201b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:53.687618 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec3134-e0d8-419e-a658-7531141c201b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:53.698966 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec3134-e0d8-419e-a658-7531141c201b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:53.700433 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec3134-e0d8-419e-a658-7531141c201b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:53.703574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e07d8-2219-4faf-a5d8-5b89f7b717f9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:53.722972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-11ec3134-e0d8-419e-a658-7531141c201b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:53.722972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:53.722972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:53.722972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:53.722972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:53.722972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:53.722972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:53.722972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:53.722972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:53.722972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:53.722972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:53.722972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:53.722972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:53.722972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:53.722972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:53.722972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:53.723954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:53.723954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:53.723954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:53.723954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:53.723954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:53.723954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:53.723954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:53.723954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:53.723954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:53.723954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:53.723954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:53.723954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:53.723954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:53.723954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:53.723954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:53.723954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:53.723954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:53.725465 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:53.725465 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:53.725465 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:53.725465 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 325/653] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:53.725465 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec3134-e0d8-419e-a658-7531141c201b None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:53.749881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81579390-ed52-4045-8592-9abbe93a2c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:53.750823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81579390-ed52-4045-8592-9abbe93a2c85 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:53.751275 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81579390-ed52-4045-8592-9abbe93a2c85 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:53.751576 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81579390-ed52-4045-8592-9abbe93a2c85 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:53.753125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81579390-ed52-4045-8592-9abbe93a2c85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:53.753583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81579390-ed52-4045-8592-9abbe93a2c85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:53.754956 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81579390-ed52-4045-8592-9abbe93a2c85 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:53.767098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 329/654] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:53.768389 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81579390-ed52-4045-8592-9abbe93a2c85 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:53.776464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:53.832302 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec3134-e0d8-419e-a658-7531141c201b None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:53.864893 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b35c94-3216-44e3-847d-456723990b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:53.865485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b35c94-3216-44e3-847d-456723990b32 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:53.865758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b35c94-3216-44e3-847d-456723990b32 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:53.866026 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b35c94-3216-44e3-847d-456723990b32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:53.866740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b35c94-3216-44e3-847d-456723990b32 None admin] RBAC: Adding query filter params (role.id=295de8f316124ccdac36a50e50531148, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=28614526d50d4201b93b20df45465d32) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:53.867048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b35c94-3216-44e3-847d-456723990b32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:53.867318 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:53.868457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b35c94-3216-44e3-847d-456723990b32 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:53.874070 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 326/655] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:33:53 2022] GET /identity/v3/role_assignments?user.id=28614526d50d4201b93b20df45465d32&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=295de8f316124ccdac36a50e50531148 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:53.874217 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81579390-ed52-4045-8592-9abbe93a2c85 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:53.874828 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b35c94-3216-44e3-847d-456723990b32 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:53.925470 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812ca84-052b-46e2-ba09-e408fbe7bad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:53.926998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812ca84-052b-46e2-ba09-e408fbe7bad3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:53.928325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812ca84-052b-46e2-ba09-e408fbe7bad3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:53.928868 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812ca84-052b-46e2-ba09-e408fbe7bad3 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:53.929740 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812ca84-052b-46e2-ba09-e408fbe7bad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:53.930230 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812ca84-052b-46e2-ba09-e408fbe7bad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:53.931852 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812ca84-052b-46e2-ba09-e408fbe7bad3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:53.947058 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 330/656] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:53.947895 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812ca84-052b-46e2-ba09-e408fbe7bad3 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:54.007298 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b35c94-3216-44e3-847d-456723990b32 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:54.019149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:54.051812 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc6700-8077-49e2-8add-f0bc262a9d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:54.052426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc6700-8077-49e2-8add-f0bc262a9d1b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:54.052740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc6700-8077-49e2-8add-f0bc262a9d1b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:54.053018 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc6700-8077-49e2-8add-f0bc262a9d1b None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:54.053660 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc6700-8077-49e2-8add-f0bc262a9d1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:54.053968 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc6700-8077-49e2-8add-f0bc262a9d1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:54.055349 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc6700-8077-49e2-8add-f0bc262a9d1b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:54.068964 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 327/657] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:54.070018 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de271c-da5b-48d3-ae0f-45cde1d8f575 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:54.070308 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de271c-da5b-48d3-ae0f-45cde1d8f575 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:54.070677 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de271c-da5b-48d3-ae0f-45cde1d8f575 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:54.076250 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 328/658] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:54.076250 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de271c-da5b-48d3-ae0f-45cde1d8f575 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:54.076484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812ca84-052b-46e2-ba09-e408fbe7bad3 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:54.116479 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf9520-bf5c-49d9-b361-1f3545c41678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:54.117141 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf9520-bf5c-49d9-b361-1f3545c41678 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:54.117423 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf9520-bf5c-49d9-b361-1f3545c41678 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:54.117696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf9520-bf5c-49d9-b361-1f3545c41678 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:54.127462 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf9520-bf5c-49d9-b361-1f3545c41678 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:54.129799 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf9520-bf5c-49d9-b361-1f3545c41678 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:54.143098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ecbf9520-bf5c-49d9-b361-1f3545c41678 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 10:33:54.143098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:54.143098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:54.143098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:54.143098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:54.143098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:54.143098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:54.143098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:54.143098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:54.143098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:54.143098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:54.143098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:54.143098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:33:54.143098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:33:54.143098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:33:54.143098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:33:54.144077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:54.144077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:54.144077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:33:54.144077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:54.144077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:33:54.144077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:54.144077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:54.144077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:54.144077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:54.144077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:54.144077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:54.144077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:54.144077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:54.144077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:54.144077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:54.144077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:54.144077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:54.144077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:54.145822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:54.145822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:54.145822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:33:54.145822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:33:54.145822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:33:54.145822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:33:54.145822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:33:54.145822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:33:54.145822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 10:33:54.145822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:54.145822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 331/659] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:33:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:54.145822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf9520-bf5c-49d9-b361-1f3545c41678 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:54.163930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:54.196931 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de271c-da5b-48d3-ae0f-45cde1d8f575 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:54.239582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99e8bd-e4e2-464f-8810-09007cbff567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:54.240218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99e8bd-e4e2-464f-8810-09007cbff567 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:54.240500 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99e8bd-e4e2-464f-8810-09007cbff567 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:54.240807 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99e8bd-e4e2-464f-8810-09007cbff567 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:54.247517 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99e8bd-e4e2-464f-8810-09007cbff567 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:54.248986 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99e8bd-e4e2-464f-8810-09007cbff567 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:54.249340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf9520-bf5c-49d9-b361-1f3545c41678 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:54.260540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-4e99e8bd-e4e2-464f-8810-09007cbff567 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:54.260540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:54.260540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:54.260540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:54.260540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:54.260540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:54.260540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:54.260540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:54.260540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:54.260540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:54.260540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:54.260540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:54.260540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:33:54.260540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:33:54.260540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:33:54.261556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:33:54.261556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:54.261556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:54.261556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:54.261556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:54.261556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:54.261556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:54.261556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:54.261556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:54.261556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:54.261556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:54.261556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:54.261556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:54.261556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:54.261556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:54.261556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:54.261556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:54.262497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:33:54.262497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:33:54.262497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:33:54.262497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:33:54.262497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:33:54.262497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:33:54.262497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:54.262497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:54.262497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 329/660] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:54.263022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb7ac0-06d0-4f2e-9aaa-000409759800 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:54.263022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb7ac0-06d0-4f2e-9aaa-000409759800 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:54.263748 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb7ac0-06d0-4f2e-9aaa-000409759800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:54.283646 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-a4eb7ac0-06d0-4f2e-9aaa-000409759800 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:54.284851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a4eb7ac0-06d0-4f2e-9aaa-000409759800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:54.292053 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012a84d-8a05-43f5-82db-9360cf9601d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:54.293024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012a84d-8a05-43f5-82db-9360cf9601d3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:54.293489 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012a84d-8a05-43f5-82db-9360cf9601d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:54.293960 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012a84d-8a05-43f5-82db-9360cf9601d3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:54.303586 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012a84d-8a05-43f5-82db-9360cf9601d3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:54.305272 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012a84d-8a05-43f5-82db-9360cf9601d3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:54.310001 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:54.319616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-3012a84d-8a05-43f5-82db-9360cf9601d3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 10:33:54.319616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:54.319616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:54.319616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:54.319616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:54.319616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:54.319616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:54.319616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:54.319616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:54.319616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:54.319616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:54.319616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:54.319616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:33:54.319616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:33:54.319616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:33:54.319616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:33:54.320840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:54.320840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:54.320840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:33:54.320840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:54.320840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:33:54.320840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:54.320840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:54.320840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:54.320840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:54.320840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:54.320840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:54.320840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:54.320840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:54.320840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:54.320840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:54.320840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:54.320840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:54.320840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:54.321988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:54.321988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:54.321988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:33:54.321988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:33:54.321988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:33:54.321988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:33:54.321988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:33:54.321988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:33:54.321988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 10:33:54.321988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:54.321988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 332/661] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:54.321988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012a84d-8a05-43f5-82db-9360cf9601d3 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:54.364285 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 330/662] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:54.365158 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb7ac0-06d0-4f2e-9aaa-000409759800 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:54.424115 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:54.450446 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012a84d-8a05-43f5-82db-9360cf9601d3 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:54.491838 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec572a6d-35d0-4056-a030-774423922b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:54.492147 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb7ac0-06d0-4f2e-9aaa-000409759800 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:54.492441 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec572a6d-35d0-4056-a030-774423922b52 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:54.492746 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec572a6d-35d0-4056-a030-774423922b52 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:54.493016 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec572a6d-35d0-4056-a030-774423922b52 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:54.493749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec572a6d-35d0-4056-a030-774423922b52 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:54.494047 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec572a6d-35d0-4056-a030-774423922b52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:54.496429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec572a6d-35d0-4056-a030-774423922b52 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:54.520763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 333/663] 10.222.0.20 () {56 vars in 1139 bytes} [Sun Sep 11 10:33:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:54.521858 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec572a6d-35d0-4056-a030-774423922b52 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:54.540221 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cdf48a-f60e-4dfd-9cb1-59971e23969d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:54.540993 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdf48a-f60e-4dfd-9cb1-59971e23969d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:54.541417 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdf48a-f60e-4dfd-9cb1-59971e23969d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:54.541706 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdf48a-f60e-4dfd-9cb1-59971e23969d None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:54.542406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cdf48a-f60e-4dfd-9cb1-59971e23969d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:54.542718 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cdf48a-f60e-4dfd-9cb1-59971e23969d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:54.544857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cdf48a-f60e-4dfd-9cb1-59971e23969d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:54.561335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 331/664] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:33:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:54.562502 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cdf48a-f60e-4dfd-9cb1-59971e23969d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:54.592494 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:54.651071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec572a6d-35d0-4056-a030-774423922b52 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:54.687386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b586199-99cd-45cb-aa27-2657c0beb0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:54.688322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b586199-99cd-45cb-aa27-2657c0beb0ce None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:54.688639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b586199-99cd-45cb-aa27-2657c0beb0ce None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:54.688920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b586199-99cd-45cb-aa27-2657c0beb0ce None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:54.690175 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b586199-99cd-45cb-aa27-2657c0beb0ce None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:54.690484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b586199-99cd-45cb-aa27-2657c0beb0ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:54.691906 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b586199-99cd-45cb-aa27-2657c0beb0ce None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:54.693538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:54.696512 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cdf48a-f60e-4dfd-9cb1-59971e23969d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:54.715813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 334/665] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Sep 11 10:33:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:54.716907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b586199-99cd-45cb-aa27-2657c0beb0ce None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:54.735006 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19af20-1ede-4856-bc5d-2f556791b909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:54.735650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19af20-1ede-4856-bc5d-2f556791b909 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:54.736023 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19af20-1ede-4856-bc5d-2f556791b909 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:54.736304 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19af20-1ede-4856-bc5d-2f556791b909 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:54.803546 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19af20-1ede-4856-bc5d-2f556791b909 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:54.805126 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19af20-1ede-4856-bc5d-2f556791b909 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:54.824746 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b586199-99cd-45cb-aa27-2657c0beb0ce None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:54.826383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:54.868537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8963320-e2b3-4546-81aa-2875b5648239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:54.869454 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8963320-e2b3-4546-81aa-2875b5648239 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:54.869892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8963320-e2b3-4546-81aa-2875b5648239 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:54.870424 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8963320-e2b3-4546-81aa-2875b5648239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:54.871415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8963320-e2b3-4546-81aa-2875b5648239 None admin] RBAC: Adding query filter params (role.id=295de8f316124ccdac36a50e50531148, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=b642a1d00de940429fc1cc6131ac22b1) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:54.871729 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8963320-e2b3-4546-81aa-2875b5648239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:54.873172 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8963320-e2b3-4546-81aa-2875b5648239 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:54.888580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 335/666] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:33:54 2022] GET /identity/v3/role_assignments?user.id=b642a1d00de940429fc1cc6131ac22b1&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=295de8f316124ccdac36a50e50531148 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:54.888580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8963320-e2b3-4546-81aa-2875b5648239 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:54.924442 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 332/667] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:54.925725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19af20-1ede-4856-bc5d-2f556791b909 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:54.964960 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:55.035739 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8963320-e2b3-4546-81aa-2875b5648239 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:55.048884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19af20-1ede-4856-bc5d-2f556791b909 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:55.071903 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:55.087449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493587d-96d5-4b42-af5d-9410bac58f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:55.088526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493587d-96d5-4b42-af5d-9410bac58f74 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:55.089379 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493587d-96d5-4b42-af5d-9410bac58f74 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:55.089865 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493587d-96d5-4b42-af5d-9410bac58f74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:55.095816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0dacf-0ad6-4170-b9f0-0f9dc2ee2424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:55.096742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0dacf-0ad6-4170-b9f0-0f9dc2ee2424 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:55.097020 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0dacf-0ad6-4170-b9f0-0f9dc2ee2424 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:55.097293 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0dacf-0ad6-4170-b9f0-0f9dc2ee2424 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:55.103298 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493587d-96d5-4b42-af5d-9410bac58f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:55.110547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-e493587d-96d5-4b42-af5d-9410bac58f74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:55.110547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:55.110547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:55.110547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:55.110547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:55.110547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:55.110547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:55.110547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:55.110547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:55.110547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:55.110547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:55.110547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:55.110547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:55.110547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:55.110547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:55.110547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:55.112027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:55.112027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:55.112027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:55.112027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:55.112027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:55.112027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:55.112027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:55.112027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:55.112027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:55.112027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:55.112027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:55.112027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:55.112027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:55.112027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:55.112027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:55.112027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:55.112885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:55.112885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:55.112885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:55.112885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:55.112885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:55.112885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:55.112885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:55.112885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:55.112885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:55.112885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:55.112885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:33:55.112885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:55.116736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 336/668] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:33:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:55.117624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493587d-96d5-4b42-af5d-9410bac58f74 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:55.184307 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0dacf-0ad6-4170-b9f0-0f9dc2ee2424 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:55.186441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0dacf-0ad6-4170-b9f0-0f9dc2ee2424 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:55.236493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493587d-96d5-4b42-af5d-9410bac58f74 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:55.255177 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:55.277884 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ff205-f0bf-4947-91a8-c29b7c855276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:55.278545 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ff205-f0bf-4947-91a8-c29b7c855276 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:55.278830 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ff205-f0bf-4947-91a8-c29b7c855276 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:55.279093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ff205-f0bf-4947-91a8-c29b7c855276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:55.298130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ff205-f0bf-4947-91a8-c29b7c855276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:55.299951 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ff205-f0bf-4947-91a8-c29b7c855276 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:55.312302 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 333/669] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:55.313213 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0dacf-0ad6-4170-b9f0-0f9dc2ee2424 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:55.316286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-802ff205-f0bf-4947-91a8-c29b7c855276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:55.316286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:55.316286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:55.316286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:55.316286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:55.316286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:55.316286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:55.316286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:55.316286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:55.316286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:55.316286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:55.316286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:55.316286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:55.316286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:55.316286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:55.316286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:55.317257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:55.317257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:55.317257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:55.317257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:55.317257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:55.317257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:55.317257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:55.317257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:55.317257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:55.317257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:55.317257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:55.317257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:55.317257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:55.317257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:55.317257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:55.317257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:55.317257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:55.318142 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:55.318142 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:55.318142 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:55.318142 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 337/670] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:55.318768 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ff205-f0bf-4947-91a8-c29b7c855276 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:55.344711 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:55.442106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0dacf-0ad6-4170-b9f0-0f9dc2ee2424 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:55.442777 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ff205-f0bf-4947-91a8-c29b7c855276 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:55.478589 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627db5fb-afd4-43cd-ab40-e7e319155ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:55.479193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627db5fb-afd4-43cd-ab40-e7e319155ffa None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:55.479473 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627db5fb-afd4-43cd-ab40-e7e319155ffa None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:55.479747 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627db5fb-afd4-43cd-ab40-e7e319155ffa None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:55.480471 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627db5fb-afd4-43cd-ab40-e7e319155ffa None admin] RBAC: Adding query filter params (name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:55.480806 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627db5fb-afd4-43cd-ab40-e7e319155ffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:55.481388 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49c633-e245-4423-90fc-e2efb64ce287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:55.482019 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49c633-e245-4423-90fc-e2efb64ce287 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:55.482187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627db5fb-afd4-43cd-ab40-e7e319155ffa None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:55.482352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49c633-e245-4423-90fc-e2efb64ce287 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:55.482555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49c633-e245-4423-90fc-e2efb64ce287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:55.491050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 334/671] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:33:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:55.491965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627db5fb-afd4-43cd-ab40-e7e319155ffa None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:55.493861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49c633-e245-4423-90fc-e2efb64ce287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:55.496648 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49c633-e245-4423-90fc-e2efb64ce287 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:55.514500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-0f49c633-e245-4423-90fc-e2efb64ce287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:55.514500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:55.514500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:55.514500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:55.514500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:55.514500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:55.514500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:55.514500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:55.514500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:55.514500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:55.514500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:55.514500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:55.514500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:55.514500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:55.514500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:55.514500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:55.516741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:55.516741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:55.516741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:55.516741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:55.516741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:55.516741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:55.516741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:55.516741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:55.516741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:55.516741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:55.516741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:55.516741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:55.516741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:55.516741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:55.516741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:55.516741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:55.516741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:55.519584 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:55.519584 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:55.519584 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:55.519584 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 338/672] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:55.519584 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49c633-e245-4423-90fc-e2efb64ce287 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:55.544135 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:55.583759 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:55.606058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627db5fb-afd4-43cd-ab40-e7e319155ffa None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:55.638129 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49c633-e245-4423-90fc-e2efb64ce287 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:55.645733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c2835-69f1-4ae7-8f4e-0709a12d54e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:55.646548 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c2835-69f1-4ae7-8f4e-0709a12d54e3 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:55.647024 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c2835-69f1-4ae7-8f4e-0709a12d54e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:55.647494 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c2835-69f1-4ae7-8f4e-0709a12d54e3 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:55.648349 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c2835-69f1-4ae7-8f4e-0709a12d54e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:55.648858 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c2835-69f1-4ae7-8f4e-0709a12d54e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:55.650482 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c2835-69f1-4ae7-8f4e-0709a12d54e3 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:55.663986 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 335/673] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:55.665144 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c2835-69f1-4ae7-8f4e-0709a12d54e3 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:55.690809 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468e1cf-6614-4bc5-b0ec-2446d7e6d76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:55.691451 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468e1cf-6614-4bc5-b0ec-2446d7e6d76e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:55.691726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468e1cf-6614-4bc5-b0ec-2446d7e6d76e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:55.691994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468e1cf-6614-4bc5-b0ec-2446d7e6d76e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:55.706122 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468e1cf-6614-4bc5-b0ec-2446d7e6d76e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:55.708220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468e1cf-6614-4bc5-b0ec-2446d7e6d76e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:55.728810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-2468e1cf-6614-4bc5-b0ec-2446d7e6d76e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:55.728810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:55.728810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:55.728810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:55.728810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:55.728810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:55.728810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:55.728810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:55.728810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:55.728810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:55.728810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:55.728810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:55.728810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:55.728810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:55.728810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:55.728810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:55.729738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:55.729738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:55.729738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:55.729738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:55.729738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:55.729738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:55.729738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:55.729738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:55.729738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:55.729738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:55.729738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:55.729738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:55.729738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:55.729738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:55.729738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:55.729738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:55.729738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:55.730643 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:55.730643 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:55.730643 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:55.733053 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 339/674] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:55.734065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468e1cf-6614-4bc5-b0ec-2446d7e6d76e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:55.785472 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c2835-69f1-4ae7-8f4e-0709a12d54e3 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:55.820932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1230409-11d9-4f7a-bba4-87d9ed6eca5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:55.821704 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1230409-11d9-4f7a-bba4-87d9ed6eca5e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:55.822004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:55.822147 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1230409-11d9-4f7a-bba4-87d9ed6eca5e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:55.822542 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1230409-11d9-4f7a-bba4-87d9ed6eca5e None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:55.823497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1230409-11d9-4f7a-bba4-87d9ed6eca5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:55.823675 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1230409-11d9-4f7a-bba4-87d9ed6eca5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:55.825169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1230409-11d9-4f7a-bba4-87d9ed6eca5e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:55.838017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 336/675] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:55.839076 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1230409-11d9-4f7a-bba4-87d9ed6eca5e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:55.842046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:55.865343 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468e1cf-6614-4bc5-b0ec-2446d7e6d76e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:55.908425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aff734-cfef-44f5-9443-7d6ad7217f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:55.909316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aff734-cfef-44f5-9443-7d6ad7217f18 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:55.909746 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aff734-cfef-44f5-9443-7d6ad7217f18 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:55.910188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aff734-cfef-44f5-9443-7d6ad7217f18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:55.918769 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aff734-cfef-44f5-9443-7d6ad7217f18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:55.920444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aff734-cfef-44f5-9443-7d6ad7217f18 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:55.934355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-46aff734-cfef-44f5-9443-7d6ad7217f18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:55.934355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:55.934355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:55.934355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:55.934355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:55.934355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:55.934355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:55.934355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:55.934355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:55.934355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:55.934355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:55.934355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:55.934355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:33:55.934355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:33:55.934355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:33:55.935494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:33:55.935494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:55.935494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:55.935494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:55.935494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:55.935494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:55.935494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:55.935494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:55.935494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:55.935494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:55.935494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:55.935494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:55.935494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:55.935494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:55.935494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:55.935494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:55.935494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:55.936632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:33:55.936632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:33:55.936632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:33:55.936632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:33:55.936632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:33:55.936632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:33:55.936632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:55.936632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:55.944356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 340/676] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:55.946188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aff734-cfef-44f5-9443-7d6ad7217f18 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:55.955713 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1230409-11d9-4f7a-bba4-87d9ed6eca5e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:55.992924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8249832-91fc-4db0-9306-422c77bb74f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:55.994264 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8249832-91fc-4db0-9306-422c77bb74f0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:55.994264 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8249832-91fc-4db0-9306-422c77bb74f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:55.994264 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8249832-91fc-4db0-9306-422c77bb74f0 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:55.995105 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8249832-91fc-4db0-9306-422c77bb74f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:55.995500 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8249832-91fc-4db0-9306-422c77bb74f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:55.997005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8249832-91fc-4db0-9306-422c77bb74f0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:56.010464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 337/677] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:56.011478 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8249832-91fc-4db0-9306-422c77bb74f0 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:56.075447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:56.076174 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aff734-cfef-44f5-9443-7d6ad7217f18 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:56.115893 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:56.120953 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8249832-91fc-4db0-9306-422c77bb74f0 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:56.123012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f4775-7d22-416c-b28d-4da61766b036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:56.123932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f4775-7d22-416c-b28d-4da61766b036 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:56.124364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f4775-7d22-416c-b28d-4da61766b036 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:56.124818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f4775-7d22-416c-b28d-4da61766b036 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:56.132190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f4775-7d22-416c-b28d-4da61766b036 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:56.133924 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f4775-7d22-416c-b28d-4da61766b036 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:56.148459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-7b9f4775-7d22-416c-b28d-4da61766b036 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:56.148459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:56.148459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:56.148459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:56.148459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:56.148459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:56.148459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:56.148459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:56.148459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:56.148459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:56.148459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:56.148459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:56.148459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:33:56.148459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:33:56.148459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:33:56.149593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:33:56.149593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:56.149593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:56.149593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:56.149593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:56.149593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:56.149593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:56.149593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:56.149593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:56.149593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:56.149593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:56.149593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:56.149593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:56.149593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:56.149593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:56.149593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:56.149593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:56.150736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:33:56.150736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:33:56.150736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:33:56.150736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:33:56.150736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:33:56.150736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:33:56.150736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:56.150736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:56.152979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 341/678] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:56.153968 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f4775-7d22-416c-b28d-4da61766b036 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:56.161841 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827d789-ba28-4ca3-9914-2afc1f3e089e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:56.162757 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827d789-ba28-4ca3-9914-2afc1f3e089e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:56.163135 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827d789-ba28-4ca3-9914-2afc1f3e089e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:56.163504 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827d789-ba28-4ca3-9914-2afc1f3e089e None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:56.164302 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827d789-ba28-4ca3-9914-2afc1f3e089e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:56.164751 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827d789-ba28-4ca3-9914-2afc1f3e089e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:56.166746 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827d789-ba28-4ca3-9914-2afc1f3e089e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:56.183753 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 338/679] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:56.183753 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827d789-ba28-4ca3-9914-2afc1f3e089e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:56.272468 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f4775-7d22-416c-b28d-4da61766b036 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:56.290708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827d789-ba28-4ca3-9914-2afc1f3e089e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:56.307912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1554f-254d-4bfd-9ad3-6da6dd34b781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:56.308525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1554f-254d-4bfd-9ad3-6da6dd34b781 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:56.308827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1554f-254d-4bfd-9ad3-6da6dd34b781 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:56.309096 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1554f-254d-4bfd-9ad3-6da6dd34b781 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:56.313811 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:56.317805 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1554f-254d-4bfd-9ad3-6da6dd34b781 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:56.319836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1554f-254d-4bfd-9ad3-6da6dd34b781 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:56.326876 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63094901-6425-4f99-9b21-7df4882f1c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:56.327486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63094901-6425-4f99-9b21-7df4882f1c10 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:56.327766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63094901-6425-4f99-9b21-7df4882f1c10 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:56.328037 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63094901-6425-4f99-9b21-7df4882f1c10 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:56.328762 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63094901-6425-4f99-9b21-7df4882f1c10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:56.329070 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63094901-6425-4f99-9b21-7df4882f1c10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:56.330551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63094901-6425-4f99-9b21-7df4882f1c10 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:56.331270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-48d1554f-254d-4bfd-9ad3-6da6dd34b781 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 10:33:56.331270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:56.331270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:56.331270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:56.331270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:56.331270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:56.331270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:56.331270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:56.331270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:56.331270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:56.331270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:56.331270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:56.331270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:33:56.331270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:33:56.331270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:33:56.331270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:33:56.332215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:56.332215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:56.332215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:33:56.332215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:56.332215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:33:56.332215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:56.332215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:56.332215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:56.332215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:56.332215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:56.332215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:56.332215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:56.332215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:56.332215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:56.332215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:56.332215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:56.332215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:56.332215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:56.333913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:56.333913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:56.333913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:33:56.333913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:33:56.333913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:33:56.333913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:33:56.333913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:33:56.333913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:33:56.333913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 10:33:56.333913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:56.333913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 342/680] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:33:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:56.333913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1554f-254d-4bfd-9ad3-6da6dd34b781 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:56.354401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 339/681] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:56.354401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ba3f4-013c-4257-8207-9995ea874f19 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:56.354401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ba3f4-013c-4257-8207-9995ea874f19 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:56.354401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ba3f4-013c-4257-8207-9995ea874f19 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:56.354401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 340/682] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:56.354401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ba3f4-013c-4257-8207-9995ea874f19 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:56.395136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:56.443911 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1554f-254d-4bfd-9ad3-6da6dd34b781 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:56.466843 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ba3f4-013c-4257-8207-9995ea874f19 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:56.478224 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cf4b8-bdea-4f0e-961e-b268c9af4bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:56.478823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cf4b8-bdea-4f0e-961e-b268c9af4bf8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:56.479105 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cf4b8-bdea-4f0e-961e-b268c9af4bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:56.479376 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cf4b8-bdea-4f0e-961e-b268c9af4bf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:56.480091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cf4b8-bdea-4f0e-961e-b268c9af4bf8 None admin] RBAC: Adding query filter params (role.id=295de8f316124ccdac36a50e50531148, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=133c5864d9544973a30ff77866522f15) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:56.480400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cf4b8-bdea-4f0e-961e-b268c9af4bf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:56.481903 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cf4b8-bdea-4f0e-961e-b268c9af4bf8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:56.496575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 343/683] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:33:56 2022] GET /identity/v3/role_assignments?user.id=133c5864d9544973a30ff77866522f15&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=295de8f316124ccdac36a50e50531148 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:56.496575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cf4b8-bdea-4f0e-961e-b268c9af4bf8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:56.513409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786126d-5a3c-436e-a273-6d3214ec18c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:56.514166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786126d-5a3c-436e-a273-6d3214ec18c7 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:56.514512 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786126d-5a3c-436e-a273-6d3214ec18c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:56.514857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786126d-5a3c-436e-a273-6d3214ec18c7 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:56.515682 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786126d-5a3c-436e-a273-6d3214ec18c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:56.516113 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786126d-5a3c-436e-a273-6d3214ec18c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:56.517778 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786126d-5a3c-436e-a273-6d3214ec18c7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:56.544731 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 341/684] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Sep 11 10:33:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:56.546417 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5531bf-3736-4ab0-8188-44e944c7a070 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:56.549535 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5531bf-3736-4ab0-8188-44e944c7a070 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:56.549907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5531bf-3736-4ab0-8188-44e944c7a070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:56.574899 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-3f5531bf-3736-4ab0-8188-44e944c7a070 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:56.576443 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3f5531bf-3736-4ab0-8188-44e944c7a070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:56.616440 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cf4b8-bdea-4f0e-961e-b268c9af4bf8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:56.617850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:56.637162 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:56.660725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0afee5-ed57-403c-b936-3ab29b13e894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:56.660725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0afee5-ed57-403c-b936-3ab29b13e894 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:56.660725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0afee5-ed57-403c-b936-3ab29b13e894 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:56.660725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0afee5-ed57-403c-b936-3ab29b13e894 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:56.661154 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0afee5-ed57-403c-b936-3ab29b13e894 None admin] RBAC: Adding query filter params (role.id=295de8f316124ccdac36a50e50531148, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=caa0d9fe3d4942be8901876e57d1e561) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:56.661154 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0afee5-ed57-403c-b936-3ab29b13e894 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:56.662318 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0afee5-ed57-403c-b936-3ab29b13e894 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:56.664652 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 342/685] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:56.665819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5531bf-3736-4ab0-8188-44e944c7a070 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:56.669768 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 344/686] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:33:56 2022] GET /identity/v3/role_assignments?user.id=caa0d9fe3d4942be8901876e57d1e561&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=295de8f316124ccdac36a50e50531148 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:56.825831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5531bf-3736-4ab0-8188-44e944c7a070 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:56.876252 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23042c69-97eb-4dd2-a5b6-30282282145d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:56.876971 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23042c69-97eb-4dd2-a5b6-30282282145d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:56.877251 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23042c69-97eb-4dd2-a5b6-30282282145d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:56.877534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23042c69-97eb-4dd2-a5b6-30282282145d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:56.920228 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:56.960013 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23042c69-97eb-4dd2-a5b6-30282282145d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:56.961501 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23042c69-97eb-4dd2-a5b6-30282282145d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:56.980236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0afee5-ed57-403c-b936-3ab29b13e894 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:57.141851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 343/687] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:33:57.158259 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23042c69-97eb-4dd2-a5b6-30282282145d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:57.191061 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0afee5-ed57-403c-b936-3ab29b13e894 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:57.233712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64b86d-1b87-4aeb-bdec-373cd8493b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:57.234694 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64b86d-1b87-4aeb-bdec-373cd8493b70 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:57.235168 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64b86d-1b87-4aeb-bdec-373cd8493b70 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:57.235608 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64b86d-1b87-4aeb-bdec-373cd8493b70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:57.251037 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64b86d-1b87-4aeb-bdec-373cd8493b70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:57.252888 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64b86d-1b87-4aeb-bdec-373cd8493b70 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:57.269782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-7e64b86d-1b87-4aeb-bdec-373cd8493b70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:57.269782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:57.269782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:57.269782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:57.269782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:57.269782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:57.269782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:57.269782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:57.269782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:57.269782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:57.269782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:57.269782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:57.269782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:57.269782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:57.269782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:57.269782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:57.270775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:57.270775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:57.270775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:57.270775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:57.270775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:57.270775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:57.270775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:57.270775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:57.270775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:57.270775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:57.270775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:57.270775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:57.270775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:57.270775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:57.270775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:57.270775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:57.270775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:57.271653 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:57.271653 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:57.271653 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:57.273796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 345/688] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:57.279905 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64b86d-1b87-4aeb-bdec-373cd8493b70 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:57.314481 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:57.402710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64b86d-1b87-4aeb-bdec-373cd8493b70 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:57.419455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:57.441739 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337915f0-9dab-4d57-892d-e85a899ceb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:57.442631 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337915f0-9dab-4d57-892d-e85a899ceb0b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:57.443052 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337915f0-9dab-4d57-892d-e85a899ceb0b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:57.443467 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337915f0-9dab-4d57-892d-e85a899ceb0b None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:57.444272 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337915f0-9dab-4d57-892d-e85a899ceb0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:57.444804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337915f0-9dab-4d57-892d-e85a899ceb0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:57.446366 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337915f0-9dab-4d57-892d-e85a899ceb0b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:57.463775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 346/689] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:57.465463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc52547-b147-49d3-8e55-0f3c0517041c None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:57.466014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc52547-b147-49d3-8e55-0f3c0517041c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:57.466560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc52547-b147-49d3-8e55-0f3c0517041c None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:57.466790 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23042c69-97eb-4dd2-a5b6-30282282145d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:57.468532 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 347/690] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:57.469504 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc52547-b147-49d3-8e55-0f3c0517041c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:57.517560 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce8072-1474-429c-abdc-137677f693dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:57.518301 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce8072-1474-429c-abdc-137677f693dc None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:57.518559 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce8072-1474-429c-abdc-137677f693dc None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:57.518972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce8072-1474-429c-abdc-137677f693dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:57.537475 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce8072-1474-429c-abdc-137677f693dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:57.539000 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce8072-1474-429c-abdc-137677f693dc None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:57.557623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-3fce8072-1474-429c-abdc-137677f693dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:57.557623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:57.557623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:57.557623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:57.557623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:57.557623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:57.557623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:57.557623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:57.557623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:57.557623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:57.557623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:57.557623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:57.557623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:57.557623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:57.557623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:57.557623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:57.558603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:57.558603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:57.558603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:57.558603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:57.558603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:57.558603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:57.558603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:57.558603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:57.558603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:57.558603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:57.558603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:57.558603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:57.558603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:57.558603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:57.558603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:57.558603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:57.558603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:57.559514 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:57.559514 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:57.559514 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:57.563661 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 344/691] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:57.565627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e23e1-4a2f-4cec-a491-5f82c1cfa786 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:57.565907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e23e1-4a2f-4cec-a491-5f82c1cfa786 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:57.566180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e23e1-4a2f-4cec-a491-5f82c1cfa786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:57.587742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-9d9e23e1-4a2f-4cec-a491-5f82c1cfa786 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:57.588992 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9d9e23e1-4a2f-4cec-a491-5f82c1cfa786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:57.644930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:57.665259 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc52547-b147-49d3-8e55-0f3c0517041c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:57.702808 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 345/692] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:57.703939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e23e1-4a2f-4cec-a491-5f82c1cfa786 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:57.785500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd2a70-68aa-4d99-b465-34428f4902fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:57.786535 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd2a70-68aa-4d99-b465-34428f4902fa None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:57.787023 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd2a70-68aa-4d99-b465-34428f4902fa None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:57.787493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd2a70-68aa-4d99-b465-34428f4902fa None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:57.788338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd2a70-68aa-4d99-b465-34428f4902fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:57.790005 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd2a70-68aa-4d99-b465-34428f4902fa None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:57.792046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:57.853379 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 348/693] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 10:33:57 2022] POST /identity/v3/users => generated 254 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:33:57.878081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e23e1-4a2f-4cec-a491-5f82c1cfa786 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:57.928475 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecf4aa-2ccd-42b4-a843-3408f64a195d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:57.929548 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecf4aa-2ccd-42b4-a843-3408f64a195d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:57.930121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecf4aa-2ccd-42b4-a843-3408f64a195d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:57.930591 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecf4aa-2ccd-42b4-a843-3408f64a195d None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:57.931492 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecf4aa-2ccd-42b4-a843-3408f64a195d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:57.931994 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecf4aa-2ccd-42b4-a843-3408f64a195d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:57.933617 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecf4aa-2ccd-42b4-a843-3408f64a195d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:57.952513 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 346/694] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:57.957857 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd2a70-68aa-4d99-b465-34428f4902fa None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:58.108775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd2a70-68aa-4d99-b465-34428f4902fa None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:58.146849 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bc141-cf3c-4c3b-a866-7431a5c6b94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:58.147496 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bc141-cf3c-4c3b-a866-7431a5c6b94e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:58.147774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bc141-cf3c-4c3b-a866-7431a5c6b94e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:58.148045 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bc141-cf3c-4c3b-a866-7431a5c6b94e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:58.155542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826bc141-cf3c-4c3b-a866-7431a5c6b94e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:58.157067 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826bc141-cf3c-4c3b-a866-7431a5c6b94e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:58.167024 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecf4aa-2ccd-42b4-a843-3408f64a195d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:58.169817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-826bc141-cf3c-4c3b-a866-7431a5c6b94e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:58.169817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:58.169817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:58.169817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:58.169817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:58.169817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:58.169817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:58.169817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:58.169817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:58.169817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:58.169817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:58.169817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:58.169817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:33:58.169817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:33:58.169817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:33:58.170678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:33:58.170678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:58.170678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:58.170678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:58.170678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:58.170678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:58.170678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:58.170678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:58.170678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:58.170678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:58.170678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:58.170678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:58.170678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:58.170678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:58.170678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:58.170678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:58.170678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:58.175046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:33:58.175046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:33:58.175046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:33:58.175046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:33:58.175046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:33:58.175046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:33:58.175046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:33:58.175046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:58.175046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 349/695] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:58.190687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bc141-cf3c-4c3b-a866-7431a5c6b94e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:58.205592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:58.297490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bc141-cf3c-4c3b-a866-7431a5c6b94e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:58.301875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecf4aa-2ccd-42b4-a843-3408f64a195d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:58.317420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:58.335382 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b6008-3eac-4460-9be6-8087f96c032c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:58.336078 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b6008-3eac-4460-9be6-8087f96c032c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:58.336359 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b6008-3eac-4460-9be6-8087f96c032c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:58.336719 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b6008-3eac-4460-9be6-8087f96c032c None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:58.337593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b6008-3eac-4460-9be6-8087f96c032c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:58.337809 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b6008-3eac-4460-9be6-8087f96c032c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:58.339239 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b6008-3eac-4460-9be6-8087f96c032c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:58.343073 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfe4a8-057d-46f5-b2fe-0702080782fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:58.343943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfe4a8-057d-46f5-b2fe-0702080782fb None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:58.344436 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfe4a8-057d-46f5-b2fe-0702080782fb None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:58.344933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfe4a8-057d-46f5-b2fe-0702080782fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:58.356575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 350/696] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:33:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:33:58.359246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b6008-3eac-4460-9be6-8087f96c032c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:58.369874 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfe4a8-057d-46f5-b2fe-0702080782fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:33:58.376398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-0abfe4a8-057d-46f5-b2fe-0702080782fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:33:58.376398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:58.376398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:58.376398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:58.376398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:58.376398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:58.376398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:58.376398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:58.376398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:58.376398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:58.376398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:58.376398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:58.376398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:33:58.376398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:33:58.376398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:33:58.376398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:33:58.377919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:33:58.377919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:33:58.377919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:33:58.377919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:33:58.377919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:58.377919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:58.377919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:58.377919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:58.377919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:58.377919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:58.377919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:58.377919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:58.377919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:58.377919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:58.377919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:58.377919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:58.378771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:58.378771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:58.378771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:58.378771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:58.378771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:33:58.378771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:33:58.378771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:33:58.378771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:33:58.378771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:33:58.378771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:33:58.378771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:33:58.378771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:33:58.381820 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 347/697] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:33:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:33:58.389734 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfe4a8-057d-46f5-b2fe-0702080782fb None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:58.444059 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:58.479175 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b6008-3eac-4460-9be6-8087f96c032c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:58.513731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6aa7ca-bc49-4e3c-8292-5e882bfee4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:58.514566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6aa7ca-bc49-4e3c-8292-5e882bfee4de None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:58.515003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6aa7ca-bc49-4e3c-8292-5e882bfee4de None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:58.515415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6aa7ca-bc49-4e3c-8292-5e882bfee4de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:58.516270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6aa7ca-bc49-4e3c-8292-5e882bfee4de None admin] RBAC: Adding query filter params (role.id=295de8f316124ccdac36a50e50531148, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=28ff72290fd14ddaba6ed757051e182b) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:58.516760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6aa7ca-bc49-4e3c-8292-5e882bfee4de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:58.518354 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6aa7ca-bc49-4e3c-8292-5e882bfee4de None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:58.520770 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfe4a8-057d-46f5-b2fe-0702080782fb None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:58.524877 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 351/698] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:33:58 2022] GET /identity/v3/role_assignments?user.id=28ff72290fd14ddaba6ed757051e182b&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=295de8f316124ccdac36a50e50531148 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:58.562828 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4647484-8afc-4d80-abd3-a3f5bef1a746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:58.563364 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4647484-8afc-4d80-abd3-a3f5bef1a746 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:58.563654 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4647484-8afc-4d80-abd3-a3f5bef1a746 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:58.563964 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4647484-8afc-4d80-abd3-a3f5bef1a746 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:58.564735 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4647484-8afc-4d80-abd3-a3f5bef1a746 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:58.565038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4647484-8afc-4d80-abd3-a3f5bef1a746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:58.566424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4647484-8afc-4d80-abd3-a3f5bef1a746 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:58.576374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 348/699] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:33:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:58.581928 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6aa7ca-bc49-4e3c-8292-5e882bfee4de None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:58.760784 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6aa7ca-bc49-4e3c-8292-5e882bfee4de None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:58.797377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:58.805297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266bcf3-a8d7-4c71-9edb-247b50be313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:58.806241 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266bcf3-a8d7-4c71-9edb-247b50be313e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:58.806776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266bcf3-a8d7-4c71-9edb-247b50be313e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:58.807246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266bcf3-a8d7-4c71-9edb-247b50be313e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:58.819349 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266bcf3-a8d7-4c71-9edb-247b50be313e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:58.820826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266bcf3-a8d7-4c71-9edb-247b50be313e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:58.835449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-b266bcf3-a8d7-4c71-9edb-247b50be313e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:58.835449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:58.835449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:58.835449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:58.835449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:58.835449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:58.835449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:58.835449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:58.835449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:58.835449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:58.835449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:58.835449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:58.835449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:33:58.835449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:33:58.835449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:33:58.835449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:33:58.836456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:58.836456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:58.836456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:58.836456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:58.836456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:58.836456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:58.836456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:58.836456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:58.836456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:58.836456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:58.836456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:58.836456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:58.836456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:58.836456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:58.836456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:58.836456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:58.836456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:33:58.837393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:33:58.837393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:33:58.837393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:58.837393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 352/700] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:58.842651 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4647484-8afc-4d80-abd3-a3f5bef1a746 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:58.881660 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:58.955257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4647484-8afc-4d80-abd3-a3f5bef1a746 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:58.989939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e58204-d4ba-4a15-8b15-86cb3933dbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:58.990562 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e58204-d4ba-4a15-8b15-86cb3933dbcb None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:58.990839 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e58204-d4ba-4a15-8b15-86cb3933dbcb None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:58.991118 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e58204-d4ba-4a15-8b15-86cb3933dbcb None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:58.991913 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e58204-d4ba-4a15-8b15-86cb3933dbcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:58.992229 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e58204-d4ba-4a15-8b15-86cb3933dbcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:58.993715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e58204-d4ba-4a15-8b15-86cb3933dbcb None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:59.008577 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 349/701] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:59.015634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266bcf3-a8d7-4c71-9edb-247b50be313e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:59.141126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266bcf3-a8d7-4c71-9edb-247b50be313e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:59.193324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df811456-30ac-42ac-b522-48ae8fda9377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:59.194353 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df811456-30ac-42ac-b522-48ae8fda9377 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:59.194855 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df811456-30ac-42ac-b522-48ae8fda9377 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:59.195396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df811456-30ac-42ac-b522-48ae8fda9377 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:59.208229 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df811456-30ac-42ac-b522-48ae8fda9377 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:59.210445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df811456-30ac-42ac-b522-48ae8fda9377 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:59.224437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-df811456-30ac-42ac-b522-48ae8fda9377 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 10:33:59.224437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:33:59.224437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:33:59.224437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:33:59.224437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:33:59.224437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:33:59.224437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:33:59.224437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:33:59.224437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:33:59.224437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:33:59.224437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:33:59.224437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:33:59.224437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:33:59.224437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:33:59.224437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:33:59.224437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:33:59.225538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:33:59.225538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:33:59.225538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:33:59.225538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:59.225538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:33:59.225538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:33:59.225538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:33:59.225538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:33:59.225538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:33:59.225538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:33:59.225538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:33:59.225538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:33:59.225538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:33:59.225538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:33:59.225538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:33:59.225538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:33:59.225538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:33:59.225538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:33:59.226546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:33:59.226546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:33:59.226546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:33:59.226546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:33:59.226546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:33:59.226546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:33:59.226546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:33:59.226546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:33:59.226546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 10:33:59.226546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:33:59.229047 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 353/702] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Sep 11 10:33:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:33:59.234899 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e58204-d4ba-4a15-8b15-86cb3933dbcb None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:59.309901 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbdc6d-98ab-4681-a9db-a00765f90f8e None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:59.310658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbdc6d-98ab-4681-a9db-a00765f90f8e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:59.310999 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbdc6d-98ab-4681-a9db-a00765f90f8e None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:59.312750 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 354/703] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:59.319260 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b95b5-6bea-4428-ad71-4c5b2bae3b8c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:59.319538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b95b5-6bea-4428-ad71-4c5b2bae3b8c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:59.319814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b95b5-6bea-4428-ad71-4c5b2bae3b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:59.366008 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ee0b95b5-6bea-4428-ad71-4c5b2bae3b8c None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:59.367318 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ee0b95b5-6bea-4428-ad71-4c5b2bae3b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:59.403679 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:59.411847 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e58204-d4ba-4a15-8b15-86cb3933dbcb None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:59.426166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:59.452704 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d63864-c879-4d5f-a3db-7361391f18c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:59.453437 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d63864-c879-4d5f-a3db-7361391f18c7 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:59.453719 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d63864-c879-4d5f-a3db-7361391f18c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:59.453995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d63864-c879-4d5f-a3db-7361391f18c7 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:59.454775 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d63864-c879-4d5f-a3db-7361391f18c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:33:59.455131 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d63864-c879-4d5f-a3db-7361391f18c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:59.456581 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d63864-c879-4d5f-a3db-7361391f18c7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:59.458122 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 355/704] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:33:59.459507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b9ef7-5c36-42fb-876d-49391d0a04fc None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:59.459786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b9ef7-5c36-42fb-876d-49391d0a04fc None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:59.460056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b9ef7-5c36-42fb-876d-49391d0a04fc None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:59.465487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 356/705] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:33:59.467699 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b8973-73dc-4d1d-8093-c22d5108b127 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:59.467981 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b8973-73dc-4d1d-8093-c22d5108b127 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:59.468254 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b8973-73dc-4d1d-8093-c22d5108b127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:59.495129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 350/706] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Sep 11 10:33:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:33:59.500174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d63864-c879-4d5f-a3db-7361391f18c7 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:59.503422 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c70b8973-73dc-4d1d-8093-c22d5108b127 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:33:59.504640 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c70b8973-73dc-4d1d-8093-c22d5108b127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:33:59.574121 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 357/707] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:33:59.667555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d63864-c879-4d5f-a3db-7361391f18c7 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:59.731310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18825b02-4b86-4c1e-a358-cd7d7c2fd7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:33:59.731932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18825b02-4b86-4c1e-a358-cd7d7c2fd7a5 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:33:59.732213 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18825b02-4b86-4c1e-a358-cd7d7c2fd7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:33:59.732487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18825b02-4b86-4c1e-a358-cd7d7c2fd7a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:33:59.762194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:33:59.824076 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18825b02-4b86-4c1e-a358-cd7d7c2fd7a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:33:59.825564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18825b02-4b86-4c1e-a358-cd7d7c2fd7a5 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:33:59.850073 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b8973-73dc-4d1d-8093-c22d5108b127 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:59.948202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 351/708] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:33:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 10:33:59.953523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18825b02-4b86-4c1e-a358-cd7d7c2fd7a5 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:33:59.962965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b8973-73dc-4d1d-8093-c22d5108b127 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:33:59.965828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:00.003027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef26d1-0b81-42bb-9788-b1ce77d9633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:00.004005 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef26d1-0b81-42bb-9788-b1ce77d9633b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:00.004482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef26d1-0b81-42bb-9788-b1ce77d9633b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:00.005098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef26d1-0b81-42bb-9788-b1ce77d9633b None admin] PATH_INFO: `/v3/services/network` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:00.006014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef26d1-0b81-42bb-9788-b1ce77d9633b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:00.007578 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef26d1-0b81-42bb-9788-b1ce77d9633b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:00.008820 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:00.021220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-8cef26d1-0b81-42bb-9788-b1ce77d9633b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 10:34:00.021220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:00.021220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:00.021220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:00.021220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:00.021220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:00.021220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:00.021220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:00.021220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 10:34:00.021220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:00.021220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:00.021220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:00.021220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:00.021220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:00.021220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:00.021220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:00.021220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:00.022255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:00.022255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:00.022255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:00.022255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:00.022255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:00.022255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:00.022255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:00.022255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:00.022255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:00.022255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:00.022255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:00.022255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:00.022255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:00.022255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:00.022255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:00.022255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:00.023109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:00.023109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:00.023109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:00.023109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:00.023109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:00.023109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:00.023109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:00.023109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:00.023109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:00.023109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:00.023109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:00.023109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:00.023109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 10:34:00.023109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:00.030382 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 358/709] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:33:59 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:34:00.031573 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef26d1-0b81-42bb-9788-b1ce77d9633b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:00.057112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18825b02-4b86-4c1e-a358-cd7d7c2fd7a5 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:00.094087 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380090e-a554-46a3-b913-23ff8fecc099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:00.094749 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380090e-a554-46a3-b913-23ff8fecc099 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:00.095069 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380090e-a554-46a3-b913-23ff8fecc099 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:00.095347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380090e-a554-46a3-b913-23ff8fecc099 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:00.095958 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380090e-a554-46a3-b913-23ff8fecc099 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:00.097699 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380090e-a554-46a3-b913-23ff8fecc099 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:00.109162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-5380090e-a554-46a3-b913-23ff8fecc099 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 10:34:00.109162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:00.109162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:00.109162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:00.109162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:00.109162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:00.109162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:00.109162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:00.109162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 10:34:00.109162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:00.109162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:00.109162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:00.109162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:00.109162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:00.109162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:00.109162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:00.109162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:00.110231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:00.110231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:00.110231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:00.110231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:00.110231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:00.110231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:00.110231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:00.110231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:00.110231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:00.110231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:00.110231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:00.110231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:00.110231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:00.110231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:00.110231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:00.110231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:00.111121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:00.111121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:00.111121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:00.111121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:00.111121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:00.111121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:00.111121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:00.111121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:00.111121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:00.111121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:00.111121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:00.111121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:00.111121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 10:34:00.111121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:00.111121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 352/710] 10.222.0.20 () {56 vars in 1129 bytes} [Sun Sep 11 10:33:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:00.111895 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380090e-a554-46a3-b913-23ff8fecc099 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:00.154626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef26d1-0b81-42bb-9788-b1ce77d9633b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:00.191333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874519d-d257-450d-b804-96bcb3bfcbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:00.192309 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874519d-d257-450d-b804-96bcb3bfcbe5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:00.192817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874519d-d257-450d-b804-96bcb3bfcbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:00.193312 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874519d-d257-450d-b804-96bcb3bfcbe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:00.205675 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874519d-d257-450d-b804-96bcb3bfcbe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:00.207401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874519d-d257-450d-b804-96bcb3bfcbe5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:00.220950 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380090e-a554-46a3-b913-23ff8fecc099 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:00.224278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-5874519d-d257-450d-b804-96bcb3bfcbe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:00.224278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:00.224278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:00.224278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:00.224278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:00.224278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:00.224278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:00.224278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:00.224278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:00.224278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:00.224278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:00.224278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:00.224278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:00.224278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:00.224278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:00.224278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:00.225533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:00.225533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:00.225533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:00.225533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:00.225533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:00.225533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:00.225533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:00.225533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:00.225533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:00.225533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:00.225533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:00.225533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:00.225533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:00.225533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:00.225533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:00.225533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:00.225533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:00.226409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:00.226409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:00.226409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:00.232854 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 359/711] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:00.233901 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874519d-d257-450d-b804-96bcb3bfcbe5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:00.237824 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:00.257277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a526b6a-3943-4984-a866-90f4104137fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:00.257940 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a526b6a-3943-4984-a866-90f4104137fc None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:00.258354 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a526b6a-3943-4984-a866-90f4104137fc None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:00.258539 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a526b6a-3943-4984-a866-90f4104137fc None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:00.259168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a526b6a-3943-4984-a866-90f4104137fc None admin] RBAC: Adding query filter params (name=network) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:00.259478 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a526b6a-3943-4984-a866-90f4104137fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:00.260957 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a526b6a-3943-4984-a866-90f4104137fc None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:00.262424 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:00.270005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 353/712] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 10:34:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:00.270005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a526b6a-3943-4984-a866-90f4104137fc None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:00.355530 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874519d-d257-450d-b804-96bcb3bfcbe5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:00.371655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a526b6a-3943-4984-a866-90f4104137fc None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:00.393907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64490225-2093-4631-a259-ea35fb871d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:00.395259 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64490225-2093-4631-a259-ea35fb871d71 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:00.396065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64490225-2093-4631-a259-ea35fb871d71 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:00.396797 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64490225-2093-4631-a259-ea35fb871d71 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:00.397648 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64490225-2093-4631-a259-ea35fb871d71 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:00.398147 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64490225-2093-4631-a259-ea35fb871d71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:00.399909 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64490225-2093-4631-a259-ea35fb871d71 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:00.405568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 360/713] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Sep 11 10:34:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:00.406568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64490225-2093-4631-a259-ea35fb871d71 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:00.411970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6c005-e3ba-4215-b741-9a0bdcb42506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:00.412732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6c005-e3ba-4215-b741-9a0bdcb42506 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:00.413017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6c005-e3ba-4215-b741-9a0bdcb42506 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:00.413293 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6c005-e3ba-4215-b741-9a0bdcb42506 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:00.413951 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6c005-e3ba-4215-b741-9a0bdcb42506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:00.414258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6c005-e3ba-4215-b741-9a0bdcb42506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:00.415634 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6c005-e3ba-4215-b741-9a0bdcb42506 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:00.433711 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 354/714] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:00.433711 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6c005-e3ba-4215-b741-9a0bdcb42506 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:00.474861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:00.510307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:00.529893 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64490225-2093-4631-a259-ea35fb871d71 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:00.536822 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6c005-e3ba-4215-b741-9a0bdcb42506 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:00.567452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86820343-f550-47a8-b428-6c54226f414d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:00.568373 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86820343-f550-47a8-b428-6c54226f414d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:00.568877 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86820343-f550-47a8-b428-6c54226f414d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:00.569442 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86820343-f550-47a8-b428-6c54226f414d None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:00.570266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86820343-f550-47a8-b428-6c54226f414d None admin] RBAC: Adding query filter params (type=network) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:00.570763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86820343-f550-47a8-b428-6c54226f414d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:00.572118 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9a460-55b6-46c0-86e0-45a59933192b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:00.572566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86820343-f550-47a8-b428-6c54226f414d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:00.572813 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9a460-55b6-46c0-86e0-45a59933192b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:00.573096 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9a460-55b6-46c0-86e0-45a59933192b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:00.573372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9a460-55b6-46c0-86e0-45a59933192b None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:00.574004 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9a460-55b6-46c0-86e0-45a59933192b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:00.574311 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9a460-55b6-46c0-86e0-45a59933192b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:00.575663 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9a460-55b6-46c0-86e0-45a59933192b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:00.589032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 355/716] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Sep 11 10:34:00 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:00.589225 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 361/716] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 10:34:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:00.590147 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9a460-55b6-46c0-86e0-45a59933192b None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:00.764302 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9a460-55b6-46c0-86e0-45a59933192b None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:00.770906 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:00.806990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc372a-43da-4015-bb6a-ab3abe3c7c8e None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:00.807308 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc372a-43da-4015-bb6a-ab3abe3c7c8e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:00.807549 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc372a-43da-4015-bb6a-ab3abe3c7c8e None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:00.809215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827cad2-755f-4eaf-ac51-e0841b833f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:00.810056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827cad2-755f-4eaf-ac51-e0841b833f37 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:00.810413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 362/717] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:00.810651 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827cad2-755f-4eaf-ac51-e0841b833f37 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:00.811067 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827cad2-755f-4eaf-ac51-e0841b833f37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:00.816343 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25954cb2-1bc7-47ae-b33c-80c2158d5cff None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:00.816669 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25954cb2-1bc7-47ae-b33c-80c2158d5cff None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:00.816949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25954cb2-1bc7-47ae-b33c-80c2158d5cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:00.820357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827cad2-755f-4eaf-ac51-e0841b833f37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:00.822080 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827cad2-755f-4eaf-ac51-e0841b833f37 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:00.839310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-6827cad2-755f-4eaf-ac51-e0841b833f37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:00.839310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:00.839310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:00.839310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:00.839310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:00.839310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:00.839310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:00.839310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:00.839310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:00.839310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:00.839310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:00.839310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:00.839310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:34:00.839310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:34:00.839310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:34:00.840447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:34:00.840447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:00.840447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:00.840447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:00.840447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:00.840447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:00.840447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:00.840447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:00.840447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:00.840447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:00.840447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:00.840447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:00.840447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:00.840447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:00.840447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:00.840447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:00.840447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:00.841595 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:34:00.841595 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:34:00.841595 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:34:00.841595 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:34:00.841595 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:34:00.841595 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:34:00.841595 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:00.841595 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:00.843744 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 356/718] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:00.844698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-25954cb2-1bc7-47ae-b33c-80c2158d5cff None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:00.846593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-25954cb2-1bc7-47ae-b33c-80c2158d5cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:00.850663 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827cad2-755f-4eaf-ac51-e0841b833f37 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:00.966182 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 363/719] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:34:00.999759 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827cad2-755f-4eaf-ac51-e0841b833f37 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:01.039799 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7eb1c-7a04-401d-be02-ce0dc07ef74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:01.040769 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7eb1c-7a04-401d-be02-ce0dc07ef74a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:01.041252 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7eb1c-7a04-401d-be02-ce0dc07ef74a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:01.041722 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7eb1c-7a04-401d-be02-ce0dc07ef74a None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:01.042617 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7eb1c-7a04-401d-be02-ce0dc07ef74a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:01.043140 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7eb1c-7a04-401d-be02-ce0dc07ef74a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:01.044790 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7eb1c-7a04-401d-be02-ce0dc07ef74a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:01.062006 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 357/720] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:34:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:01.068014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25954cb2-1bc7-47ae-b33c-80c2158d5cff None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:01.169749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:01.208718 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25954cb2-1bc7-47ae-b33c-80c2158d5cff None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:01.255630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c538c11-560b-4658-b0e9-100105be1463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:01.256253 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c538c11-560b-4658-b0e9-100105be1463 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:01.256505 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c538c11-560b-4658-b0e9-100105be1463 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:01.256815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c538c11-560b-4658-b0e9-100105be1463 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:01.257553 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c538c11-560b-4658-b0e9-100105be1463 None admin] RBAC: Adding query filter params (role.id=529cb3511f3a498b9b7169ed5b0f6b8e, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=b642a1d00de940429fc1cc6131ac22b1) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:01.257863 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c538c11-560b-4658-b0e9-100105be1463 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:01.259280 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c538c11-560b-4658-b0e9-100105be1463 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:01.269384 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 364/721] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:34:01 2022] GET /identity/v3/role_assignments?user.id=b642a1d00de940429fc1cc6131ac22b1&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=529cb3511f3a498b9b7169ed5b0f6b8e => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:01.335791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7eb1c-7a04-401d-be02-ce0dc07ef74a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:01.373073 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:01.444529 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12431091-d345-41be-a4ed-062ce18b0206 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:01.444878 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12431091-d345-41be-a4ed-062ce18b0206 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:01.445108 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12431091-d345-41be-a4ed-062ce18b0206 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:01.446673 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 365/722] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:01.452056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463f2a9-940a-4965-b749-a75218edddd1 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:01.452388 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463f2a9-940a-4965-b749-a75218edddd1 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:01.452620 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463f2a9-940a-4965-b749-a75218edddd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:01.461185 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7eb1c-7a04-401d-be02-ce0dc07ef74a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:01.493259 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7463f2a9-940a-4965-b749-a75218edddd1 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:01.495774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7463f2a9-940a-4965-b749-a75218edddd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:01.528933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9eb14-e5fa-44b3-9273-6d9d2aee6206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:01.529957 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9eb14-e5fa-44b3-9273-6d9d2aee6206 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:01.531326 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9eb14-e5fa-44b3-9273-6d9d2aee6206 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:01.531816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9eb14-e5fa-44b3-9273-6d9d2aee6206 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:01.553580 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9eb14-e5fa-44b3-9273-6d9d2aee6206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:34:01.559404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-fdd9eb14-e5fa-44b3-9273-6d9d2aee6206 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:34:01.559404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:01.559404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:01.559404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:01.559404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:01.559404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:01.559404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:01.559404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:01.559404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:01.559404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:01.559404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:01.559404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:01.559404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:34:01.559404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:34:01.559404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:34:01.559404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:34:01.560352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:34:01.560352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:34:01.560352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:34:01.560352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:34:01.560352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:01.560352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:01.560352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:01.560352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:01.560352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:01.560352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:01.560352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:01.560352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:01.560352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:01.560352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:01.560352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:01.560352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:01.561241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:01.561241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:01.561241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:01.561241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:01.561241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:34:01.561241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:34:01.561241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:34:01.561241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:34:01.561241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:34:01.561241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:34:01.561241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:34:01.561241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:01.564497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 358/723] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:34:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:01.569925 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9eb14-e5fa-44b3-9273-6d9d2aee6206 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:01.644379 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 366/724] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 10:34:01.731673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:01.759241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9eb14-e5fa-44b3-9273-6d9d2aee6206 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:01.803564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87521d-15f8-4e58-a7b1-cf49cd7aae43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:01.804173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87521d-15f8-4e58-a7b1-cf49cd7aae43 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:01.804464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87521d-15f8-4e58-a7b1-cf49cd7aae43 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:01.804738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87521d-15f8-4e58-a7b1-cf49cd7aae43 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:01.805401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87521d-15f8-4e58-a7b1-cf49cd7aae43 None admin] RBAC: Adding query filter params (name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:01.805699 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87521d-15f8-4e58-a7b1-cf49cd7aae43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:01.807049 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87521d-15f8-4e58-a7b1-cf49cd7aae43 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:01.819808 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 359/725] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:34:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:01.825231 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463f2a9-940a-4965-b749-a75218edddd1 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:01.915020 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87521d-15f8-4e58-a7b1-cf49cd7aae43 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:01.924976 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:01.974499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463f2a9-940a-4965-b749-a75218edddd1 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:02.038210 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b0882-cd87-431a-a4c6-c6c286612418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:02.038839 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b0882-cd87-431a-a4c6-c6c286612418 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:02.039116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b0882-cd87-431a-a4c6-c6c286612418 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:02.039382 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b0882-cd87-431a-a4c6-c6c286612418 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:02.063487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b0882-cd87-431a-a4c6-c6c286612418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:02.065019 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b0882-cd87-431a-a4c6-c6c286612418 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:02.082235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-a38b0882-cd87-431a-a4c6-c6c286612418 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:02.082235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:02.082235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:02.082235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:02.082235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:02.082235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:02.082235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:02.082235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:02.082235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:02.082235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:02.082235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:02.082235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:02.082235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:02.082235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:02.082235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:02.082235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:02.083219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:02.083219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:02.083219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:02.083219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:02.083219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:02.083219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:02.083219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:02.083219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:02.083219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:02.083219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:02.083219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:02.083219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:02.083219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:02.083219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:02.083219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:02.083219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:02.083219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:02.084153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:02.084153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:02.084153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:02.084153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 367/726] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:02.089874 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b0882-cd87-431a-a4c6-c6c286612418 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:02.113204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87521d-15f8-4e58-a7b1-cf49cd7aae43 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:02.187064 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056da3a2-375c-4bf4-8ca6-9210ea0f7af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:02.187627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056da3a2-375c-4bf4-8ca6-9210ea0f7af8 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:02.187917 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056da3a2-375c-4bf4-8ca6-9210ea0f7af8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:02.188167 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056da3a2-375c-4bf4-8ca6-9210ea0f7af8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:02.215583 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056da3a2-375c-4bf4-8ca6-9210ea0f7af8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:34:02.221947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-056da3a2-375c-4bf4-8ca6-9210ea0f7af8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:34:02.221947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:02.221947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:02.221947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:02.221947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:02.221947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:02.221947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:02.221947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:02.221947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:02.221947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:02.221947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:02.221947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:02.221947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:34:02.221947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:34:02.221947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:34:02.221947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:34:02.222904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:34:02.222904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:34:02.222904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:34:02.222904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:34:02.222904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:02.222904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:02.222904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:02.222904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:02.222904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:02.222904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:02.222904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:02.222904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:02.222904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:02.222904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:02.222904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:02.222904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:02.223772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:02.223772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:02.223772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:02.223772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:02.223772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:34:02.223772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:34:02.223772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:34:02.223772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:34:02.223772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:34:02.223772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:34:02.223772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:34:02.223772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:02.232892 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 360/727] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:34:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:02.239110 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056da3a2-375c-4bf4-8ca6-9210ea0f7af8 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:02.241931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b0882-cd87-431a-a4c6-c6c286612418 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:02.256918 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:02.291702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:02.315789 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c02797-383e-4ce5-935d-38cb01cc8664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:02.316395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c02797-383e-4ce5-935d-38cb01cc8664 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:02.316690 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c02797-383e-4ce5-935d-38cb01cc8664 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:02.316960 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c02797-383e-4ce5-935d-38cb01cc8664 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:02.317603 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c02797-383e-4ce5-935d-38cb01cc8664 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:02.317898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c02797-383e-4ce5-935d-38cb01cc8664 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:02.319250 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c02797-383e-4ce5-935d-38cb01cc8664 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:02.336488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 368/728] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:02.337748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c02797-383e-4ce5-935d-38cb01cc8664 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:02.451870 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056da3a2-375c-4bf4-8ca6-9210ea0f7af8 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:02.482552 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c02797-383e-4ce5-935d-38cb01cc8664 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:02.518469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc785b-5bb5-408c-adf5-5854a80788fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:02.519095 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc785b-5bb5-408c-adf5-5854a80788fe None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:02.519372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc785b-5bb5-408c-adf5-5854a80788fe None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:02.519643 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc785b-5bb5-408c-adf5-5854a80788fe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:02.527494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc785b-5bb5-408c-adf5-5854a80788fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:02.528940 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc785b-5bb5-408c-adf5-5854a80788fe None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:02.540953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-1bdc785b-5bb5-408c-adf5-5854a80788fe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 10:34:02.540953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:02.540953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:02.540953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:02.540953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:02.540953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:02.540953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:02.540953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:02.540953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:02.540953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:02.540953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:02.540953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:02.540953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:34:02.540953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:34:02.540953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:34:02.540953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:34:02.541892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:02.541892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:02.541892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:34:02.541892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:02.541892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:34:02.541892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:02.541892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:02.541892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:02.541892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:02.541892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:02.541892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:02.541892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:02.541892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:02.541892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:02.541892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:02.541892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:02.541892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:02.541892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:02.542836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:02.542836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:02.542836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:34:02.542836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:34:02.542836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:34:02.542836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:34:02.542836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:34:02.542836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:34:02.542836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 10:34:02.542836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:02.546698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 369/729] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Sep 11 10:34:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:02.547841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc785b-5bb5-408c-adf5-5854a80788fe None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:02.549410 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a19f9-5e6c-491d-af98-c6c4af1c288e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:02.550033 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a19f9-5e6c-491d-af98-c6c4af1c288e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:02.550314 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a19f9-5e6c-491d-af98-c6c4af1c288e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:02.550588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a19f9-5e6c-491d-af98-c6c4af1c288e None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:02.551262 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a19f9-5e6c-491d-af98-c6c4af1c288e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:02.551562 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a19f9-5e6c-491d-af98-c6c4af1c288e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:02.552966 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a19f9-5e6c-491d-af98-c6c4af1c288e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:02.583039 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 361/730] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:34:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:02.589465 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a19f9-5e6c-491d-af98-c6c4af1c288e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:02.607234 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:02.664940 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc785b-5bb5-408c-adf5-5854a80788fe None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:02.703417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f844d9-7cc6-4f78-9380-0b6cffa7defc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:02.703947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f844d9-7cc6-4f78-9380-0b6cffa7defc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:02.704759 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f844d9-7cc6-4f78-9380-0b6cffa7defc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:02.705046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f844d9-7cc6-4f78-9380-0b6cffa7defc None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:02.706059 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f844d9-7cc6-4f78-9380-0b6cffa7defc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:02.706369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f844d9-7cc6-4f78-9380-0b6cffa7defc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:02.708069 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f844d9-7cc6-4f78-9380-0b6cffa7defc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:02.727464 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 370/731] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Sep 11 10:34:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:02.733534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f844d9-7cc6-4f78-9380-0b6cffa7defc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:02.742993 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:02.781279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a19f9-5e6c-491d-af98-c6c4af1c288e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:02.817014 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8e6c7-4686-493e-86e1-34fc0f6b541a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:02.817702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8e6c7-4686-493e-86e1-34fc0f6b541a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:02.818025 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8e6c7-4686-493e-86e1-34fc0f6b541a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:02.818300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8e6c7-4686-493e-86e1-34fc0f6b541a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:02.829809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8e6c7-4686-493e-86e1-34fc0f6b541a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:02.831304 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8e6c7-4686-493e-86e1-34fc0f6b541a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:02.854042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-53a8e6c7-4686-493e-86e1-34fc0f6b541a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:02.854042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:02.854042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:02.854042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:02.854042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:02.854042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:02.854042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:02.854042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:02.854042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:02.854042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:02.854042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:02.854042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:02.854042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:02.854042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:02.854042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:02.854042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:02.855011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:02.855011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:02.855011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:02.855011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:02.855011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:02.855011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:02.855011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:02.855011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:02.855011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:02.855011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:02.855011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:02.855011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:02.855011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:02.855011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:02.855011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:02.855011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:02.855011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:02.856291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:02.856291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:02.856291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:02.856291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 362/732] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:02.862934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8e6c7-4686-493e-86e1-34fc0f6b541a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:02.947529 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f844d9-7cc6-4f78-9380-0b6cffa7defc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:02.950896 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:02.988536 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1842d2b-c242-4184-bd4f-34a7fd9a8e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:02.989524 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1842d2b-c242-4184-bd4f-34a7fd9a8e41 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:02.989999 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1842d2b-c242-4184-bd4f-34a7fd9a8e41 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:02.990461 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1842d2b-c242-4184-bd4f-34a7fd9a8e41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:03.028024 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8e6c7-4686-493e-86e1-34fc0f6b541a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:03.050021 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:03.080372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfcff7-ff1a-48ba-981e-00e921e76917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:03.081458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfcff7-ff1a-48ba-981e-00e921e76917 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:03.081982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfcff7-ff1a-48ba-981e-00e921e76917 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:03.082452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfcff7-ff1a-48ba-981e-00e921e76917 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:03.083488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfcff7-ff1a-48ba-981e-00e921e76917 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:03.083991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfcff7-ff1a-48ba-981e-00e921e76917 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:03.085803 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfcff7-ff1a-48ba-981e-00e921e76917 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:03.095787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1842d2b-c242-4184-bd4f-34a7fd9a8e41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:03.097568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1842d2b-c242-4184-bd4f-34a7fd9a8e41 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:03.106289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 363/733] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:03.121924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfcff7-ff1a-48ba-981e-00e921e76917 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:03.207547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 371/734] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:34:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:34:03.209087 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5264b2f-e4c8-4cf1-b8aa-b38dbb9f3671 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:03.209545 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5264b2f-e4c8-4cf1-b8aa-b38dbb9f3671 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:03.209833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5264b2f-e4c8-4cf1-b8aa-b38dbb9f3671 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:03.211658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 372/735] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:03.212592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5264b2f-e4c8-4cf1-b8aa-b38dbb9f3671 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:03.215518 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:03.262660 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfcff7-ff1a-48ba-981e-00e921e76917 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:03.301423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6512ce7-1950-4280-9995-28d6560b0c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:03.302359 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6512ce7-1950-4280-9995-28d6560b0c15 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:03.302836 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6512ce7-1950-4280-9995-28d6560b0c15 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:03.303280 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6512ce7-1950-4280-9995-28d6560b0c15 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:03.312591 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6512ce7-1950-4280-9995-28d6560b0c15 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:03.314534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6512ce7-1950-4280-9995-28d6560b0c15 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:03.320022 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5264b2f-e4c8-4cf1-b8aa-b38dbb9f3671 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:03.330175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-d6512ce7-1950-4280-9995-28d6560b0c15 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 10:34:03.330175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:03.330175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:03.330175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:03.330175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:03.330175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:03.330175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:03.330175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:03.330175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:03.330175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:03.330175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:03.330175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:03.330175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:34:03.330175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:34:03.330175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:34:03.330175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:34:03.331267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:03.331267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:03.331267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:34:03.331267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:03.331267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:34:03.331267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:03.331267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:03.331267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:03.331267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:03.331267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:03.331267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:03.331267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:03.331267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:03.331267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:03.331267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:03.331267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:03.331267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:03.331267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:03.332192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:03.332192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:03.332192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:34:03.332192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:34:03.332192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:34:03.332192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:34:03.332192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:34:03.332192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:34:03.332192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 10:34:03.332192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:03.334481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 364/736] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:34:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:34:03.335898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f38590-ea23-4959-9dc9-42f29b2f48c3 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:03.336407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f38590-ea23-4959-9dc9-42f29b2f48c3 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:03.336899 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f38590-ea23-4959-9dc9-42f29b2f48c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:03.356736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-35f38590-ea23-4959-9dc9-42f29b2f48c3 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:03.358534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-35f38590-ea23-4959-9dc9-42f29b2f48c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:03.363420 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362d287-b4ab-455a-9ec5-af3b35b2d24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:03.363837 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362d287-b4ab-455a-9ec5-af3b35b2d24b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:03.364114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362d287-b4ab-455a-9ec5-af3b35b2d24b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:03.364383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362d287-b4ab-455a-9ec5-af3b35b2d24b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:03.375090 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362d287-b4ab-455a-9ec5-af3b35b2d24b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:03.376896 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362d287-b4ab-455a-9ec5-af3b35b2d24b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:03.392425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-8362d287-b4ab-455a-9ec5-af3b35b2d24b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:03.392425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:03.392425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:03.392425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:03.392425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:03.392425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:03.392425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:03.392425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:03.392425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:03.392425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:03.392425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:03.392425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:03.392425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:03.392425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:03.392425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:03.392425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:03.393429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:03.393429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:03.393429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:03.393429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:03.393429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:03.393429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:03.393429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:03.393429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:03.393429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:03.393429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:03.393429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:03.393429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:03.393429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:03.393429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:03.393429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:03.393429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:03.393429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:03.394299 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:03.394299 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:03.394299 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:03.398191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 373/737] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:03.399034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362d287-b4ab-455a-9ec5-af3b35b2d24b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:03.403411 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:03.442005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 365/738] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:34:03.442998 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f38590-ea23-4959-9dc9-42f29b2f48c3 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:03.461347 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:03.522273 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362d287-b4ab-455a-9ec5-af3b35b2d24b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:03.565381 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5e184-09e7-4491-be9c-6a7d486fb406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:03.565986 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5e184-09e7-4491-be9c-6a7d486fb406 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:03.566256 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5e184-09e7-4491-be9c-6a7d486fb406 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:03.566519 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5e184-09e7-4491-be9c-6a7d486fb406 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:03.567488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5e184-09e7-4491-be9c-6a7d486fb406 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:03.567792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5e184-09e7-4491-be9c-6a7d486fb406 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:03.569498 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5e184-09e7-4491-be9c-6a7d486fb406 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:03.574486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f38590-ea23-4959-9dc9-42f29b2f48c3 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:03.589387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 374/739] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Sep 11 10:34:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:03.591013 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711057d-9b53-4d89-9e9f-b69e3c3fe567 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:03.591502 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711057d-9b53-4d89-9e9f-b69e3c3fe567 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:03.591978 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711057d-9b53-4d89-9e9f-b69e3c3fe567 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:03.598076 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 375/740] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:03.599431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17100bd5-f460-45bd-a6c0-9769cd14205e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:03.599920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17100bd5-f460-45bd-a6c0-9769cd14205e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:03.600435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17100bd5-f460-45bd-a6c0-9769cd14205e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:03.616596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0af87-fa6a-4e1f-8ace-c91291108820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:03.618686 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0af87-fa6a-4e1f-8ace-c91291108820 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:03.618821 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0af87-fa6a-4e1f-8ace-c91291108820 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:03.619087 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0af87-fa6a-4e1f-8ace-c91291108820 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:03.619730 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0af87-fa6a-4e1f-8ace-c91291108820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:03.620035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0af87-fa6a-4e1f-8ace-c91291108820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:03.621426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0af87-fa6a-4e1f-8ace-c91291108820 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:03.621918 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-17100bd5-f460-45bd-a6c0-9769cd14205e None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:03.623368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-17100bd5-f460-45bd-a6c0-9769cd14205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:03.638633 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 366/741] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:03.639558 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0af87-fa6a-4e1f-8ace-c91291108820 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:03.672165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:03.700573 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 376/742] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:34:03.701844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17100bd5-f460-45bd-a6c0-9769cd14205e None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:03.751791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0af87-fa6a-4e1f-8ace-c91291108820 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:03.757824 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:03.794145 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189cb2d-99ae-4f9b-ac20-31e8abfaf9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:03.794766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189cb2d-99ae-4f9b-ac20-31e8abfaf9e7 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:03.795047 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189cb2d-99ae-4f9b-ac20-31e8abfaf9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:03.795317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189cb2d-99ae-4f9b-ac20-31e8abfaf9e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:03.817722 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17100bd5-f460-45bd-a6c0-9769cd14205e None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:03.859934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96103b2b-63ae-44a2-bef5-8d20aa3c1209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:03.860740 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96103b2b-63ae-44a2-bef5-8d20aa3c1209 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:03.861284 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96103b2b-63ae-44a2-bef5-8d20aa3c1209 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:03.861564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96103b2b-63ae-44a2-bef5-8d20aa3c1209 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:03.868975 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189cb2d-99ae-4f9b-ac20-31e8abfaf9e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:03.869334 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96103b2b-63ae-44a2-bef5-8d20aa3c1209 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:03.870417 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189cb2d-99ae-4f9b-ac20-31e8abfaf9e7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:03.870749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96103b2b-63ae-44a2-bef5-8d20aa3c1209 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:03.884947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-96103b2b-63ae-44a2-bef5-8d20aa3c1209 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:03.884947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:03.884947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:03.884947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:03.884947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:03.884947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:03.884947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:03.884947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:03.884947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:03.884947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:03.884947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:03.884947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:03.884947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:34:03.884947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:34:03.884947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:34:03.885826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:34:03.885826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:03.885826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:03.885826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:03.885826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:03.885826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:03.885826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:03.885826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:03.885826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:03.885826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:03.885826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:03.885826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:03.885826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:03.885826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:03.885826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:03.885826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:03.885826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:03.886693 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:34:03.886693 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:34:03.886693 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:34:03.886693 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:34:03.886693 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:34:03.886693 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:34:03.886693 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:03.886693 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:03.886693 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 377/743] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:03.887167 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96103b2b-63ae-44a2-bef5-8d20aa3c1209 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:03.902748 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:03.976426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 367/744] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:34:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 10:34:03.982388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3405b-7133-4603-970a-12f925a80f56 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:03.982682 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3405b-7133-4603-970a-12f925a80f56 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:03.982959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3405b-7133-4603-970a-12f925a80f56 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:03.984534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 368/745] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:03.989048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3405b-7133-4603-970a-12f925a80f56 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:03.989822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96103b2b-63ae-44a2-bef5-8d20aa3c1209 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:03.991405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:04.025825 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118680f-20c9-413c-932f-cb20bf24f0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:04.026428 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118680f-20c9-413c-932f-cb20bf24f0d4 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:04.026705 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118680f-20c9-413c-932f-cb20bf24f0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:04.026971 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118680f-20c9-413c-932f-cb20bf24f0d4 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:04.027610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118680f-20c9-413c-932f-cb20bf24f0d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:04.028991 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118680f-20c9-413c-932f-cb20bf24f0d4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:04.045152 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 378/746] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 10:34:03 2022] POST /identity/v3/services => generated 240 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:34:04.045878 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118680f-20c9-413c-932f-cb20bf24f0d4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:04.105993 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3405b-7133-4603-970a-12f925a80f56 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:04.136535 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:04.148181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1aa2f-aab8-4baa-8368-402b9b859ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:04.149038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1aa2f-aab8-4baa-8368-402b9b859ca0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:04.149315 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1aa2f-aab8-4baa-8368-402b9b859ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:04.149582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1aa2f-aab8-4baa-8368-402b9b859ca0 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:04.150292 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1aa2f-aab8-4baa-8368-402b9b859ca0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:04.151087 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1aa2f-aab8-4baa-8368-402b9b859ca0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:04.152571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1aa2f-aab8-4baa-8368-402b9b859ca0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:04.163963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118680f-20c9-413c-932f-cb20bf24f0d4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:04.170431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 369/747] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:34:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:04.170431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147e4a4-471e-451c-87c2-3b28e85514fc None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:04.170431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147e4a4-471e-451c-87c2-3b28e85514fc None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:04.170431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147e4a4-471e-451c-87c2-3b28e85514fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:04.187855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-c147e4a4-471e-451c-87c2-3b28e85514fc None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:04.189186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c147e4a4-471e-451c-87c2-3b28e85514fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:04.210761 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3266c33-b534-4183-a9fb-cd4518d2c54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:04.211393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3266c33-b534-4183-a9fb-cd4518d2c54e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:04.211670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3266c33-b534-4183-a9fb-cd4518d2c54e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:04.211941 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3266c33-b534-4183-a9fb-cd4518d2c54e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:04.225852 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3266c33-b534-4183-a9fb-cd4518d2c54e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:04.227278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3266c33-b534-4183-a9fb-cd4518d2c54e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:04.243083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-c3266c33-b534-4183-a9fb-cd4518d2c54e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:04.243083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:04.243083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:04.243083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:04.243083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:04.243083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:04.243083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:04.243083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:04.243083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:04.243083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:04.243083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:04.243083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:04.243083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:04.243083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:04.243083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:04.243083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:04.244098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:04.244098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:04.244098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:04.244098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:04.244098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:04.244098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:04.244098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:04.244098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:04.244098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:04.244098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:04.244098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:04.244098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:04.244098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:04.244098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:04.244098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:04.244098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:04.244098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:04.245433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:04.245433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:04.245433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:04.245433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 379/748] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:04.246513 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3266c33-b534-4183-a9fb-cd4518d2c54e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:04.266424 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:04.272266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 370/749] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:04 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 10:34:04.273411 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147e4a4-471e-451c-87c2-3b28e85514fc None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:04.375247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3266c33-b534-4183-a9fb-cd4518d2c54e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:04.401611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147e4a4-471e-451c-87c2-3b28e85514fc None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:04.417778 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65df5b-0105-47c3-a02d-c49ce1ff5bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:04.418448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65df5b-0105-47c3-a02d-c49ce1ff5bcd None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:04.418731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65df5b-0105-47c3-a02d-c49ce1ff5bcd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:04.419140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65df5b-0105-47c3-a02d-c49ce1ff5bcd None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:04.419942 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65df5b-0105-47c3-a02d-c49ce1ff5bcd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:04.421577 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65df5b-0105-47c3-a02d-c49ce1ff5bcd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:04.425694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:04.448579 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 380/750] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 10:34:04 2022] POST /identity/v3/services => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:34:04.448579 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65df5b-0105-47c3-a02d-c49ce1ff5bcd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:04.469124 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e95f5c-75f1-4678-bc45-4a90c256f20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:04.470939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e95f5c-75f1-4678-bc45-4a90c256f20b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:04.471219 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e95f5c-75f1-4678-bc45-4a90c256f20b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:04.472467 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e95f5c-75f1-4678-bc45-4a90c256f20b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:04.475775 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e95f5c-75f1-4678-bc45-4a90c256f20b None admin] RBAC: Adding query filter params (role.id=295de8f316124ccdac36a50e50531148, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=bdc800f1d4174b5cba4f6f496207ec95) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:04.476122 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e95f5c-75f1-4678-bc45-4a90c256f20b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:04.477687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e95f5c-75f1-4678-bc45-4a90c256f20b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:04.492872 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 371/751] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:34:04 2022] GET /identity/v3/role_assignments?user.id=bdc800f1d4174b5cba4f6f496207ec95&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=295de8f316124ccdac36a50e50531148 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:04.545269 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e95f5c-75f1-4678-bc45-4a90c256f20b None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:04.588996 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:04.650991 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65df5b-0105-47c3-a02d-c49ce1ff5bcd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:04.713931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3565dc-1753-4af9-ad5e-e1ae4ccd1f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:04.714554 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3565dc-1753-4af9-ad5e-e1ae4ccd1f5a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:04.714834 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3565dc-1753-4af9-ad5e-e1ae4ccd1f5a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:04.715107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3565dc-1753-4af9-ad5e-e1ae4ccd1f5a None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:04.715766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3565dc-1753-4af9-ad5e-e1ae4ccd1f5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:04.716071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3565dc-1753-4af9-ad5e-e1ae4ccd1f5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:04.718177 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3565dc-1753-4af9-ad5e-e1ae4ccd1f5a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:04.731950 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e95f5c-75f1-4678-bc45-4a90c256f20b None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:04.733705 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 381/752] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:04.744017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3565dc-1753-4af9-ad5e-e1ae4ccd1f5a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:04.787619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050750a2-ad61-450b-9765-76eaef4563f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:04.788871 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050750a2-ad61-450b-9765-76eaef4563f1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:04.788871 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050750a2-ad61-450b-9765-76eaef4563f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:04.788871 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050750a2-ad61-450b-9765-76eaef4563f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:04.800567 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050750a2-ad61-450b-9765-76eaef4563f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:34:04.806857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-050750a2-ad61-450b-9765-76eaef4563f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:34:04.806857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:04.806857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:04.806857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:04.806857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:04.806857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:04.806857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:04.806857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:04.806857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:04.806857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:04.806857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:04.806857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:04.806857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:34:04.806857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:34:04.806857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:34:04.806857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:34:04.807791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:34:04.807791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:34:04.807791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:34:04.807791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:34:04.807791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:04.807791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:04.807791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:04.807791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:04.807791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:04.807791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:04.807791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:04.807791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:04.807791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:04.807791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:04.807791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:04.807791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:04.808668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:04.808668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:04.808668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:04.808668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:04.808668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:34:04.808668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:34:04.808668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:34:04.808668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:34:04.808668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:34:04.808668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:34:04.808668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:34:04.808668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:04.815860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 372/753] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:34:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:34:04.817434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050750a2-ad61-450b-9765-76eaef4563f1 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:04.856508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:04.861946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3565dc-1753-4af9-ad5e-e1ae4ccd1f5a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:04.897707 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa22e5-4545-4e31-b749-2c319e326ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:04.898354 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa22e5-4545-4e31-b749-2c319e326ded None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:04.898632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa22e5-4545-4e31-b749-2c319e326ded None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:04.898909 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa22e5-4545-4e31-b749-2c319e326ded None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:04.900865 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:04.906639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa22e5-4545-4e31-b749-2c319e326ded None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:04.908143 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa22e5-4545-4e31-b749-2c319e326ded None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:04.920383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-9ffa22e5-4545-4e31-b749-2c319e326ded None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:04.920383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:04.920383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:04.920383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:04.920383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:04.920383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:04.920383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:04.920383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:04.920383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:04.920383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:04.920383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:04.920383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:04.920383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:34:04.920383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:34:04.920383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:34:04.921537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:34:04.921537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:04.921537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:04.921537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:04.921537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:04.921537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:04.921537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:04.921537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:04.921537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:04.921537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:04.921537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:04.921537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:04.921537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:04.921537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:04.921537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:04.921537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:04.921537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:04.922453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:34:04.922453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:34:04.922453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:34:04.922453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:34:04.922453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:34:04.922453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:34:04.922453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:04.922453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:04.923649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 382/754] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:34:04.929065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa22e5-4545-4e31-b749-2c319e326ded None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:04.938910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050750a2-ad61-450b-9765-76eaef4563f1 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:04.990754 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba5df2-a4c0-41fe-80b6-28fb2c457946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:04.991708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba5df2-a4c0-41fe-80b6-28fb2c457946 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:04.992163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba5df2-a4c0-41fe-80b6-28fb2c457946 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:04.992637 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba5df2-a4c0-41fe-80b6-28fb2c457946 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:04.993596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba5df2-a4c0-41fe-80b6-28fb2c457946 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:04.994073 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba5df2-a4c0-41fe-80b6-28fb2c457946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:04.995667 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba5df2-a4c0-41fe-80b6-28fb2c457946 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:05.008667 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 373/755] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:34:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:05.011303 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba5df2-a4c0-41fe-80b6-28fb2c457946 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:05.035217 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa22e5-4545-4e31-b749-2c319e326ded None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:05.087230 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9dcb21-20c9-4561-8443-03cfa4d004bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:05.088006 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dcb21-20c9-4561-8443-03cfa4d004bd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:05.088363 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dcb21-20c9-4561-8443-03cfa4d004bd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:05.088771 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dcb21-20c9-4561-8443-03cfa4d004bd None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:05.089754 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9dcb21-20c9-4561-8443-03cfa4d004bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:05.089938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9dcb21-20c9-4561-8443-03cfa4d004bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:05.092578 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9dcb21-20c9-4561-8443-03cfa4d004bd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:05.104798 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 383/756] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:34:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:05.111198 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9dcb21-20c9-4561-8443-03cfa4d004bd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:05.173766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:05.190281 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:05.195552 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba5df2-a4c0-41fe-80b6-28fb2c457946 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:05.237614 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b1f66-f8e9-4b1b-bac9-d9044932ba21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:05.239130 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b1f66-f8e9-4b1b-bac9-d9044932ba21 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:05.239425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b1f66-f8e9-4b1b-bac9-d9044932ba21 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:05.239704 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b1f66-f8e9-4b1b-bac9-d9044932ba21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:05.252898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b1f66-f8e9-4b1b-bac9-d9044932ba21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:05.254372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b1f66-f8e9-4b1b-bac9-d9044932ba21 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:05.273855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-dd6b1f66-f8e9-4b1b-bac9-d9044932ba21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:05.273855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:05.273855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:05.273855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:05.273855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:05.273855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:05.273855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:05.273855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:05.273855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:05.273855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:05.273855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:05.273855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:05.273855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:05.273855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:05.273855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:05.273855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:05.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:05.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:05.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:05.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:05.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:05.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:05.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:05.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:05.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:05.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:05.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:05.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:05.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:05.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:05.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:05.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:05.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:05.275736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:05.275736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:05.275736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:05.275736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 374/757] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:34:05.280855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b1f66-f8e9-4b1b-bac9-d9044932ba21 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:05.282109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9dcb21-20c9-4561-8443-03cfa4d004bd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:05.325700 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d0c0e-f8c0-46c0-b00f-761ea3d002ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:05.326312 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d0c0e-f8c0-46c0-b00f-761ea3d002ee None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:05.326752 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d0c0e-f8c0-46c0-b00f-761ea3d002ee None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:05.327031 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d0c0e-f8c0-46c0-b00f-761ea3d002ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:05.327770 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d0c0e-f8c0-46c0-b00f-761ea3d002ee None admin] RBAC: Adding query filter params (role.id=529cb3511f3a498b9b7169ed5b0f6b8e, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=28ff72290fd14ddaba6ed757051e182b) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:05.328079 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d0c0e-f8c0-46c0-b00f-761ea3d002ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:05.329627 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d0c0e-f8c0-46c0-b00f-761ea3d002ee None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:05.335975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 384/758] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:34:05 2022] GET /identity/v3/role_assignments?user.id=28ff72290fd14ddaba6ed757051e182b&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=529cb3511f3a498b9b7169ed5b0f6b8e => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:05.448436 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b1f66-f8e9-4b1b-bac9-d9044932ba21 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:05.510940 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bddc3-80b3-4f7b-a3f2-03931fc56428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:05.511573 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bddc3-80b3-4f7b-a3f2-03931fc56428 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:05.511847 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bddc3-80b3-4f7b-a3f2-03931fc56428 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:05.512118 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bddc3-80b3-4f7b-a3f2-03931fc56428 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:05.512809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17bddc3-80b3-4f7b-a3f2-03931fc56428 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:05.513112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17bddc3-80b3-4f7b-a3f2-03931fc56428 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:05.514524 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17bddc3-80b3-4f7b-a3f2-03931fc56428 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:05.532236 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 375/759] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:05.538092 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d0c0e-f8c0-46c0-b00f-761ea3d002ee None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:05.675641 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d0c0e-f8c0-46c0-b00f-761ea3d002ee None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:05.695156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:05.718068 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e228a-1c58-4e8c-8e1d-8800f2b832ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:05.718715 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e228a-1c58-4e8c-8e1d-8800f2b832ac None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:05.718997 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e228a-1c58-4e8c-8e1d-8800f2b832ac None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:05.719272 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e228a-1c58-4e8c-8e1d-8800f2b832ac None admin] PATH_INFO: `/v3/users/nova` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:05.726934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e228a-1c58-4e8c-8e1d-8800f2b832ac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:05.728371 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e228a-1c58-4e8c-8e1d-8800f2b832ac None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:05.740534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-7e6e228a-1c58-4e8c-8e1d-8800f2b832ac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 10:34:05.740534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:05.740534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:05.740534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:05.740534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:05.740534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:05.740534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:05.740534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:05.740534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:05.740534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:05.740534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:05.740534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:05.740534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:34:05.740534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:34:05.740534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:34:05.740534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:34:05.741471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:05.741471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:05.741471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:34:05.741471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:05.741471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:34:05.741471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:05.741471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:05.741471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:05.741471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:05.741471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:05.741471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:05.741471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:05.741471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:05.741471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:05.741471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:05.741471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:05.741471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:05.741471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:05.742401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:05.742401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:05.742401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:34:05.742401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:34:05.742401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:34:05.742401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:34:05.742401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:34:05.742401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:34:05.742401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 10:34:05.742401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:05.742401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 385/760] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Sep 11 10:34:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:05.747588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bddc3-80b3-4f7b-a3f2-03931fc56428 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:05.765041 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:05.887256 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bddc3-80b3-4f7b-a3f2-03931fc56428 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:05.931932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc046c7-d3d5-4fee-886b-246277bba67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:05.932533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc046c7-d3d5-4fee-886b-246277bba67c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:05.932828 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc046c7-d3d5-4fee-886b-246277bba67c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:05.933097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc046c7-d3d5-4fee-886b-246277bba67c None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:05.933824 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc046c7-d3d5-4fee-886b-246277bba67c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:05.934155 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc046c7-d3d5-4fee-886b-246277bba67c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:05.935547 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc046c7-d3d5-4fee-886b-246277bba67c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:05.960658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 376/761] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Sep 11 10:34:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:05.962453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e228a-1c58-4e8c-8e1d-8800f2b832ac None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:06.121233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e228a-1c58-4e8c-8e1d-8800f2b832ac None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:06.162386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343e76a-2b8e-4534-830c-e3932afb4b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:06.163018 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343e76a-2b8e-4534-830c-e3932afb4b1d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:06.163294 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343e76a-2b8e-4534-830c-e3932afb4b1d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:06.163620 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343e76a-2b8e-4534-830c-e3932afb4b1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:06.180293 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343e76a-2b8e-4534-830c-e3932afb4b1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:06.181758 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343e76a-2b8e-4534-830c-e3932afb4b1d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:06.196814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-0343e76a-2b8e-4534-830c-e3932afb4b1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:06.196814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:06.196814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:06.196814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:06.196814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:06.196814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:06.196814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:06.196814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:06.196814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:06.196814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:06.196814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:06.196814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:06.196814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:06.196814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:06.196814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:06.196814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:06.198966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:06.198966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:06.198966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:06.198966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:06.198966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:06.198966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:06.198966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:06.198966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:06.198966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:06.198966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:06.198966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:06.198966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:06.198966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:06.198966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:06.198966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:06.198966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:06.198966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:06.200051 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:06.200051 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:06.200051 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:06.200051 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 386/762] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:06.203402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc046c7-d3d5-4fee-886b-246277bba67c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:06.283744 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:06.329695 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc046c7-d3d5-4fee-886b-246277bba67c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:06.378255 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616bc5e-4f03-4c67-93f9-ad28933ed7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:06.378846 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616bc5e-4f03-4c67-93f9-ad28933ed7bc None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:06.379123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616bc5e-4f03-4c67-93f9-ad28933ed7bc None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:06.379392 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616bc5e-4f03-4c67-93f9-ad28933ed7bc None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:06.380087 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616bc5e-4f03-4c67-93f9-ad28933ed7bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:06.380390 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616bc5e-4f03-4c67-93f9-ad28933ed7bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:06.381930 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616bc5e-4f03-4c67-93f9-ad28933ed7bc None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:06.399337 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 377/763] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:06.404581 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343e76a-2b8e-4534-830c-e3932afb4b1d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:06.444742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:06.520897 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66d5eb-b4b5-460e-a0d7-beebe4024b07 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:06.521255 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66d5eb-b4b5-460e-a0d7-beebe4024b07 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:06.521437 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66d5eb-b4b5-460e-a0d7-beebe4024b07 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:06.522795 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 378/764] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:06.529460 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226849a7-4633-4c74-ac30-7b012f64127d None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:06.529866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226849a7-4633-4c74-ac30-7b012f64127d None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:06.530246 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226849a7-4633-4c74-ac30-7b012f64127d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:06.535474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343e76a-2b8e-4534-830c-e3932afb4b1d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:06.564139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-226849a7-4633-4c74-ac30-7b012f64127d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:06.565537 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-226849a7-4633-4c74-ac30-7b012f64127d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:06.578043 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01838a-13a4-4438-bb9e-3d8b38ea7484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:06.579748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01838a-13a4-4438-bb9e-3d8b38ea7484 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:06.580168 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01838a-13a4-4438-bb9e-3d8b38ea7484 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:06.580636 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01838a-13a4-4438-bb9e-3d8b38ea7484 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:06.594054 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01838a-13a4-4438-bb9e-3d8b38ea7484 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:06.596897 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01838a-13a4-4438-bb9e-3d8b38ea7484 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:06.617870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ed01838a-13a4-4438-bb9e-3d8b38ea7484 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:06.617870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:06.617870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:06.617870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:06.617870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:06.617870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:06.617870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:06.617870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:06.617870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:06.617870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:06.617870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:06.617870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:06.617870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:34:06.617870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:34:06.617870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:34:06.618947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:34:06.618947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:06.618947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:06.618947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:06.618947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:06.618947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:06.618947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:06.618947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:06.618947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:06.618947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:06.618947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:06.618947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:06.618947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:06.618947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:06.618947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:06.618947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:06.618947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:06.620026 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:34:06.620026 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:34:06.620026 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:34:06.620026 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:34:06.620026 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:34:06.620026 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:34:06.620026 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:06.620026 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:06.626758 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 387/765] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:06.627746 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01838a-13a4-4438-bb9e-3d8b38ea7484 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:06.672656 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 379/766] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:06.807287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:06.818434 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01838a-13a4-4438-bb9e-3d8b38ea7484 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:06.865825 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ae388-346b-4823-929d-1ae0ef1c50c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:06.866441 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ae388-346b-4823-929d-1ae0ef1c50c0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:06.866725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ae388-346b-4823-929d-1ae0ef1c50c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:06.866997 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ae388-346b-4823-929d-1ae0ef1c50c0 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:06.867694 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ae388-346b-4823-929d-1ae0ef1c50c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:06.868002 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ae388-346b-4823-929d-1ae0ef1c50c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:06.869464 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ae388-346b-4823-929d-1ae0ef1c50c0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:06.888729 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 388/767] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:34:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:06.894664 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226849a7-4633-4c74-ac30-7b012f64127d None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:06.988287 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:07.047262 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226849a7-4633-4c74-ac30-7b012f64127d None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:07.069288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ae388-346b-4823-929d-1ae0ef1c50c0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:07.099460 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8d3ad-ea1e-4724-941a-b73916850cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:07.100122 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8d3ad-ea1e-4724-941a-b73916850cff None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:07.100398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8d3ad-ea1e-4724-941a-b73916850cff None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:07.100727 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8d3ad-ea1e-4724-941a-b73916850cff None admin] PATH_INFO: `/v3/projects/cd477d464e9f48149879362d04db9b9e/users/b642a1d00de940429fc1cc6131ac22b1/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:07.103441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8d3ad-ea1e-4724-941a-b73916850cff None admin] RBAC: Authorizing `identity:create_grant(project_id=cd477d464e9f48149879362d04db9b9e, user_id=b642a1d00de940429fc1cc6131ac22b1, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:07.104896 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8d3ad-ea1e-4724-941a-b73916850cff None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:07.130100 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 380/768] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:34:06 2022] PUT /identity/v3/projects/cd477d464e9f48149879362d04db9b9e/users/b642a1d00de940429fc1cc6131ac22b1/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:34:07.227358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ae388-346b-4823-929d-1ae0ef1c50c0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:07.283773 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e81bc-c838-4028-ad26-9dbe9b866ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:07.284407 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e81bc-c838-4028-ad26-9dbe9b866ccb None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:07.284711 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e81bc-c838-4028-ad26-9dbe9b866ccb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:07.284981 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e81bc-c838-4028-ad26-9dbe9b866ccb None admin] PATH_INFO: `/v3/services/network` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:07.285566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e81bc-c838-4028-ad26-9dbe9b866ccb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:07.287001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e81bc-c838-4028-ad26-9dbe9b866ccb None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:07.296619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-7b2e81bc-c838-4028-ad26-9dbe9b866ccb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 10:34:07.296619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:07.296619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:07.296619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:07.296619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:07.296619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:07.296619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:07.296619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:07.296619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 10:34:07.296619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:07.296619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:07.296619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:07.296619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:07.296619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:07.296619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:07.296619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:07.296619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:07.297656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:07.297656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:07.297656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:07.297656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:07.297656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:07.297656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:07.297656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:07.297656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:07.297656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:07.297656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:07.297656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:07.297656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:07.297656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:07.297656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:07.297656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:07.297656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:07.299038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:07.299038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:07.299038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:07.299038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:07.299038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:07.299038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:07.299038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:07.299038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:07.299038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:07.299038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:07.299038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:07.299038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:07.299038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 10:34:07.299038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:07.299038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 389/769] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:07 2022] GET /identity/v3/services/network => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:07.305666 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8d3ad-ea1e-4724-941a-b73916850cff None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:07.409003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ae5f0-7027-4b8e-8e34-3d86c557511e None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:07.409319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ae5f0-7027-4b8e-8e34-3d86c557511e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:07.409549 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ae5f0-7027-4b8e-8e34-3d86c557511e None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:07.411751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 390/770] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:34:07.417153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fce48-ae1f-437a-96f8-1a348e11b522 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:07.417419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fce48-ae1f-437a-96f8-1a348e11b522 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:07.417689 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fce48-ae1f-437a-96f8-1a348e11b522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:07.432194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8d3ad-ea1e-4724-941a-b73916850cff None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:07.445405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-518fce48-ae1f-437a-96f8-1a348e11b522 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:07.446652 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-518fce48-ae1f-437a-96f8-1a348e11b522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:07.457009 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:07.462495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:07.486220 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b962186-ad64-46e3-a8df-2f40079eb272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:07.486933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b962186-ad64-46e3-a8df-2f40079eb272 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:07.487273 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b962186-ad64-46e3-a8df-2f40079eb272 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:07.488013 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b962186-ad64-46e3-a8df-2f40079eb272 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:07.488777 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b962186-ad64-46e3-a8df-2f40079eb272 None admin] RBAC: Adding query filter params (name=network) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:07.489385 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b962186-ad64-46e3-a8df-2f40079eb272 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:07.491183 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b962186-ad64-46e3-a8df-2f40079eb272 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:07.498009 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 381/771] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 10:34:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:07.503780 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b962186-ad64-46e3-a8df-2f40079eb272 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:07.569284 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 391/772] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:07.578910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78f8bc-9c67-428c-aacb-82b67503fc3d None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:07.579563 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78f8bc-9c67-428c-aacb-82b67503fc3d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:07.579640 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78f8bc-9c67-428c-aacb-82b67503fc3d None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:07.580966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 392/773] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:34:07.586011 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a97ea-367f-4ac8-8018-bc16ad24765c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:07.586287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a97ea-367f-4ac8-8018-bc16ad24765c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:07.586560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a97ea-367f-4ac8-8018-bc16ad24765c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:07.617184 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4c7a97ea-367f-4ac8-8018-bc16ad24765c None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:07.619031 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4c7a97ea-367f-4ac8-8018-bc16ad24765c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:07.694995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b962186-ad64-46e3-a8df-2f40079eb272 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:07.730238 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 393/774] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Sep 11 10:34:07.777827 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5366b-a886-4f91-9148-55491b341972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:07.778445 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5366b-a886-4f91-9148-55491b341972 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:07.778727 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5366b-a886-4f91-9148-55491b341972 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:07.779011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5366b-a886-4f91-9148-55491b341972 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:07.779650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5366b-a886-4f91-9148-55491b341972 None admin] RBAC: Adding query filter params (type=network) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:07.779957 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5366b-a886-4f91-9148-55491b341972 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:07.781373 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5366b-a886-4f91-9148-55491b341972 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:07.786772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 382/775] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 10:34:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:07.792626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a97ea-367f-4ac8-8018-bc16ad24765c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:07.906491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:07.937021 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a97ea-367f-4ac8-8018-bc16ad24765c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:07.944380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c95154-a727-48b0-968f-9305fe2d203c None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:07.944896 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c95154-a727-48b0-968f-9305fe2d203c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:07.944974 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c95154-a727-48b0-968f-9305fe2d203c None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:07.946530 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 383/776] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:07.959823 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45f393-6ba7-4363-b8a7-26886c4fc19d None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:07.960107 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45f393-6ba7-4363-b8a7-26886c4fc19d None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:07.960386 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45f393-6ba7-4363-b8a7-26886c4fc19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:07.975069 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f54137-e5a5-4d9b-b356-7eea151826ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:07.975908 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f54137-e5a5-4d9b-b356-7eea151826ba None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:07.976187 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f54137-e5a5-4d9b-b356-7eea151826ba None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:07.976456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f54137-e5a5-4d9b-b356-7eea151826ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:07.977232 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f54137-e5a5-4d9b-b356-7eea151826ba None admin] RBAC: Adding query filter params (interface=public, service_id=abf1fa0a05bb4c499597c3e9e3ec7066, region_id=RegionOne) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:07.978503 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f54137-e5a5-4d9b-b356-7eea151826ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:07.979921 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f54137-e5a5-4d9b-b356-7eea151826ba None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:07.989787 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-2e45f393-6ba7-4363-b8a7-26886c4fc19d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:07.990911 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 394/777] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Sep 11 10:34:07 2022] GET /identity/v3/endpoints?service_id=abf1fa0a05bb4c499597c3e9e3ec7066&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:07.991045 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2e45f393-6ba7-4363-b8a7-26886c4fc19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:07.991805 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f54137-e5a5-4d9b-b356-7eea151826ba None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:08.050170 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:08.081109 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 384/778] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:08.082250 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45f393-6ba7-4363-b8a7-26886c4fc19d None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:08.103701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f54137-e5a5-4d9b-b356-7eea151826ba None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:08.142908 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3acba36-a6f9-4618-ac3a-6a225c7df36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:08.143537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acba36-a6f9-4618-ac3a-6a225c7df36d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:08.143810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acba36-a6f9-4618-ac3a-6a225c7df36d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:08.144202 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acba36-a6f9-4618-ac3a-6a225c7df36d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:08.151581 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:08.156188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3acba36-a6f9-4618-ac3a-6a225c7df36d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:34:08.161881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-b3acba36-a6f9-4618-ac3a-6a225c7df36d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:34:08.161881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:08.161881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:08.161881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:08.161881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:08.161881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:08.161881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:08.161881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:08.161881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:08.161881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:08.161881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:08.161881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:08.161881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:34:08.161881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:34:08.161881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:34:08.161881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:34:08.162994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:34:08.162994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:34:08.162994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:34:08.162994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:34:08.162994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:08.162994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:08.162994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:08.162994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:08.162994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:08.162994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:08.162994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:08.162994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:08.162994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:08.162994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:08.162994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:08.162994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:08.164057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:08.164057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:08.164057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:08.164057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:08.164057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:34:08.164057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:34:08.164057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:34:08.164057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:34:08.164057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:34:08.164057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:34:08.164057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:34:08.164057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:08.171519 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 395/779] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:34:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:08.171519 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3acba36-a6f9-4618-ac3a-6a225c7df36d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:08.213690 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45f393-6ba7-4363-b8a7-26886c4fc19d None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:08.254572 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f860c-605f-4bd9-a6cc-87e095f83aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:08.255159 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f860c-605f-4bd9-a6cc-87e095f83aa2 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:08.255435 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f860c-605f-4bd9-a6cc-87e095f83aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:08.255703 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f860c-605f-4bd9-a6cc-87e095f83aa2 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:08.256305 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f860c-605f-4bd9-a6cc-87e095f83aa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:08.257809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f860c-605f-4bd9-a6cc-87e095f83aa2 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:08.263218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 385/780] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Sep 11 10:34:08 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:08.264060 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f860c-605f-4bd9-a6cc-87e095f83aa2 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:08.290700 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3acba36-a6f9-4618-ac3a-6a225c7df36d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:08.311621 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:08.341125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f2669-ca6c-45f1-aa96-77b648696475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:08.342264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f2669-ca6c-45f1-aa96-77b648696475 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:08.342742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f2669-ca6c-45f1-aa96-77b648696475 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:08.343207 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f2669-ca6c-45f1-aa96-77b648696475 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:08.344042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f2669-ca6c-45f1-aa96-77b648696475 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:08.346598 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f2669-ca6c-45f1-aa96-77b648696475 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:08.357568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-5b9f2669-ca6c-45f1-aa96-77b648696475 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 10:34:08.357568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:08.357568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:08.357568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:08.357568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:08.357568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:08.357568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:08.357568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:08.357568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 10:34:08.357568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:08.357568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:08.357568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:08.357568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:08.357568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:08.357568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:08.357568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:08.357568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:08.358632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:08.358632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:08.358632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:08.358632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:08.358632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:08.358632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:08.358632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:08.358632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:08.358632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:08.358632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:08.358632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:08.358632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:08.358632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:08.358632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:08.358632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:08.358632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:08.359478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:08.359478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:08.359478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:08.359478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:08.359478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:08.359478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:08.359478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:08.359478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:08.359478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:08.359478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:08.359478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:08.359478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:08.359478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 10:34:08.359478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:08.362706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 396/781] 10.222.0.20 () {56 vars in 1129 bytes} [Sun Sep 11 10:34:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:08.368973 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f2669-ca6c-45f1-aa96-77b648696475 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:08.444662 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:08.450612 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f860c-605f-4bd9-a6cc-87e095f83aa2 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:08.492718 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763320c-9fde-4496-a226-f0acf1e1c820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:08.493706 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763320c-9fde-4496-a226-f0acf1e1c820 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:08.494223 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763320c-9fde-4496-a226-f0acf1e1c820 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:08.494707 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763320c-9fde-4496-a226-f0acf1e1c820 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:08.495213 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f2669-ca6c-45f1-aa96-77b648696475 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:08.495943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763320c-9fde-4496-a226-f0acf1e1c820 None admin] RBAC: Adding query filter params (name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:08.496259 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763320c-9fde-4496-a226-f0acf1e1c820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:08.497867 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763320c-9fde-4496-a226-f0acf1e1c820 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:08.510528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 386/782] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:34:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:08.511689 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763320c-9fde-4496-a226-f0acf1e1c820 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:08.543433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf880d58-0f32-491f-9517-2dda5d2d5664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:08.544042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf880d58-0f32-491f-9517-2dda5d2d5664 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:08.544315 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf880d58-0f32-491f-9517-2dda5d2d5664 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:08.547093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf880d58-0f32-491f-9517-2dda5d2d5664 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:08.547093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf880d58-0f32-491f-9517-2dda5d2d5664 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:08.547093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf880d58-0f32-491f-9517-2dda5d2d5664 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:08.547093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf880d58-0f32-491f-9517-2dda5d2d5664 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:08.553284 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 397/783] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Sep 11 10:34:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:08.554358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf880d58-0f32-491f-9517-2dda5d2d5664 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:08.634421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763320c-9fde-4496-a226-f0acf1e1c820 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:08.636016 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:08.670425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001d16a-f567-4628-a8e0-fa6e700cdcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:08.671114 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001d16a-f567-4628-a8e0-fa6e700cdcab None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:08.671395 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001d16a-f567-4628-a8e0-fa6e700cdcab None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:08.671744 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001d16a-f567-4628-a8e0-fa6e700cdcab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:08.676369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf880d58-0f32-491f-9517-2dda5d2d5664 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:08.683192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001d16a-f567-4628-a8e0-fa6e700cdcab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:34:08.688121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-c001d16a-f567-4628-a8e0-fa6e700cdcab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:34:08.688121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:08.688121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:08.688121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:08.688121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:08.688121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:08.688121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:08.688121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:08.688121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:08.688121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:08.688121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:08.688121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:08.688121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:34:08.688121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:34:08.688121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:34:08.688121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:34:08.689189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:34:08.689189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:34:08.689189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:34:08.689189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:34:08.689189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:08.689189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:08.689189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:08.689189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:08.689189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:08.689189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:08.689189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:08.689189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:08.689189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:08.689189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:08.689189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:08.689189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:08.690421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:08.690421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:08.690421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:08.690421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:08.690421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:34:08.690421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:34:08.690421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:34:08.690421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:34:08.690421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:34:08.690421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:34:08.690421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:34:08.690421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:08.690421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 387/784] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:34:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:08.691108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001d16a-f567-4628-a8e0-fa6e700cdcab None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:08.716215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:08.727955 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cbf13-8430-4ea7-8b37-55011b1de1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:08.729125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cbf13-8430-4ea7-8b37-55011b1de1c6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:08.729947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cbf13-8430-4ea7-8b37-55011b1de1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:08.730499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cbf13-8430-4ea7-8b37-55011b1de1c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:08.743033 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cbf13-8430-4ea7-8b37-55011b1de1c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:08.744724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cbf13-8430-4ea7-8b37-55011b1de1c6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:08.763400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-0a8cbf13-8430-4ea7-8b37-55011b1de1c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:08.763400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:08.763400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:08.763400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:08.763400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:08.763400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:08.763400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:08.763400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:08.763400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:08.763400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:08.763400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:08.763400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:08.763400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:08.763400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:08.763400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:08.763400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:08.764361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:08.764361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:08.764361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:08.764361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:08.764361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:08.764361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:08.764361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:08.764361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:08.764361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:08.764361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:08.764361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:08.764361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:08.764361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:08.764361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:08.764361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:08.764361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:08.764361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:08.765272 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:08.765272 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:08.765272 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:08.768370 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 398/785] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:08.769463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cbf13-8430-4ea7-8b37-55011b1de1c6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:08.809660 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001d16a-f567-4628-a8e0-fa6e700cdcab None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:08.846163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b076cbc-b0d1-4759-ab58-3ee479c369f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:08.847215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b076cbc-b0d1-4759-ab58-3ee479c369f4 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:08.847591 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b076cbc-b0d1-4759-ab58-3ee479c369f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:08.847960 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b076cbc-b0d1-4759-ab58-3ee479c369f4 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:08.848726 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b076cbc-b0d1-4759-ab58-3ee479c369f4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:08.849128 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b076cbc-b0d1-4759-ab58-3ee479c369f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:08.850593 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b076cbc-b0d1-4759-ab58-3ee479c369f4 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:08.855990 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 388/786] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Sep 11 10:34:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:08.856994 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b076cbc-b0d1-4759-ab58-3ee479c369f4 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:08.889879 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:08.899789 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cbf13-8430-4ea7-8b37-55011b1de1c6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:08.941351 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63490672-fd21-4247-af4d-9143cf6b47b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:08.942237 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63490672-fd21-4247-af4d-9143cf6b47b4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:08.942668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63490672-fd21-4247-af4d-9143cf6b47b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:08.943079 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63490672-fd21-4247-af4d-9143cf6b47b4 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:08.943886 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63490672-fd21-4247-af4d-9143cf6b47b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:08.944327 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63490672-fd21-4247-af4d-9143cf6b47b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:08.946420 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63490672-fd21-4247-af4d-9143cf6b47b4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:08.961342 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 399/787] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:34:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:08.962374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63490672-fd21-4247-af4d-9143cf6b47b4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:08.983990 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b076cbc-b0d1-4759-ab58-3ee479c369f4 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:09.011471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:09.031739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92307d-91e2-4a23-9652-f43e7ec122e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:09.033565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92307d-91e2-4a23-9652-f43e7ec122e4 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:09.034250 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92307d-91e2-4a23-9652-f43e7ec122e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:09.034667 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92307d-91e2-4a23-9652-f43e7ec122e4 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:09.035687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92307d-91e2-4a23-9652-f43e7ec122e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:09.036152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92307d-91e2-4a23-9652-f43e7ec122e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:09.038343 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92307d-91e2-4a23-9652-f43e7ec122e4 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:09.053855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 389/788] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:09.055406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92307d-91e2-4a23-9652-f43e7ec122e4 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:09.079951 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63490672-fd21-4247-af4d-9143cf6b47b4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:09.120361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba843e-24f5-459f-a55f-0778bc27b9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:09.121165 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba843e-24f5-459f-a55f-0778bc27b9cd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:09.121539 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba843e-24f5-459f-a55f-0778bc27b9cd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:09.121911 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba843e-24f5-459f-a55f-0778bc27b9cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:09.122757 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba843e-24f5-459f-a55f-0778bc27b9cd None admin] RBAC: Adding query filter params (interface=public, service_id=ff12a1d3e8434097845bf45ac5eeb5e9, region_id=RegionOne) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:09.123202 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba843e-24f5-459f-a55f-0778bc27b9cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:09.124798 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba843e-24f5-459f-a55f-0778bc27b9cd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:09.131783 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 400/789] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Sep 11 10:34:08 2022] GET /identity/v3/endpoints?service_id=ff12a1d3e8434097845bf45ac5eeb5e9&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:09.132874 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba843e-24f5-459f-a55f-0778bc27b9cd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:09.159400 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:09.175836 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92307d-91e2-4a23-9652-f43e7ec122e4 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:09.212305 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380d8c2-c187-48b5-9865-61d8294c0e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:09.213223 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380d8c2-c187-48b5-9865-61d8294c0e86 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:09.213645 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380d8c2-c187-48b5-9865-61d8294c0e86 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:09.214056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380d8c2-c187-48b5-9865-61d8294c0e86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:09.226155 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380d8c2-c187-48b5-9865-61d8294c0e86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:09.228230 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380d8c2-c187-48b5-9865-61d8294c0e86 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:09.243284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-a380d8c2-c187-48b5-9865-61d8294c0e86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:09.243284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:09.243284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:09.243284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:09.243284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:09.243284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:09.243284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:09.243284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:09.243284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:09.243284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:09.243284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:09.243284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:09.243284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:09.243284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:09.243284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:09.243284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:09.244242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:09.244242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:09.244242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:09.244242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:09.244242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:09.244242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:09.244242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:09.244242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:09.244242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:09.244242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:09.244242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:09.244242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:09.244242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:09.244242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:09.244242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:09.244242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:09.244242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:09.245163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:09.245163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:09.245163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:09.246889 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba843e-24f5-459f-a55f-0778bc27b9cd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:09.247840 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 390/790] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:09.248904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380d8c2-c187-48b5-9865-61d8294c0e86 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:09.255038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:09.300835 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcb261-5bc9-478f-baf4-544715bce09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:09.301266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcb261-5bc9-478f-baf4-544715bce09d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:09.301546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcb261-5bc9-478f-baf4-544715bce09d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:09.301820 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcb261-5bc9-478f-baf4-544715bce09d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:09.310341 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcb261-5bc9-478f-baf4-544715bce09d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:09.311775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcb261-5bc9-478f-baf4-544715bce09d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:09.324575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-6dfcb261-5bc9-478f-baf4-544715bce09d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 10:34:09.324575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:09.324575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:09.324575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:09.324575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:09.324575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:09.324575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:09.324575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:09.324575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:09.324575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:09.324575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:09.324575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:09.324575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:34:09.324575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:34:09.324575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:34:09.324575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:34:09.325510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:09.325510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:09.325510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:34:09.325510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:09.325510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:34:09.325510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:09.325510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:09.325510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:09.325510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:09.325510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:09.325510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:09.325510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:09.325510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:09.325510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:09.325510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:09.325510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:09.325510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:09.325510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:09.326731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:09.326731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:09.326731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:34:09.326731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:34:09.326731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:34:09.326731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:34:09.326731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:34:09.326731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:34:09.326731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 10:34:09.326731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:09.326731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 401/791] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Sep 11 10:34:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:09.327515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcb261-5bc9-478f-baf4-544715bce09d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:09.366059 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380d8c2-c187-48b5-9865-61d8294c0e86 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:09.400177 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4387594-3171-4499-932d-4378b801f3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:09.401142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4387594-3171-4499-932d-4378b801f3d1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:09.401596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4387594-3171-4499-932d-4378b801f3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:09.402039 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4387594-3171-4499-932d-4378b801f3d1 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:09.402860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4387594-3171-4499-932d-4378b801f3d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:09.404408 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4387594-3171-4499-932d-4378b801f3d1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:09.410276 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 391/792] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Sep 11 10:34:09 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:09.411411 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4387594-3171-4499-932d-4378b801f3d1 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:09.414331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:09.440151 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcb261-5bc9-478f-baf4-544715bce09d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:09.479602 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1425a2b-42be-423b-b453-b2796dfb3c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:09.480138 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1425a2b-42be-423b-b453-b2796dfb3c13 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:09.480419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1425a2b-42be-423b-b453-b2796dfb3c13 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:09.480723 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1425a2b-42be-423b-b453-b2796dfb3c13 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:09.481440 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1425a2b-42be-423b-b453-b2796dfb3c13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:09.481748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1425a2b-42be-423b-b453-b2796dfb3c13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:09.483369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1425a2b-42be-423b-b453-b2796dfb3c13 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:09.503105 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 402/793] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:09.505462 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1425a2b-42be-423b-b453-b2796dfb3c13 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:09.540478 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4387594-3171-4499-932d-4378b801f3d1 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:09.542366 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:09.589354 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb3591-699e-4ce3-9ed8-3bafbd68259e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:09.590115 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb3591-699e-4ce3-9ed8-3bafbd68259e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:09.590560 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb3591-699e-4ce3-9ed8-3bafbd68259e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:09.590936 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb3591-699e-4ce3-9ed8-3bafbd68259e None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:09.591786 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb3591-699e-4ce3-9ed8-3bafbd68259e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:09.592190 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb3591-699e-4ce3-9ed8-3bafbd68259e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:09.594415 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb3591-699e-4ce3-9ed8-3bafbd68259e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:09.622904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 392/794] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Sep 11 10:34:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:09.624205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2b878-2d4d-46bf-9ee6-102e3a0e4a01 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:09.624485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2b878-2d4d-46bf-9ee6-102e3a0e4a01 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:09.624786 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2b878-2d4d-46bf-9ee6-102e3a0e4a01 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:09.626464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 393/795] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:09.631237 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2b878-2d4d-46bf-9ee6-102e3a0e4a01 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:09.638800 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1425a2b-42be-423b-b453-b2796dfb3c13 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:09.681802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf4a53-b925-4f3e-8769-a62b6cbdaa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:09.682483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf4a53-b925-4f3e-8769-a62b6cbdaa5a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:09.682711 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf4a53-b925-4f3e-8769-a62b6cbdaa5a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:09.682983 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf4a53-b925-4f3e-8769-a62b6cbdaa5a None admin] PATH_INFO: `/v3/users/swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:09.692130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf4a53-b925-4f3e-8769-a62b6cbdaa5a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:09.693649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf4a53-b925-4f3e-8769-a62b6cbdaa5a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:09.703800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:09.709100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-8caf4a53-b925-4f3e-8769-a62b6cbdaa5a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 10:34:09.709100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:09.709100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:09.709100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:09.709100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:09.709100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:09.709100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:09.709100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:09.709100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:09.709100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:09.709100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:09.709100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:09.709100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:34:09.709100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:34:09.709100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:34:09.709100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:34:09.710114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:09.710114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:09.710114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:34:09.710114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:09.710114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:34:09.710114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:09.710114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:09.710114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:09.710114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:09.710114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:09.710114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:09.710114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:09.710114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:09.710114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:09.710114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:09.710114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:09.710114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:09.710114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:09.711062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:09.711062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:09.711062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:34:09.711062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:34:09.711062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:34:09.711062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:34:09.711062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:34:09.711062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:34:09.711062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 10:34:09.711062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:09.711062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 403/796] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:34:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:34:09.711933 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0637757-2761-44c2-9353-b69be4d984de None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:09.712214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0637757-2761-44c2-9353-b69be4d984de None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:09.712485 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0637757-2761-44c2-9353-b69be4d984de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:09.735259 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f0637757-2761-44c2-9353-b69be4d984de None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:09.737368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f0637757-2761-44c2-9353-b69be4d984de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:09.754037 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2b878-2d4d-46bf-9ee6-102e3a0e4a01 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:09.792645 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d003d4b-92a2-4987-a14b-922161b97cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:09.793282 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d003d4b-92a2-4987-a14b-922161b97cf6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:09.793557 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d003d4b-92a2-4987-a14b-922161b97cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:09.793847 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d003d4b-92a2-4987-a14b-922161b97cf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:09.805473 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d003d4b-92a2-4987-a14b-922161b97cf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:09.806937 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d003d4b-92a2-4987-a14b-922161b97cf6 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:09.809302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 404/797] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:09.810377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0637757-2761-44c2-9353-b69be4d984de None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:09.826844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:09.834540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-4d003d4b-92a2-4987-a14b-922161b97cf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:09.834540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:09.834540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:09.834540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:09.834540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:09.834540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:09.834540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:09.834540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:09.834540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:09.834540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:09.834540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:09.834540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:09.834540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:09.834540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:09.834540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:09.834540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:09.835693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:09.835693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:09.835693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:09.835693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:09.835693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:09.835693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:09.835693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:09.835693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:09.835693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:09.835693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:09.835693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:09.835693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:09.835693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:09.835693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:09.835693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:09.835693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:09.835693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:09.836797 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:09.836797 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:09.836797 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:09.836797 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 394/798] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:09.841414 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d003d4b-92a2-4987-a14b-922161b97cf6 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:09.919060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0637757-2761-44c2-9353-b69be4d984de None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:09.960586 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca704e6-2056-4973-916e-516302726a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:09.961522 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca704e6-2056-4973-916e-516302726a6c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:09.961978 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca704e6-2056-4973-916e-516302726a6c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:09.962425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca704e6-2056-4973-916e-516302726a6c None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:09.963319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca704e6-2056-4973-916e-516302726a6c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:09.963873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca704e6-2056-4973-916e-516302726a6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:09.966609 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca704e6-2056-4973-916e-516302726a6c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:10.004889 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 405/799] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Sep 11 10:34:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:10.008049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca704e6-2056-4973-916e-516302726a6c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:10.032115 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d003d4b-92a2-4987-a14b-922161b97cf6 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:10.052667 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:10.071493 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb3114-bc14-407f-bd61-91f034f05357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:10.072902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb3114-bc14-407f-bd61-91f034f05357 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:10.073270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb3114-bc14-407f-bd61-91f034f05357 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:10.073550 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb3114-bc14-407f-bd61-91f034f05357 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:10.074199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb3114-bc14-407f-bd61-91f034f05357 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:10.074551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb3114-bc14-407f-bd61-91f034f05357 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:10.076075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb3114-bc14-407f-bd61-91f034f05357 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:10.089406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 395/800] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:10.097468 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb3114-bc14-407f-bd61-91f034f05357 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:10.257038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb3114-bc14-407f-bd61-91f034f05357 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:10.289291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:10.292705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7f675-7495-482d-a49b-dacb614e242e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:10.293603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7f675-7495-482d-a49b-dacb614e242e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:10.294079 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7f675-7495-482d-a49b-dacb614e242e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:10.294575 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7f675-7495-482d-a49b-dacb614e242e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:10.302426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7f675-7495-482d-a49b-dacb614e242e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:10.304181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7f675-7495-482d-a49b-dacb614e242e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:10.316368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-abb7f675-7495-482d-a49b-dacb614e242e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:10.316368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:10.316368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:10.316368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:10.316368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:10.316368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:10.316368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:10.316368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:10.316368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:10.316368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:10.316368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:10.316368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:10.316368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:34:10.316368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:34:10.316368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:34:10.317327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:34:10.317327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:10.317327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:10.317327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:10.317327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:10.317327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:10.317327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:10.317327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:10.317327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:10.317327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:10.317327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:10.317327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:10.317327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:10.317327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:10.317327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:10.317327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:10.317327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:10.318209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:34:10.318209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:34:10.318209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:34:10.318209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:34:10.318209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:34:10.318209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:34:10.318209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:10.318209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:10.320690 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 396/801] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:10.321687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7f675-7495-482d-a49b-dacb614e242e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:10.325091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca704e6-2056-4973-916e-516302726a6c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:10.358110 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:10.368770 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b7c52-5a39-4033-9093-4e4cbc797393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:10.369409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b7c52-5a39-4033-9093-4e4cbc797393 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:10.369685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b7c52-5a39-4033-9093-4e4cbc797393 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:10.369962 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b7c52-5a39-4033-9093-4e4cbc797393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:10.383319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b7c52-5a39-4033-9093-4e4cbc797393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:10.385299 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b7c52-5a39-4033-9093-4e4cbc797393 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:10.403130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-996b7c52-5a39-4033-9093-4e4cbc797393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:10.403130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:10.403130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:10.403130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:10.403130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:10.403130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:10.403130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:10.403130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:10.403130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:10.403130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:10.403130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:10.403130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:10.403130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:10.403130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:10.403130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:10.403130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:10.404107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:10.404107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:10.404107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:10.404107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:10.404107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:10.404107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:10.404107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:10.404107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:10.404107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:10.404107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:10.404107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:10.404107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:10.404107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:10.404107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:10.404107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:10.404107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:10.404107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:10.405042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:10.405042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:10.405042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:10.405932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 406/802] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:10.406813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b7c52-5a39-4033-9093-4e4cbc797393 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:10.440582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7f675-7495-482d-a49b-dacb614e242e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:10.478799 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168e0ce-c975-405a-8050-e76ebeeda190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:10.479609 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168e0ce-c975-405a-8050-e76ebeeda190 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:10.479894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168e0ce-c975-405a-8050-e76ebeeda190 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:10.480192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168e0ce-c975-405a-8050-e76ebeeda190 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:10.492427 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168e0ce-c975-405a-8050-e76ebeeda190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:34:10.498426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-1168e0ce-c975-405a-8050-e76ebeeda190 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:34:10.498426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:10.498426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:10.498426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:10.498426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:10.498426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:10.498426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:10.498426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:10.498426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:10.498426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:10.498426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:10.498426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:10.498426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:34:10.498426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:34:10.498426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:34:10.498426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:34:10.499350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:34:10.499350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:34:10.499350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:34:10.499350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:34:10.499350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:10.499350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:10.499350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:10.499350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:10.499350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:10.499350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:10.499350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:10.499350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:10.499350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:10.499350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:10.499350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:10.499350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:10.500181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:10.500181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:10.500181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:10.500181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:10.500181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:34:10.500181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:34:10.500181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:34:10.500181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:34:10.500181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:34:10.500181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:34:10.500181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:34:10.500181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:10.504900 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 397/803] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:34:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:10.505849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168e0ce-c975-405a-8050-e76ebeeda190 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:10.530064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b7c52-5a39-4033-9093-4e4cbc797393 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:10.565523 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:10.580129 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c4725-c804-443b-b06d-6a9ac7938675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:10.580776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c4725-c804-443b-b06d-6a9ac7938675 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:10.581115 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c4725-c804-443b-b06d-6a9ac7938675 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:10.581389 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c4725-c804-443b-b06d-6a9ac7938675 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:10.581992 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c4725-c804-443b-b06d-6a9ac7938675 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:10.582290 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c4725-c804-443b-b06d-6a9ac7938675 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:10.584210 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c4725-c804-443b-b06d-6a9ac7938675 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:10.599810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 407/804] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:34:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:10.605586 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c4725-c804-443b-b06d-6a9ac7938675 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:10.637120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:10.647919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168e0ce-c975-405a-8050-e76ebeeda190 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:10.692979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae5093-959c-47b2-ad1a-ccbae6808f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:10.693858 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae5093-959c-47b2-ad1a-ccbae6808f84 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:10.694297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae5093-959c-47b2-ad1a-ccbae6808f84 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:10.694712 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae5093-959c-47b2-ad1a-ccbae6808f84 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:10.695512 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae5093-959c-47b2-ad1a-ccbae6808f84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:10.695961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae5093-959c-47b2-ad1a-ccbae6808f84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:10.698135 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae5093-959c-47b2-ad1a-ccbae6808f84 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:10.725595 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 398/805] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:10.726934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae5093-959c-47b2-ad1a-ccbae6808f84 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:10.737609 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c4725-c804-443b-b06d-6a9ac7938675 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:10.783255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644a287-57c7-4a08-8a30-b069dff01112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:10.785269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644a287-57c7-4a08-8a30-b069dff01112 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:10.785903 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644a287-57c7-4a08-8a30-b069dff01112 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:10.786529 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644a287-57c7-4a08-8a30-b069dff01112 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:10.787550 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644a287-57c7-4a08-8a30-b069dff01112 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:10.788050 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644a287-57c7-4a08-8a30-b069dff01112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:10.789954 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644a287-57c7-4a08-8a30-b069dff01112 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:10.807558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 408/806] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:34:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:10.807558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644a287-57c7-4a08-8a30-b069dff01112 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:10.850297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae5093-959c-47b2-ad1a-ccbae6808f84 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:10.857335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:10.885893 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6eb8d-494a-4a39-af50-57dad8749a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:10.886550 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6eb8d-494a-4a39-af50-57dad8749a7d None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:10.886826 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6eb8d-494a-4a39-af50-57dad8749a7d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:10.887097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6eb8d-494a-4a39-af50-57dad8749a7d None admin] PATH_INFO: `/v3/projects/cd477d464e9f48149879362d04db9b9e/users/bdc800f1d4174b5cba4f6f496207ec95/roles/295de8f316124ccdac36a50e50531148` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:10.901789 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6eb8d-494a-4a39-af50-57dad8749a7d None admin] RBAC: Authorizing `identity:create_grant(project_id=cd477d464e9f48149879362d04db9b9e, user_id=bdc800f1d4174b5cba4f6f496207ec95, role_id=295de8f316124ccdac36a50e50531148)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:10.903243 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6eb8d-494a-4a39-af50-57dad8749a7d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:10.915808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644a287-57c7-4a08-8a30-b069dff01112 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:10.917692 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 399/807] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:34:10 2022] PUT /identity/v3/projects/cd477d464e9f48149879362d04db9b9e/users/bdc800f1d4174b5cba4f6f496207ec95/roles/295de8f316124ccdac36a50e50531148 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:34:10.919325 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6eb8d-494a-4a39-af50-57dad8749a7d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:10.931994 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:10.970944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce074e-236d-4b2c-9284-097f889c3b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:10.971874 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce074e-236d-4b2c-9284-097f889c3b24 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:10.972154 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce074e-236d-4b2c-9284-097f889c3b24 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:10.972420 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce074e-236d-4b2c-9284-097f889c3b24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:10.980909 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce074e-236d-4b2c-9284-097f889c3b24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:10.982565 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce074e-236d-4b2c-9284-097f889c3b24 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:10.995733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-14ce074e-236d-4b2c-9284-097f889c3b24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:10.995733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:10.995733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:10.995733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:10.995733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:10.995733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:10.995733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:10.995733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:10.995733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:10.995733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:10.995733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:10.995733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:10.995733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:34:10.995733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:34:10.995733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:34:10.997350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:34:10.997350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:10.997350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:10.997350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:10.997350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:10.997350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:10.997350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:10.997350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:10.997350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:10.997350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:10.997350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:10.997350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:10.997350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:10.997350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:10.997350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:10.997350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:10.997350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:10.998335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:34:10.998335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:34:10.998335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:34:10.998335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:34:10.998335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:34:10.998335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:34:10.998335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:10.998335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:10.998335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 409/808] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:10.998847 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f22f7-7664-40f2-9e9e-8b4bdc554edf None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:10.998847 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f22f7-7664-40f2-9e9e-8b4bdc554edf None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:10.999392 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f22f7-7664-40f2-9e9e-8b4bdc554edf None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:11.000352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 410/809] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:11.005368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f22f7-7664-40f2-9e9e-8b4bdc554edf None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:11.104888 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6eb8d-494a-4a39-af50-57dad8749a7d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:11.129573 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f22f7-7664-40f2-9e9e-8b4bdc554edf None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:11.140457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:11.148751 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a95ed-8a83-4609-8a12-fc2093dc14a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:11.149392 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a95ed-8a83-4609-8a12-fc2093dc14a0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:11.149668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a95ed-8a83-4609-8a12-fc2093dc14a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:11.149939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a95ed-8a83-4609-8a12-fc2093dc14a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:11.162167 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a95ed-8a83-4609-8a12-fc2093dc14a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:11.164023 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a95ed-8a83-4609-8a12-fc2093dc14a0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:11.174831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8d7e8-e168-4b2b-879f-282d62d5b508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:11.175547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8d7e8-e168-4b2b-879f-282d62d5b508 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:11.175849 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8d7e8-e168-4b2b-879f-282d62d5b508 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:11.176123 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8d7e8-e168-4b2b-879f-282d62d5b508 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:11.177187 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8d7e8-e168-4b2b-879f-282d62d5b508 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:11.177486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8d7e8-e168-4b2b-879f-282d62d5b508 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:11.179145 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8d7e8-e168-4b2b-879f-282d62d5b508 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:11.187853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-127a95ed-8a83-4609-8a12-fc2093dc14a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:11.187853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:11.187853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:11.187853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:11.187853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:11.187853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:11.187853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:11.187853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:11.187853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:11.187853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:11.187853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:11.187853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:11.187853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:11.187853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:11.187853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:11.187853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:11.189431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:11.189431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:11.189431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:11.189431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:11.189431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:11.189431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:11.189431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:11.189431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:11.189431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:11.189431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:11.189431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:11.189431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:11.189431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:11.189431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:11.189431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:11.189431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:11.189431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:11.190329 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:11.190329 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:11.190329 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:11.190919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 400/810] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:11.191931 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f991477-bf36-4c2b-bb59-4a88a613d75d None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:11.192576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f991477-bf36-4c2b-bb59-4a88a613d75d None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:11.192576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f991477-bf36-4c2b-bb59-4a88a613d75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:11.192904 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 411/811] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:34:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:11.198251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8d7e8-e168-4b2b-879f-282d62d5b508 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:11.217776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-6f991477-bf36-4c2b-bb59-4a88a613d75d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:11.218982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6f991477-bf36-4c2b-bb59-4a88a613d75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:11.277435 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:11.304645 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 401/812] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:11.305550 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f991477-bf36-4c2b-bb59-4a88a613d75d None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:11.327960 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8d7e8-e168-4b2b-879f-282d62d5b508 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:11.387847 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86296c-73b3-48c5-b08a-b8c75a956a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:11.388373 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86296c-73b3-48c5-b08a-b8c75a956a36 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:11.388671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86296c-73b3-48c5-b08a-b8c75a956a36 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:11.388936 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86296c-73b3-48c5-b08a-b8c75a956a36 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:11.389642 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86296c-73b3-48c5-b08a-b8c75a956a36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:11.389941 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86296c-73b3-48c5-b08a-b8c75a956a36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:11.391287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86296c-73b3-48c5-b08a-b8c75a956a36 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:11.404928 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 412/813] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:11.412284 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86296c-73b3-48c5-b08a-b8c75a956a36 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:11.457427 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:11.503225 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f991477-bf36-4c2b-bb59-4a88a613d75d None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:11.567187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efa272-c4c6-4a7a-9cfe-7eda503bc92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:11.567860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efa272-c4c6-4a7a-9cfe-7eda503bc92c None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:11.568137 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efa272-c4c6-4a7a-9cfe-7eda503bc92c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:11.568405 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efa272-c4c6-4a7a-9cfe-7eda503bc92c None admin] PATH_INFO: `/v3/projects/cd477d464e9f48149879362d04db9b9e/users/28ff72290fd14ddaba6ed757051e182b/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:11.571639 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efa272-c4c6-4a7a-9cfe-7eda503bc92c None admin] RBAC: Authorizing `identity:create_grant(project_id=cd477d464e9f48149879362d04db9b9e, user_id=28ff72290fd14ddaba6ed757051e182b, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:11.573116 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efa272-c4c6-4a7a-9cfe-7eda503bc92c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:11.586827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86296c-73b3-48c5-b08a-b8c75a956a36 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:11.597822 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 402/814] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:34:11 2022] PUT /identity/v3/projects/cd477d464e9f48149879362d04db9b9e/users/28ff72290fd14ddaba6ed757051e182b/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:34:11.646708 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c43ae5-33b4-4a36-95ab-ac8f07c5975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:11.646898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efa272-c4c6-4a7a-9cfe-7eda503bc92c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:11.647422 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c43ae5-33b4-4a36-95ab-ac8f07c5975a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:11.647704 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c43ae5-33b4-4a36-95ab-ac8f07c5975a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:11.648040 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c43ae5-33b4-4a36-95ab-ac8f07c5975a None admin] PATH_INFO: `/v3/users/nova` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:11.661543 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c43ae5-33b4-4a36-95ab-ac8f07c5975a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:11.662784 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c43ae5-33b4-4a36-95ab-ac8f07c5975a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:11.675374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-11c43ae5-33b4-4a36-95ab-ac8f07c5975a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 10:34:11.675374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:11.675374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:11.675374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:11.675374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:11.675374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:11.675374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:11.675374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:11.675374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:11.675374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:11.675374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:11.675374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:11.675374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:34:11.675374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:34:11.675374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:34:11.675374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:34:11.676378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:11.676378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:11.676378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:34:11.676378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:11.676378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:34:11.676378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:11.676378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:11.676378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:11.676378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:11.676378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:11.676378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:11.676378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:11.676378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:11.676378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:11.676378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:11.676378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:11.676378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:11.676378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:11.677325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:11.677325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:11.677325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:34:11.677325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:34:11.677325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:34:11.677325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:34:11.677325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:34:11.677325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:34:11.677325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 10:34:11.677325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:11.677325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 413/815] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Sep 11 10:34:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:34:11.683601 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c43ae5-33b4-4a36-95ab-ac8f07c5975a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:11.732962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:11.838523 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:11.853206 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efa272-c4c6-4a7a-9cfe-7eda503bc92c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:11.857816 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c43ae5-33b4-4a36-95ab-ac8f07c5975a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:11.898173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae9008-fdf4-4d1f-a522-6f78e326e187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:11.899218 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae9008-fdf4-4d1f-a522-6f78e326e187 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:11.899692 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae9008-fdf4-4d1f-a522-6f78e326e187 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:11.900157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae9008-fdf4-4d1f-a522-6f78e326e187 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:11.901172 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae9008-fdf4-4d1f-a522-6f78e326e187 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:11.901711 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae9008-fdf4-4d1f-a522-6f78e326e187 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:11.903363 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae9008-fdf4-4d1f-a522-6f78e326e187 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:11.924734 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 414/816] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Sep 11 10:34:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:11.926583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d376a3-015a-4aa5-83cd-9c79aa9c9608 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:11.927160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d376a3-015a-4aa5-83cd-9c79aa9c9608 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:11.932327 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d376a3-015a-4aa5-83cd-9c79aa9c9608 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:11.934690 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 415/817] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:11.936329 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d376a3-015a-4aa5-83cd-9c79aa9c9608 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:12.040416 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5017e6-676f-4b2a-bf0b-a2d20b74cfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:12.041552 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5017e6-676f-4b2a-bf0b-a2d20b74cfdf None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:12.042038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5017e6-676f-4b2a-bf0b-a2d20b74cfdf None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:12.042502 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5017e6-676f-4b2a-bf0b-a2d20b74cfdf None admin] PATH_INFO: `/v3/services/network` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:12.043404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5017e6-676f-4b2a-bf0b-a2d20b74cfdf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:12.045081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5017e6-676f-4b2a-bf0b-a2d20b74cfdf None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:12.051231 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d376a3-015a-4aa5-83cd-9c79aa9c9608 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:12.056421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-bc5017e6-676f-4b2a-bf0b-a2d20b74cfdf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 10:34:12.056421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:12.056421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:12.056421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:12.056421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:12.056421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:12.056421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:12.056421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:12.056421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 10:34:12.056421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:12.056421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:12.056421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:12.056421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:12.056421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:12.056421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:12.056421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:12.056421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:12.057407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:12.057407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:12.057407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:12.057407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:12.057407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:12.057407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:12.057407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:12.057407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:12.057407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:12.057407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:12.057407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:12.057407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:12.057407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:12.057407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:12.057407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:12.057407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:12.058242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:12.058242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:12.058242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:12.058242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:12.058242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:12.058242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:12.058242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:12.058242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:12.058242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:12.058242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:12.058242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:12.058242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:12.058242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 10:34:12.058242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:12.061404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 403/818] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:11 2022] GET /identity/v3/services/network => generated 88 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:34:12.064113 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf4834-2363-466c-aba6-cf00bdf54caa None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:12.064699 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf4834-2363-466c-aba6-cf00bdf54caa None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:12.065165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf4834-2363-466c-aba6-cf00bdf54caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:12.088287 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-3caf4834-2363-466c-aba6-cf00bdf54caa None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:12.090319 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3caf4834-2363-466c-aba6-cf00bdf54caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:12.093156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf4a15-ff0e-4fde-aa03-1463761bc774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:12.093820 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf4a15-ff0e-4fde-aa03-1463761bc774 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:12.094126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf4a15-ff0e-4fde-aa03-1463761bc774 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:12.095071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf4a15-ff0e-4fde-aa03-1463761bc774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:12.111172 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:12.171733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf4a15-ff0e-4fde-aa03-1463761bc774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:12.173194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf4a15-ff0e-4fde-aa03-1463761bc774 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:12.190277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 404/819] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:12.191963 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf4834-2363-466c-aba6-cf00bdf54caa None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:12.255355 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:12.300321 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 416/820] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:34:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 10:34:12.306434 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf4a15-ff0e-4fde-aa03-1463761bc774 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:12.356975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:12.406595 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf4834-2363-466c-aba6-cf00bdf54caa None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:12.414401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf4a15-ff0e-4fde-aa03-1463761bc774 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:12.461474 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306669f4-3c60-4ac4-a7ea-0a8e55d404d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:12.462152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306669f4-3c60-4ac4-a7ea-0a8e55d404d1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:12.462430 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306669f4-3c60-4ac4-a7ea-0a8e55d404d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:12.463042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306669f4-3c60-4ac4-a7ea-0a8e55d404d1 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:12.463674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306669f4-3c60-4ac4-a7ea-0a8e55d404d1 None admin] RBAC: Adding query filter params (name=network) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:12.464024 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306669f4-3c60-4ac4-a7ea-0a8e55d404d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:12.465412 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306669f4-3c60-4ac4-a7ea-0a8e55d404d1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:12.470583 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 405/821] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 10:34:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:12.481492 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306669f4-3c60-4ac4-a7ea-0a8e55d404d1 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:12.483377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10d943-3071-4fc7-af05-3520b3f8f4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:12.484018 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10d943-3071-4fc7-af05-3520b3f8f4a7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:12.484296 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10d943-3071-4fc7-af05-3520b3f8f4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:12.484585 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10d943-3071-4fc7-af05-3520b3f8f4a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:12.496889 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10d943-3071-4fc7-af05-3520b3f8f4a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:12.498354 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10d943-3071-4fc7-af05-3520b3f8f4a7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:12.524064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-2d10d943-3071-4fc7-af05-3520b3f8f4a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:12.524064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:12.524064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:12.524064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:12.524064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:12.524064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:12.524064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:12.524064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:12.524064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:12.524064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:12.524064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:12.524064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:12.524064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:12.524064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:12.524064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:12.524064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:12.525114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:12.525114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:12.525114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:12.525114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:12.525114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:12.525114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:12.525114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:12.525114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:12.525114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:12.525114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:12.525114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:12.525114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:12.525114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:12.525114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:12.525114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:12.525114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:12.525114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:12.526020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:12.526020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:12.526020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:12.528163 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 417/822] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:12.531237 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10d943-3071-4fc7-af05-3520b3f8f4a7 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:12.640836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:12.644537 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306669f4-3c60-4ac4-a7ea-0a8e55d404d1 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:12.646205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:12.650328 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10d943-3071-4fc7-af05-3520b3f8f4a7 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:12.689120 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a67a47-3361-46c8-801a-73d71a057e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:12.689800 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a67a47-3361-46c8-801a-73d71a057e58 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:12.690156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a67a47-3361-46c8-801a-73d71a057e58 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:12.690440 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a67a47-3361-46c8-801a-73d71a057e58 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:12.691148 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a67a47-3361-46c8-801a-73d71a057e58 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:12.692370 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009cd51-d220-412e-90ff-55bcb3ec2433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:12.692679 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a67a47-3361-46c8-801a-73d71a057e58 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:12.693524 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009cd51-d220-412e-90ff-55bcb3ec2433 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:12.694033 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009cd51-d220-412e-90ff-55bcb3ec2433 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:12.694875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009cd51-d220-412e-90ff-55bcb3ec2433 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:12.696281 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009cd51-d220-412e-90ff-55bcb3ec2433 None admin] RBAC: Adding query filter params (type=network) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:12.697027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009cd51-d220-412e-90ff-55bcb3ec2433 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:12.698761 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009cd51-d220-412e-90ff-55bcb3ec2433 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:12.703696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-61a67a47-3361-46c8-801a-73d71a057e58 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 10:34:12.703696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:12.703696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:12.703696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:12.703696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:12.703696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:12.703696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:12.703696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:12.703696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 10:34:12.703696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:12.703696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:12.703696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:12.703696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:12.703696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:12.703696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:12.703696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:12.703696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:12.705355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:12.705355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:12.705355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:12.705355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:12.705355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:12.705355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:12.705355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:12.705355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:12.705355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:12.705355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:12.705355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:12.705355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:12.705355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:12.705355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:12.705355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:12.705355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:12.706243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:12.706243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:12.706243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:12.706243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:12.706243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:12.706243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:12.706243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:12.706243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:12.706243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:12.706243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:12.706243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:12.706243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:12.706243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 10:34:12.706243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:12.713425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 418/824] 10.222.0.20 () {56 vars in 1129 bytes} [Sun Sep 11 10:34:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:34:12.713425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a67a47-3361-46c8-801a-73d71a057e58 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:12.713789 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 406/824] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 10:34:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:12.715036 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009cd51-d220-412e-90ff-55bcb3ec2433 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:12.823337 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a67a47-3361-46c8-801a-73d71a057e58 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:12.857075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009cd51-d220-412e-90ff-55bcb3ec2433 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:12.866230 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263a463-6179-4815-b8ba-9391e37a76d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:12.866874 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263a463-6179-4815-b8ba-9391e37a76d1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:12.867115 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263a463-6179-4815-b8ba-9391e37a76d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:12.867385 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263a463-6179-4815-b8ba-9391e37a76d1 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:12.868032 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263a463-6179-4815-b8ba-9391e37a76d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:12.868331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263a463-6179-4815-b8ba-9391e37a76d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:12.870128 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263a463-6179-4815-b8ba-9391e37a76d1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:12.884355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 419/825] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:12.885481 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263a463-6179-4815-b8ba-9391e37a76d1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:12.901761 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8b8a5-b20d-4c7b-8839-1b047aab507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:12.902940 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8b8a5-b20d-4c7b-8839-1b047aab507a None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:12.903912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8b8a5-b20d-4c7b-8839-1b047aab507a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:12.904690 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8b8a5-b20d-4c7b-8839-1b047aab507a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:12.905593 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8b8a5-b20d-4c7b-8839-1b047aab507a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:12.908356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8b8a5-b20d-4c7b-8839-1b047aab507a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:12.910667 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:12.945004 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 407/826] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:34:12 2022] POST /identity/v3/endpoints => generated 337 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:34:12.945004 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8b8a5-b20d-4c7b-8839-1b047aab507a None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:12.998842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:13.071289 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263a463-6179-4815-b8ba-9391e37a76d1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:13.166885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8d843-bf06-4f00-8219-145e1afaf081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:13.168399 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8d843-bf06-4f00-8219-145e1afaf081 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:13.168994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8d843-bf06-4f00-8219-145e1afaf081 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:13.169475 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8d843-bf06-4f00-8219-145e1afaf081 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:13.170601 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8d843-bf06-4f00-8219-145e1afaf081 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:13.171108 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8d843-bf06-4f00-8219-145e1afaf081 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:13.171422 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8b8a5-b20d-4c7b-8839-1b047aab507a None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:13.175398 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8d843-bf06-4f00-8219-145e1afaf081 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:13.182284 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 420/827] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Sep 11 10:34:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:13.191214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8d843-bf06-4f00-8219-145e1afaf081 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:13.214860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ac50d-31b1-4f06-8a69-25e0fddd3655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:13.215521 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ac50d-31b1-4f06-8a69-25e0fddd3655 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:13.215778 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ac50d-31b1-4f06-8a69-25e0fddd3655 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:13.216057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ac50d-31b1-4f06-8a69-25e0fddd3655 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:13.223367 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ac50d-31b1-4f06-8a69-25e0fddd3655 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:13.224840 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ac50d-31b1-4f06-8a69-25e0fddd3655 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:13.239944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-681ac50d-31b1-4f06-8a69-25e0fddd3655 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:13.239944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:13.239944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:13.239944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:13.239944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:13.239944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:13.239944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:13.239944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:13.239944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:13.239944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:13.239944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:13.239944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:13.239944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:34:13.239944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:34:13.239944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:34:13.241371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:34:13.241371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:13.241371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:13.241371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:13.241371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:13.241371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:13.241371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:13.241371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:13.241371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:13.241371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:13.241371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:13.241371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:13.241371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:13.241371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:13.241371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:13.241371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:13.241371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:13.242933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:34:13.242933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:34:13.242933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:34:13.242933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:34:13.242933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:34:13.242933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:34:13.242933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:13.242933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:13.242933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 408/828] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:13.249627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ac50d-31b1-4f06-8a69-25e0fddd3655 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:13.300883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:13.326418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8d843-bf06-4f00-8219-145e1afaf081 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:13.340700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:13.364797 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ac50d-31b1-4f06-8a69-25e0fddd3655 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:13.366246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93377b6c-9bdf-48a6-a4ec-3825e86a830b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:13.366846 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93377b6c-9bdf-48a6-a4ec-3825e86a830b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:13.367130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93377b6c-9bdf-48a6-a4ec-3825e86a830b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:13.368018 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93377b6c-9bdf-48a6-a4ec-3825e86a830b None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:13.368018 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93377b6c-9bdf-48a6-a4ec-3825e86a830b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:13.368318 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93377b6c-9bdf-48a6-a4ec-3825e86a830b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:13.369712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93377b6c-9bdf-48a6-a4ec-3825e86a830b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:13.374679 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 421/829] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Sep 11 10:34:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:13.376398 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9848ee-9a99-4add-8713-d87baae21f72 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:13.376714 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9848ee-9a99-4add-8713-d87baae21f72 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:13.376985 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9848ee-9a99-4add-8713-d87baae21f72 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:13.378325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 422/830] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:13.383046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9848ee-9a99-4add-8713-d87baae21f72 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:13.404692 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e2cbc-2529-4988-a388-07bfcd4c1bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:13.405291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e2cbc-2529-4988-a388-07bfcd4c1bae None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:13.405559 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e2cbc-2529-4988-a388-07bfcd4c1bae None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:13.405834 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e2cbc-2529-4988-a388-07bfcd4c1bae None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:13.406516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e2cbc-2529-4988-a388-07bfcd4c1bae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:13.406821 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e2cbc-2529-4988-a388-07bfcd4c1bae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:13.408970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e2cbc-2529-4988-a388-07bfcd4c1bae None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:13.426776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 409/831] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:34:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:13.426776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303e2d7-cbd4-46c0-818b-06b161eabe8e None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:13.426776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303e2d7-cbd4-46c0-818b-06b161eabe8e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:13.426776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303e2d7-cbd4-46c0-818b-06b161eabe8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:13.440778 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-b303e2d7-cbd4-46c0-818b-06b161eabe8e None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:13.441952 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b303e2d7-cbd4-46c0-818b-06b161eabe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:13.499198 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9848ee-9a99-4add-8713-d87baae21f72 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:13.511460 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 410/832] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:13.512460 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303e2d7-cbd4-46c0-818b-06b161eabe8e None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:13.546210 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9320c7-d251-46bc-a3da-79798ba45e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:13.547049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9320c7-d251-46bc-a3da-79798ba45e3c None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:13.547398 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9320c7-d251-46bc-a3da-79798ba45e3c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:13.547854 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9320c7-d251-46bc-a3da-79798ba45e3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:13.548668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9320c7-d251-46bc-a3da-79798ba45e3c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:13.550413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9320c7-d251-46bc-a3da-79798ba45e3c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:13.570132 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:13.583776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 423/833] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:34:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:34:13.606138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:13.654627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303e2d7-cbd4-46c0-818b-06b161eabe8e None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:13.701816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f15f9-4a01-470a-9918-150c6d49dcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:13.702719 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f15f9-4a01-470a-9918-150c6d49dcea None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:13.703145 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f15f9-4a01-470a-9918-150c6d49dcea None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:13.703560 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f15f9-4a01-470a-9918-150c6d49dcea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:13.705464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f15f9-4a01-470a-9918-150c6d49dcea None admin] RBAC: Adding query filter params (role.id=529cb3511f3a498b9b7169ed5b0f6b8e, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=b642a1d00de940429fc1cc6131ac22b1) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:13.705950 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f15f9-4a01-470a-9918-150c6d49dcea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:13.707570 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f15f9-4a01-470a-9918-150c6d49dcea None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:13.714889 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 411/834] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:34:13 2022] GET /identity/v3/role_assignments?user.id=b642a1d00de940429fc1cc6131ac22b1&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=529cb3511f3a498b9b7169ed5b0f6b8e => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:13.800312 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9320c7-d251-46bc-a3da-79798ba45e3c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:13.910348 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9320c7-d251-46bc-a3da-79798ba45e3c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:13.959869 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34568e6-2b4d-4fcc-88b8-7fec67edc5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:13.960593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34568e6-2b4d-4fcc-88b8-7fec67edc5b8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:13.960915 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34568e6-2b4d-4fcc-88b8-7fec67edc5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:13.961198 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34568e6-2b4d-4fcc-88b8-7fec67edc5b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:13.974761 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34568e6-2b4d-4fcc-88b8-7fec67edc5b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:34:13.981747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-b34568e6-2b4d-4fcc-88b8-7fec67edc5b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:34:13.981747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:13.981747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:13.981747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:13.981747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:13.981747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:13.981747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:13.981747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:13.981747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:13.981747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:13.981747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:13.981747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:13.981747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:34:13.981747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:34:13.981747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:34:13.981747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:34:13.982687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:34:13.982687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:34:13.982687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:34:13.982687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:34:13.982687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:13.982687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:13.982687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:13.982687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:13.982687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:13.982687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:13.982687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:13.982687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:13.982687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:13.982687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:13.982687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:13.982687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:13.983527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:13.983527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:13.983527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:13.983527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:13.983527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:34:13.983527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:34:13.983527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:34:13.983527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:34:13.983527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:34:13.983527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:34:13.983527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:34:13.983527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:13.983527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 424/835] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:34:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:13.990813 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f15f9-4a01-470a-9918-150c6d49dcea None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:14.043618 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843c56-3eb8-4eef-b72e-c11477243a1b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:14.043925 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843c56-3eb8-4eef-b72e-c11477243a1b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:14.044173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843c56-3eb8-4eef-b72e-c11477243a1b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:14.046098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 425/836] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:14.051782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac997b9-0b64-44d1-b6a7-e91efeb6c904 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:14.051920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac997b9-0b64-44d1-b6a7-e91efeb6c904 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:14.052120 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac997b9-0b64-44d1-b6a7-e91efeb6c904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:14.073466 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-fac997b9-0b64-44d1-b6a7-e91efeb6c904 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:14.074678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fac997b9-0b64-44d1-b6a7-e91efeb6c904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:14.102439 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f15f9-4a01-470a-9918-150c6d49dcea None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:14.132348 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:14.141791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f6c7f-98e9-43b6-afe3-b93c860f3e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:14.143362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f6c7f-98e9-43b6-afe3-b93c860f3e86 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:14.144042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f6c7f-98e9-43b6-afe3-b93c860f3e86 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:14.144733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f6c7f-98e9-43b6-afe3-b93c860f3e86 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:14.145643 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f6c7f-98e9-43b6-afe3-b93c860f3e86 None admin] RBAC: Adding query filter params (name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:14.146160 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f6c7f-98e9-43b6-afe3-b93c860f3e86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:14.147795 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f6c7f-98e9-43b6-afe3-b93c860f3e86 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:14.148944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:14.157936 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 412/837] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:34:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:14.162456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 426/838] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 10:34:14.164044 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f6c7f-98e9-43b6-afe3-b93c860f3e86 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:14.274172 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f6c7f-98e9-43b6-afe3-b93c860f3e86 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:14.314133 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded83ebd-f594-4c74-9347-cea013447137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:14.314807 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded83ebd-f594-4c74-9347-cea013447137 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:14.315087 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded83ebd-f594-4c74-9347-cea013447137 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:14.315362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded83ebd-f594-4c74-9347-cea013447137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:14.326619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded83ebd-f594-4c74-9347-cea013447137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:14.328091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded83ebd-f594-4c74-9347-cea013447137 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:14.342908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-ded83ebd-f594-4c74-9347-cea013447137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:14.342908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:14.342908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:14.342908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:14.342908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:14.342908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:14.342908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:14.342908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:14.342908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:14.342908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:14.342908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:14.342908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:14.342908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:14.342908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:14.342908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:14.342908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:14.343883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:14.343883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:14.343883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:14.343883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:14.343883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:14.343883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:14.343883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:14.343883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:14.343883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:14.343883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:14.343883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:14.343883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:14.343883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:14.343883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:14.343883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:14.343883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:14.343883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:14.345880 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:14.345880 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:14.345880 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:14.345880 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 413/839] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:14.350540 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac997b9-0b64-44d1-b6a7-e91efeb6c904 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:14.453925 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac997b9-0b64-44d1-b6a7-e91efeb6c904 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:14.456222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded83ebd-f594-4c74-9347-cea013447137 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:14.503527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538aa41e-941a-4ce4-9593-56e079ff1cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:14.504695 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538aa41e-941a-4ce4-9593-56e079ff1cd7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:14.505495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538aa41e-941a-4ce4-9593-56e079ff1cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:14.506182 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538aa41e-941a-4ce4-9593-56e079ff1cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:14.506974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538aa41e-941a-4ce4-9593-56e079ff1cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:14.507440 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538aa41e-941a-4ce4-9593-56e079ff1cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:14.510217 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538aa41e-941a-4ce4-9593-56e079ff1cd7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:14.518295 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:14.527716 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 427/840] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:14.534021 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538aa41e-941a-4ce4-9593-56e079ff1cd7 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:14.587754 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded83ebd-f594-4c74-9347-cea013447137 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:14.602559 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:14.634786 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530104e-31d0-4bae-8f2f-d9a4eca42e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:14.635592 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530104e-31d0-4bae-8f2f-d9a4eca42e1c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:14.635908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530104e-31d0-4bae-8f2f-d9a4eca42e1c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:14.636262 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530104e-31d0-4bae-8f2f-d9a4eca42e1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:14.648599 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530104e-31d0-4bae-8f2f-d9a4eca42e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:34:14.654310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-c530104e-31d0-4bae-8f2f-d9a4eca42e1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:34:14.654310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:14.654310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:14.654310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:14.654310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:14.654310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:14.654310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:14.654310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:14.654310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:14.654310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:14.654310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:14.654310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:14.654310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:34:14.654310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:34:14.654310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:34:14.654310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:34:14.655419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:34:14.655419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:34:14.655419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:34:14.655419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:34:14.655419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:14.655419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:14.655419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:14.655419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:14.655419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:14.655419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:14.655419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:14.655419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:14.655419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:14.655419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:14.655419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:14.655419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:14.656534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:14.656534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:14.656534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:14.656534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:14.656534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:34:14.656534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:34:14.656534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:34:14.656534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:34:14.656534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:34:14.656534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:34:14.656534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:34:14.656534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:14.656534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 414/841] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:34:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:14.661505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530104e-31d0-4bae-8f2f-d9a4eca42e1c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:14.671516 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538aa41e-941a-4ce4-9593-56e079ff1cd7 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:14.724119 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0e5cc-89c4-4575-a102-52ed1c635431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:14.725015 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0e5cc-89c4-4575-a102-52ed1c635431 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:14.725501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0e5cc-89c4-4575-a102-52ed1c635431 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:14.725989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0e5cc-89c4-4575-a102-52ed1c635431 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:14.733957 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0e5cc-89c4-4575-a102-52ed1c635431 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:14.736141 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0e5cc-89c4-4575-a102-52ed1c635431 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:14.747605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-3bf0e5cc-89c4-4575-a102-52ed1c635431 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 10:34:14.747605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:14.747605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:14.747605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:14.747605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:14.747605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:14.747605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:14.747605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:14.747605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:14.747605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:14.747605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:14.747605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:14.747605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:34:14.747605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:34:14.747605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:34:14.747605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:34:14.748525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:14.748525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:14.748525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:34:14.748525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:14.748525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:34:14.748525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:14.748525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:14.748525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:14.748525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:14.748525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:14.748525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:14.748525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:14.748525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:14.748525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:14.748525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:14.748525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:14.748525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:14.748525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:14.749494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:14.749494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:14.749494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:34:14.749494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:34:14.749494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:34:14.749494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:34:14.749494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:34:14.749494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:34:14.749494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 10:34:14.749494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:14.751930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 428/842] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Sep 11 10:34:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:14.757636 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0e5cc-89c4-4575-a102-52ed1c635431 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:14.801830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530104e-31d0-4bae-8f2f-d9a4eca42e1c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:14.803838 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:14.852978 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a5a9c-9c03-459b-9a6c-d71b847380ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:14.853524 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a5a9c-9c03-459b-9a6c-d71b847380ff None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:14.853804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a5a9c-9c03-459b-9a6c-d71b847380ff None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:14.854075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a5a9c-9c03-459b-9a6c-d71b847380ff None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:14.854736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a5a9c-9c03-459b-9a6c-d71b847380ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:14.855035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a5a9c-9c03-459b-9a6c-d71b847380ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:14.856400 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a5a9c-9c03-459b-9a6c-d71b847380ff None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:14.870775 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 415/843] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:34:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:14.874862 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0e5cc-89c4-4575-a102-52ed1c635431 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:14.876687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a5a9c-9c03-459b-9a6c-d71b847380ff None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:14.887285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:14.924836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c4a1d-8dc1-4d62-b090-364d6dd8470e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:14.925856 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c4a1d-8dc1-4d62-b090-364d6dd8470e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:14.925856 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c4a1d-8dc1-4d62-b090-364d6dd8470e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:14.926116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c4a1d-8dc1-4d62-b090-364d6dd8470e None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:14.926749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c4a1d-8dc1-4d62-b090-364d6dd8470e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:14.927059 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c4a1d-8dc1-4d62-b090-364d6dd8470e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:14.928870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c4a1d-8dc1-4d62-b090-364d6dd8470e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:14.956984 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 429/844] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Sep 11 10:34:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:14.958738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c4a1d-8dc1-4d62-b090-364d6dd8470e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:15.012027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a5a9c-9c03-459b-9a6c-d71b847380ff None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:15.058164 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b84a80-eb62-4124-aac1-47da4bf78602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:15.058797 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b84a80-eb62-4124-aac1-47da4bf78602 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:15.059093 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b84a80-eb62-4124-aac1-47da4bf78602 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:15.059746 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b84a80-eb62-4124-aac1-47da4bf78602 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:15.069500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c4a1d-8dc1-4d62-b090-364d6dd8470e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:15.077572 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b84a80-eb62-4124-aac1-47da4bf78602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:15.080237 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b84a80-eb62-4124-aac1-47da4bf78602 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:15.100457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-38b84a80-eb62-4124-aac1-47da4bf78602 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:15.100457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:15.100457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:15.100457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:15.100457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:15.100457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:15.100457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:15.100457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:15.100457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:15.100457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:15.100457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:15.100457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:15.100457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:15.100457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:15.100457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:15.100457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:15.101455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:15.101455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:15.101455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:15.101455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:15.101455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:15.101455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:15.101455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:15.101455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:15.101455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:15.101455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:15.101455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:15.101455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:15.101455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:15.101455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:15.101455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:15.101455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:15.101455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:15.103088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:15.103088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:15.103088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:15.103088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 416/845] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:34:15.108387 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b84a80-eb62-4124-aac1-47da4bf78602 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:15.115975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bbd6f-f200-4f55-9c6a-adfcb0380cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:15.116882 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bbd6f-f200-4f55-9c6a-adfcb0380cd9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:15.117367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bbd6f-f200-4f55-9c6a-adfcb0380cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:15.117838 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bbd6f-f200-4f55-9c6a-adfcb0380cd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:15.153309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:15.157968 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:15.196512 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bbd6f-f200-4f55-9c6a-adfcb0380cd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:15.198396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bbd6f-f200-4f55-9c6a-adfcb0380cd9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:15.243589 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b84a80-eb62-4124-aac1-47da4bf78602 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:15.286947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d55fd2-50eb-40bd-ba71-2d7ee646a1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:15.288268 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d55fd2-50eb-40bd-ba71-2d7ee646a1dd None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:15.288724 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d55fd2-50eb-40bd-ba71-2d7ee646a1dd None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:15.289143 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d55fd2-50eb-40bd-ba71-2d7ee646a1dd None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:15.289932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d55fd2-50eb-40bd-ba71-2d7ee646a1dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:15.290823 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d55fd2-50eb-40bd-ba71-2d7ee646a1dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:15.292700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d55fd2-50eb-40bd-ba71-2d7ee646a1dd None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:15.312747 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 417/846] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:15.314220 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d55fd2-50eb-40bd-ba71-2d7ee646a1dd None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:15.328417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 430/847] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:34:14 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 10:34:15.330050 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bbd6f-f200-4f55-9c6a-adfcb0380cd9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:15.410801 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:15.420921 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:15.425717 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d55fd2-50eb-40bd-ba71-2d7ee646a1dd None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:15.454881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bbd6f-f200-4f55-9c6a-adfcb0380cd9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:15.465969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf83595-e2a2-46d9-ad22-d9f76795ce4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:15.466922 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf83595-e2a2-46d9-ad22-d9f76795ce4c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:15.467376 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf83595-e2a2-46d9-ad22-d9f76795ce4c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:15.467846 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf83595-e2a2-46d9-ad22-d9f76795ce4c None admin] PATH_INFO: `/v3/users/swift` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:15.476216 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf83595-e2a2-46d9-ad22-d9f76795ce4c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:15.478191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf83595-e2a2-46d9-ad22-d9f76795ce4c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:15.491737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160f858-6acc-4795-8fa4-91bc99f91780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:15.492452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160f858-6acc-4795-8fa4-91bc99f91780 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:15.492879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160f858-6acc-4795-8fa4-91bc99f91780 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:15.493221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160f858-6acc-4795-8fa4-91bc99f91780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:15.494774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-ecf83595-e2a2-46d9-ad22-d9f76795ce4c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 10:34:15.494774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:15.494774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:15.494774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:15.494774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:15.494774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:15.494774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:15.494774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:15.494774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:15.494774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:15.494774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:15.494774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:15.494774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:34:15.494774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:34:15.494774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:34:15.494774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:34:15.495725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:15.495725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:15.495725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:34:15.495725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:15.495725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:34:15.495725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:15.495725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:15.495725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:15.495725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:15.495725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:15.495725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:15.495725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:15.495725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:15.495725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:15.495725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:15.495725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:15.495725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:15.495725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:15.496715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:15.496715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:15.496715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:34:15.496715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:34:15.496715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:34:15.496715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:34:15.496715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:34:15.496715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:34:15.496715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 10:34:15.496715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:15.499545 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 418/848] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:34:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:15.505163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf83595-e2a2-46d9-ad22-d9f76795ce4c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:15.511837 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160f858-6acc-4795-8fa4-91bc99f91780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:15.513441 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160f858-6acc-4795-8fa4-91bc99f91780 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:15.530405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-0160f858-6acc-4795-8fa4-91bc99f91780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:15.530405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:15.530405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:15.530405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:15.530405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:15.530405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:15.530405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:15.530405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:15.530405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:15.530405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:15.530405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:15.530405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:15.530405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:15.530405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:15.530405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:15.530405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:15.531605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:15.531605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:15.531605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:15.531605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:15.531605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:15.531605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:15.531605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:15.531605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:15.531605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:15.531605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:15.531605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:15.531605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:15.531605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:15.531605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:15.531605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:15.531605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:15.531605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:15.532932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:15.532932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:15.532932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:15.538886 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 431/849] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:15.540280 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160f858-6acc-4795-8fa4-91bc99f91780 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:15.645419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160f858-6acc-4795-8fa4-91bc99f91780 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:15.656258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf83595-e2a2-46d9-ad22-d9f76795ce4c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:15.668732 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:15.689330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac001333-7053-437a-b7ef-dae1836335ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:15.689916 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac001333-7053-437a-b7ef-dae1836335ca None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:15.690197 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac001333-7053-437a-b7ef-dae1836335ca None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:15.690469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac001333-7053-437a-b7ef-dae1836335ca None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:15.691112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac001333-7053-437a-b7ef-dae1836335ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:15.691414 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac001333-7053-437a-b7ef-dae1836335ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:15.692821 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac001333-7053-437a-b7ef-dae1836335ca None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:15.697323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c5e30-44f4-4f6f-9ea2-c3d235937e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:15.698211 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c5e30-44f4-4f6f-9ea2-c3d235937e48 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:15.698739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c5e30-44f4-4f6f-9ea2-c3d235937e48 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:15.699282 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c5e30-44f4-4f6f-9ea2-c3d235937e48 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:15.700752 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c5e30-44f4-4f6f-9ea2-c3d235937e48 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:15.701269 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c5e30-44f4-4f6f-9ea2-c3d235937e48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:15.703699 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c5e30-44f4-4f6f-9ea2-c3d235937e48 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:15.706953 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:15.718213 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 432/850] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:15.720768 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac001333-7053-437a-b7ef-dae1836335ca None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:15.738986 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 419/851] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Sep 11 10:34:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:15.745178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c5e30-44f4-4f6f-9ea2-c3d235937e48 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:15.854721 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac001333-7053-437a-b7ef-dae1836335ca None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:15.866733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c5e30-44f4-4f6f-9ea2-c3d235937e48 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:15.897038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cda8f-a188-4f87-8781-8af1e1125804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:15.898031 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cda8f-a188-4f87-8781-8af1e1125804 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:15.898642 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cda8f-a188-4f87-8781-8af1e1125804 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:15.899120 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cda8f-a188-4f87-8781-8af1e1125804 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:15.902870 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1bb5d-ad11-4a9c-abe3-3ef44ff64262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:15.903478 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1bb5d-ad11-4a9c-abe3-3ef44ff64262 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:15.903753 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1bb5d-ad11-4a9c-abe3-3ef44ff64262 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:15.904019 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1bb5d-ad11-4a9c-abe3-3ef44ff64262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:15.907305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cda8f-a188-4f87-8781-8af1e1125804 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:15.908788 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cda8f-a188-4f87-8781-8af1e1125804 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:15.920616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-de2cda8f-a188-4f87-8781-8af1e1125804 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:15.920616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:15.920616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:15.920616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:15.920616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:15.920616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:15.920616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:15.920616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:15.920616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:15.920616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:15.920616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:15.920616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:15.920616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:34:15.920616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:34:15.920616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:34:15.921551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:34:15.921551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:15.921551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:15.921551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:15.921551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:15.921551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:15.921551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:15.921551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:15.921551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:15.921551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:15.921551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:15.921551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:15.921551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:15.921551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:15.921551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:15.921551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:15.921551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:15.922488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:34:15.922488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:34:15.922488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:34:15.922488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:34:15.922488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:34:15.922488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:34:15.922488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:15.922488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:15.924890 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 433/852] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:15.927307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bec4b-010b-4d74-8cea-b501f624b684 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:15.927603 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bec4b-010b-4d74-8cea-b501f624b684 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:15.927862 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bec4b-010b-4d74-8cea-b501f624b684 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:15.930091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 434/853] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:15.933540 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bec4b-010b-4d74-8cea-b501f624b684 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:15.975859 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:15.982927 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:15.985613 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1bb5d-ad11-4a9c-abe3-3ef44ff64262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:15.987327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1bb5d-ad11-4a9c-abe3-3ef44ff64262 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:16.046733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bec4b-010b-4d74-8cea-b501f624b684 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:16.079893 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acf94a-baf8-471c-9f14-11c40bfeaebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:16.080496 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acf94a-baf8-471c-9f14-11c40bfeaebb None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:16.080807 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acf94a-baf8-471c-9f14-11c40bfeaebb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:16.081087 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acf94a-baf8-471c-9f14-11c40bfeaebb None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:16.081778 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acf94a-baf8-471c-9f14-11c40bfeaebb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:16.082089 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acf94a-baf8-471c-9f14-11c40bfeaebb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:16.083505 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acf94a-baf8-471c-9f14-11c40bfeaebb None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:16.087585 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 420/854] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:34:15 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 10:34:16.088872 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b042af-7930-4e0b-8f4b-4fcff73ea40f None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:16.089160 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b042af-7930-4e0b-8f4b-4fcff73ea40f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:16.089433 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b042af-7930-4e0b-8f4b-4fcff73ea40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:16.098116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 435/855] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:34:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:16.099382 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3ec27-97af-4463-aa19-c062d8ea1775 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:16.099675 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3ec27-97af-4463-aa19-c062d8ea1775 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:16.099951 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3ec27-97af-4463-aa19-c062d8ea1775 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:16.104152 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 436/856] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:16.104152 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3ec27-97af-4463-aa19-c062d8ea1775 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:16.111424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-29b042af-7930-4e0b-8f4b-4fcff73ea40f None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:16.112727 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-29b042af-7930-4e0b-8f4b-4fcff73ea40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:16.179058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 421/857] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:16.179819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b042af-7930-4e0b-8f4b-4fcff73ea40f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:16.199405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:16.205030 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:16.205879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3ec27-97af-4463-aa19-c062d8ea1775 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:16.245410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0565f66-ffe4-4111-b5a7-45d1e1c41fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:16.246028 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0565f66-ffe4-4111-b5a7-45d1e1c41fcc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:16.246302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0565f66-ffe4-4111-b5a7-45d1e1c41fcc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:16.246570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0565f66-ffe4-4111-b5a7-45d1e1c41fcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:16.257510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0565f66-ffe4-4111-b5a7-45d1e1c41fcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:16.259044 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0565f66-ffe4-4111-b5a7-45d1e1c41fcc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:16.275987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-d0565f66-ffe4-4111-b5a7-45d1e1c41fcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:16.275987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:16.275987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:16.275987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:16.275987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:16.275987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:16.275987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:16.275987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:16.275987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:16.275987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:16.275987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:16.275987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:16.275987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:16.275987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:16.275987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:16.275987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:16.276995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:16.276995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:16.276995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:16.276995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:16.276995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:16.276995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:16.276995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:16.276995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:16.276995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:16.276995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:16.276995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:16.276995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:16.276995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:16.276995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:16.276995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:16.276995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:16.276995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:16.277873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:16.277873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:16.277873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:16.277873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 437/858] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:16.278658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931df56-6eba-45f4-8c46-7632065adf72 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:16.278761 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931df56-6eba-45f4-8c46-7632065adf72 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:16.279291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931df56-6eba-45f4-8c46-7632065adf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:16.290137 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b042af-7930-4e0b-8f4b-4fcff73ea40f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:16.302159 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f931df56-6eba-45f4-8c46-7632065adf72 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:16.303366 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f931df56-6eba-45f4-8c46-7632065adf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:16.324681 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8609d6-4051-4e5c-a98d-784f11b4a523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:16.325276 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8609d6-4051-4e5c-a98d-784f11b4a523 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:16.325594 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8609d6-4051-4e5c-a98d-784f11b4a523 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:16.325898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8609d6-4051-4e5c-a98d-784f11b4a523 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:16.326565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8609d6-4051-4e5c-a98d-784f11b4a523 None admin] RBAC: Adding query filter params (role.id=295de8f316124ccdac36a50e50531148, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=bdc800f1d4174b5cba4f6f496207ec95) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:16.326869 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8609d6-4051-4e5c-a98d-784f11b4a523 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:16.328274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8609d6-4051-4e5c-a98d-784f11b4a523 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:16.344588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 422/859] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:34:16 2022] GET /identity/v3/role_assignments?user.id=bdc800f1d4174b5cba4f6f496207ec95&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=295de8f316124ccdac36a50e50531148 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:16.344588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8609d6-4051-4e5c-a98d-784f11b4a523 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:16.391367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 438/860] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:16.452916 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931df56-6eba-45f4-8c46-7632065adf72 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:16.454889 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:16.468427 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8609d6-4051-4e5c-a98d-784f11b4a523 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:16.507342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ddee5-8063-4590-854b-59934db890f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:16.508100 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ddee5-8063-4590-854b-59934db890f9 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:16.508395 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ddee5-8063-4590-854b-59934db890f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:16.508750 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ddee5-8063-4590-854b-59934db890f9 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:16.509558 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ddee5-8063-4590-854b-59934db890f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:16.509873 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ddee5-8063-4590-854b-59934db890f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:16.511553 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ddee5-8063-4590-854b-59934db890f9 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:16.526012 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 423/861] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:16.532772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ddee5-8063-4590-854b-59934db890f9 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:16.543010 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:16.564030 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931df56-6eba-45f4-8c46-7632065adf72 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:16.610767 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcb4e4-bf91-4b69-99cc-2d30ff1cefa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:16.611398 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcb4e4-bf91-4b69-99cc-2d30ff1cefa9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:16.611676 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcb4e4-bf91-4b69-99cc-2d30ff1cefa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:16.611947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcb4e4-bf91-4b69-99cc-2d30ff1cefa9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:16.612524 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fcb4e4-bf91-4b69-99cc-2d30ff1cefa9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:16.613929 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fcb4e4-bf91-4b69-99cc-2d30ff1cefa9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:16.627657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-59fcb4e4-bf91-4b69-99cc-2d30ff1cefa9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 10:34:16.627657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:16.627657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:16.627657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:16.627657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:16.627657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:16.627657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:16.627657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:16.627657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 10:34:16.627657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:16.627657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:16.627657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:16.627657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:16.627657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:16.627657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:16.627657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:16.627657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:16.628786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:16.628786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:16.628786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:16.628786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:16.628786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:16.628786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:16.628786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:16.628786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:16.628786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:16.628786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:16.628786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:16.628786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:16.628786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:16.628786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:16.628786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:16.628786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:16.629624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:16.629624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:16.629624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:16.629624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:16.629624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:16.629624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:16.629624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:16.629624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:16.629624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:16.629624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:16.629624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:16.629624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:16.629624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 10:34:16.629624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:16.630373 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 439/862] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:34:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:34:16.638186 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcb4e4-bf91-4b69-99cc-2d30ff1cefa9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:16.661885 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ddee5-8063-4590-854b-59934db890f9 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:16.701996 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b1bdb-9b00-4eac-80af-3877bbd6030e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:16.702653 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b1bdb-9b00-4eac-80af-3877bbd6030e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:16.703002 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b1bdb-9b00-4eac-80af-3877bbd6030e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:16.703198 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b1bdb-9b00-4eac-80af-3877bbd6030e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:16.716108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b1bdb-9b00-4eac-80af-3877bbd6030e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:16.717585 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b1bdb-9b00-4eac-80af-3877bbd6030e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:16.729507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-377b1bdb-9b00-4eac-80af-3877bbd6030e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:16.729507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:16.729507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:16.729507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:16.729507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:16.729507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:16.729507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:16.729507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:16.729507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:16.729507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:16.729507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:16.729507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:16.729507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:34:16.729507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:34:16.729507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:34:16.730434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:34:16.730434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:16.730434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:16.730434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:16.730434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:16.730434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:16.730434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:16.730434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:16.730434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:16.730434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:16.730434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:16.730434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:16.730434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:16.730434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:16.730434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:16.730434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:16.730434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:16.734335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:34:16.734335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:34:16.734335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:34:16.734335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:34:16.734335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:34:16.734335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:34:16.734335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:16.734335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:16.734335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 424/863] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:34:16.734335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b1bdb-9b00-4eac-80af-3877bbd6030e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:16.746866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:16.765327 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcb4e4-bf91-4b69-99cc-2d30ff1cefa9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:16.802853 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a4d9f-6d05-448f-a59f-99d7b2673027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:16.803629 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a4d9f-6d05-448f-a59f-99d7b2673027 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:16.803909 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a4d9f-6d05-448f-a59f-99d7b2673027 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:16.804181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a4d9f-6d05-448f-a59f-99d7b2673027 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:16.804848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a4d9f-6d05-448f-a59f-99d7b2673027 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:16.805153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a4d9f-6d05-448f-a59f-99d7b2673027 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:16.806741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a4d9f-6d05-448f-a59f-99d7b2673027 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:16.815910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 440/864] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:34:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:16.815910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a4d9f-6d05-448f-a59f-99d7b2673027 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:16.828458 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:16.841617 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b1bdb-9b00-4eac-80af-3877bbd6030e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:16.876114 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4052dd-ee60-408d-89ab-b6ac474889b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:16.876802 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4052dd-ee60-408d-89ab-b6ac474889b8 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:16.877131 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4052dd-ee60-408d-89ab-b6ac474889b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:16.877411 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4052dd-ee60-408d-89ab-b6ac474889b8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:16.878000 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4052dd-ee60-408d-89ab-b6ac474889b8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:16.879375 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4052dd-ee60-408d-89ab-b6ac474889b8 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:16.888603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-9a4052dd-ee60-408d-89ab-b6ac474889b8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 10:34:16.888603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:16.888603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:16.888603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:16.888603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:16.888603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:16.888603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:16.888603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:16.888603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 10:34:16.888603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:16.888603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:16.888603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:16.888603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:16.888603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:16.888603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:16.888603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:16.889701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:16.889701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:16.889701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:16.889701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:16.889701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:16.889701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:16.889701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:16.889701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:16.889701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:16.889701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:16.889701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:16.889701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:16.889701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:16.889701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:16.889701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:16.889701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:16.889701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:16.890616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:16.890616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:16.890616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:16.890616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:16.890616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:16.890616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:16.890616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:16.890616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:16.890616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:16.890616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:16.890616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:16.890616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:16.890616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 10:34:16.890616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:16.890616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 425/865] 10.222.0.20 () {56 vars in 1132 bytes} [Sun Sep 11 10:34:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:16.892050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4052dd-ee60-408d-89ab-b6ac474889b8 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:16.928294 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a4d9f-6d05-448f-a59f-99d7b2673027 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:16.964484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584644eb-86be-44ac-9da3-23f42df77984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:16.965023 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:16.965160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584644eb-86be-44ac-9da3-23f42df77984 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:16.965673 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584644eb-86be-44ac-9da3-23f42df77984 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:16.965673 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584644eb-86be-44ac-9da3-23f42df77984 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:16.966275 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584644eb-86be-44ac-9da3-23f42df77984 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:16.966581 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584644eb-86be-44ac-9da3-23f42df77984 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:16.967993 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584644eb-86be-44ac-9da3-23f42df77984 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:16.981392 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 441/866] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:34:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:16.982203 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584644eb-86be-44ac-9da3-23f42df77984 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:17.002977 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4052dd-ee60-408d-89ab-b6ac474889b8 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:17.040911 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d004e-de98-4fa7-b19b-04702d097380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:17.041514 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d004e-de98-4fa7-b19b-04702d097380 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:17.041794 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d004e-de98-4fa7-b19b-04702d097380 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:17.042064 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d004e-de98-4fa7-b19b-04702d097380 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:17.042691 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d004e-de98-4fa7-b19b-04702d097380 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:17.042998 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d004e-de98-4fa7-b19b-04702d097380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:17.044357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d004e-de98-4fa7-b19b-04702d097380 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:17.056493 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 426/867] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:34:16 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:17.056493 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d004e-de98-4fa7-b19b-04702d097380 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:17.065109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:17.095905 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584644eb-86be-44ac-9da3-23f42df77984 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:17.136108 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6c66c-05fb-4eb0-8d10-93621dc573a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:17.136758 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6c66c-05fb-4eb0-8d10-93621dc573a4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:17.137044 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6c66c-05fb-4eb0-8d10-93621dc573a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:17.137322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6c66c-05fb-4eb0-8d10-93621dc573a4 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:17.137967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6c66c-05fb-4eb0-8d10-93621dc573a4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:17.138273 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6c66c-05fb-4eb0-8d10-93621dc573a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:17.139673 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6c66c-05fb-4eb0-8d10-93621dc573a4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:17.145230 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 442/868] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 10:34:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:17.151759 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6c66c-05fb-4eb0-8d10-93621dc573a4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:17.195893 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d004e-de98-4fa7-b19b-04702d097380 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:17.234146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9d19b-dbac-4438-a203-172b7bb1ffe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:17.234683 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9d19b-dbac-4438-a203-172b7bb1ffe4 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:17.235065 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9d19b-dbac-4438-a203-172b7bb1ffe4 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:17.235349 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9d19b-dbac-4438-a203-172b7bb1ffe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:17.236075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9d19b-dbac-4438-a203-172b7bb1ffe4 None admin] RBAC: Adding query filter params (role.id=529cb3511f3a498b9b7169ed5b0f6b8e, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=28ff72290fd14ddaba6ed757051e182b) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:17.236376 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9d19b-dbac-4438-a203-172b7bb1ffe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:17.238580 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9d19b-dbac-4438-a203-172b7bb1ffe4 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:17.241651 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:17.245288 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 427/869] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:34:17 2022] GET /identity/v3/role_assignments?user.id=28ff72290fd14ddaba6ed757051e182b&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=529cb3511f3a498b9b7169ed5b0f6b8e => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:17.278068 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6c66c-05fb-4eb0-8d10-93621dc573a4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:17.319781 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfacdb2-398a-4512-a697-bd502553a065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:17.320409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfacdb2-398a-4512-a697-bd502553a065 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:17.320706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfacdb2-398a-4512-a697-bd502553a065 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:17.320975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfacdb2-398a-4512-a697-bd502553a065 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:17.321614 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfacdb2-398a-4512-a697-bd502553a065 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:17.321913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfacdb2-398a-4512-a697-bd502553a065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:17.323291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfacdb2-398a-4512-a697-bd502553a065 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:17.325081 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:17.330097 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 443/870] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 10:34:17 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:18.692220 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3916854-14ce-4e0a-9eb0-17476e403ded None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:18.692772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3916854-14ce-4e0a-9eb0-17476e403ded None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:18.692772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3916854-14ce-4e0a-9eb0-17476e403ded None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:18.694434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 428/871] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:18.699858 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9c9a3-9532-48ab-a161-9cc45b53c425 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:18.700237 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9c9a3-9532-48ab-a161-9cc45b53c425 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:18.700419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9c9a3-9532-48ab-a161-9cc45b53c425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:18.724507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-aaf9c9a3-9532-48ab-a161-9cc45b53c425 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:18.725906 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-aaf9c9a3-9532-48ab-a161-9cc45b53c425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:18.793629 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 444/872] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 10:34:19.066684 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3916854-14ce-4e0a-9eb0-17476e403ded None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:19.174083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3916854-14ce-4e0a-9eb0-17476e403ded None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:19.214930 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c9270-c793-4b5c-bbfa-e93266b097d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:19.215895 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c9270-c793-4b5c-bbfa-e93266b097d1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:19.216321 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c9270-c793-4b5c-bbfa-e93266b097d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:19.216768 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c9270-c793-4b5c-bbfa-e93266b097d1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:19.228341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c9270-c793-4b5c-bbfa-e93266b097d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:34:19.233357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-752c9270-c793-4b5c-bbfa-e93266b097d1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 10:34:19.233357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:19.233357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:19.233357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:19.233357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:19.233357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:19.233357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:19.233357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:19.233357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:19.233357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:19.233357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:19.233357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:19.233357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:34:19.233357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:34:19.233357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:34:19.233357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:34:19.234476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:34:19.234476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:34:19.234476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:34:19.234476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:34:19.234476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:19.234476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:19.234476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:19.234476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:19.234476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:19.234476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:19.234476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:19.234476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:19.234476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:19.234476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:19.234476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:19.234476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:19.236121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:19.236121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:19.236121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:19.236121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:19.236121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:34:19.236121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:34:19.236121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:34:19.236121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:34:19.236121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:34:19.236121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:34:19.236121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 10:34:19.236121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:19.238290 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 429/873] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Sep 11 10:34:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:19.244188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9c9a3-9532-48ab-a161-9cc45b53c425 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:19.304721 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1b623-6d9c-4b28-b803-0664c7e88ea1 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:19.305004 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1b623-6d9c-4b28-b803-0664c7e88ea1 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:19.305278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1b623-6d9c-4b28-b803-0664c7e88ea1 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:19.306889 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 430/874] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:34:19.312150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85466c60-ea75-4719-bef6-3b55b0c2d616 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:19.312432 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85466c60-ea75-4719-bef6-3b55b0c2d616 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:19.312742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85466c60-ea75-4719-bef6-3b55b0c2d616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:19.334613 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-85466c60-ea75-4719-bef6-3b55b0c2d616 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:19.336230 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-85466c60-ea75-4719-bef6-3b55b0c2d616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:19.363283 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9c9a3-9532-48ab-a161-9cc45b53c425 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:19.397827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:19.409275 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793c995-8786-474f-ac1b-45ec671b5a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:19.410041 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793c995-8786-474f-ac1b-45ec671b5a0e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:19.410497 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793c995-8786-474f-ac1b-45ec671b5a0e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:19.410867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793c995-8786-474f-ac1b-45ec671b5a0e None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:19.411643 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793c995-8786-474f-ac1b-45ec671b5a0e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:19.412107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793c995-8786-474f-ac1b-45ec671b5a0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:19.413670 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:19.416030 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793c995-8786-474f-ac1b-45ec671b5a0e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:19.427269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 445/875] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Sep 11 10:34:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:19.428118 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 431/876] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 10:34:19.433545 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793c995-8786-474f-ac1b-45ec671b5a0e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:19.506045 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0a977-11a2-4917-997e-0368003ad1a5 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:19.506380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0a977-11a2-4917-997e-0368003ad1a5 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:19.506655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0a977-11a2-4917-997e-0368003ad1a5 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:19.508617 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 432/877] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:19.514091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc35e7-41ac-43a8-a5c6-7a61bae63c25 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:19.514371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc35e7-41ac-43a8-a5c6-7a61bae63c25 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:19.514649 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc35e7-41ac-43a8-a5c6-7a61bae63c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:19.533611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-dfdc35e7-41ac-43a8-a5c6-7a61bae63c25 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:19.534813 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-dfdc35e7-41ac-43a8-a5c6-7a61bae63c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:19.552415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793c995-8786-474f-ac1b-45ec671b5a0e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:19.589389 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d1627-cf1b-410d-a60b-bdb9454f4648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:19.589932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d1627-cf1b-410d-a60b-bdb9454f4648 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:19.590213 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d1627-cf1b-410d-a60b-bdb9454f4648 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:19.590487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d1627-cf1b-410d-a60b-bdb9454f4648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:19.602997 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d1627-cf1b-410d-a60b-bdb9454f4648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:19.604429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d1627-cf1b-410d-a60b-bdb9454f4648 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:19.611550 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 433/878] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 10:34:19.613873 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec471bd4-d562-4d18-b837-15b4c5cfb9d9 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:19.614160 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec471bd4-d562-4d18-b837-15b4c5cfb9d9 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:19.614433 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec471bd4-d562-4d18-b837-15b4c5cfb9d9 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:19.615835 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 434/879] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:19.620941 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911d971-ecfa-48bc-8135-f7c9c71c9673 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:19.621061 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911d971-ecfa-48bc-8135-f7c9c71c9673 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:19.621293 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911d971-ecfa-48bc-8135-f7c9c71c9673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:19.628914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-616d1627-cf1b-410d-a60b-bdb9454f4648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:19.628914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:19.628914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:19.628914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:19.628914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:19.628914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:19.628914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:19.628914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:19.628914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:19.628914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:19.628914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:19.628914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:19.628914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:19.628914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:19.628914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:19.628914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:19.629883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:19.629883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:19.629883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:19.629883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:19.629883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:19.629883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:19.629883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:19.629883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:19.629883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:19.629883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:19.629883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:19.629883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:19.629883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:19.629883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:19.629883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:19.629883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:19.629883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:19.630788 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:19.630788 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:19.630788 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:19.630788 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 446/880] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:19.635894 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d1627-cf1b-410d-a60b-bdb9454f4648 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:19.642250 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-0911d971-ecfa-48bc-8135-f7c9c71c9673 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:19.643687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0911d971-ecfa-48bc-8135-f7c9c71c9673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:19.688769 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:19.720442 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 435/881] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 10:34:19.721624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911d971-ecfa-48bc-8135-f7c9c71c9673 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:19.749763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d1627-cf1b-410d-a60b-bdb9454f4648 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:19.780980 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:19.784817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4e0ec-b768-4c03-9614-1a56954129ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:19.785635 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4e0ec-b768-4c03-9614-1a56954129ec None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:19.786093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4e0ec-b768-4c03-9614-1a56954129ec None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:19.786548 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4e0ec-b768-4c03-9614-1a56954129ec None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:19.787366 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4e0ec-b768-4c03-9614-1a56954129ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:19.787872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4e0ec-b768-4c03-9614-1a56954129ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:19.789425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4e0ec-b768-4c03-9614-1a56954129ec None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:19.806534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 447/882] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:19.809691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4e0ec-b768-4c03-9614-1a56954129ec None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:19.838278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911d971-ecfa-48bc-8135-f7c9c71c9673 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:19.874289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbac242-6a64-4b1e-bd6f-535d9de585dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:19.876214 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbac242-6a64-4b1e-bd6f-535d9de585dc None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:19.876931 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbac242-6a64-4b1e-bd6f-535d9de585dc None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:19.877662 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbac242-6a64-4b1e-bd6f-535d9de585dc None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:19.878514 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbac242-6a64-4b1e-bd6f-535d9de585dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:19.880393 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbac242-6a64-4b1e-bd6f-535d9de585dc None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:19.899803 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 436/883] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 10:34:19 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:34:19.900818 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbac242-6a64-4b1e-bd6f-535d9de585dc None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:19.936028 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4e0ec-b768-4c03-9614-1a56954129ec None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:19.939670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:20.000817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8869a-4e0b-4afa-adb8-24103a3ed6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:20.001762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8869a-4e0b-4afa-adb8-24103a3ed6c1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:20.002048 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8869a-4e0b-4afa-adb8-24103a3ed6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:20.002328 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8869a-4e0b-4afa-adb8-24103a3ed6c1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:20.013712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8869a-4e0b-4afa-adb8-24103a3ed6c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:20.015678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8869a-4e0b-4afa-adb8-24103a3ed6c1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:20.024804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbac242-6a64-4b1e-bd6f-535d9de585dc None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:20.030803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-82d8869a-4e0b-4afa-adb8-24103a3ed6c1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 10:34:20.030803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:20.030803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:20.030803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:20.030803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:20.030803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:20.030803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:20.030803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:20.030803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:20.030803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:20.030803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:20.030803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:20.030803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:34:20.030803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:34:20.030803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:34:20.030803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:34:20.031938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:20.031938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:20.031938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:34:20.031938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:20.031938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:34:20.031938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:20.031938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:20.031938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:20.031938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:20.031938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:20.031938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:20.031938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:20.031938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:20.031938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:20.031938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:20.031938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:20.031938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:20.031938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:20.033561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:20.033561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:20.033561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:34:20.033561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:34:20.033561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:34:20.033561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:34:20.033561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:34:20.033561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:34:20.033561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 10:34:20.033561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:20.033561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 448/884] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Sep 11 10:34:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:34:20.034138 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8869a-4e0b-4afa-adb8-24103a3ed6c1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:20.044585 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:20.069131 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb3fdf-4c9c-4579-b4f8-3b417fc6c398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:20.069783 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb3fdf-4c9c-4579-b4f8-3b417fc6c398 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:20.070066 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb3fdf-4c9c-4579-b4f8-3b417fc6c398 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:20.070669 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb3fdf-4c9c-4579-b4f8-3b417fc6c398 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:20.071245 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb3fdf-4c9c-4579-b4f8-3b417fc6c398 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:20.072661 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb3fdf-4c9c-4579-b4f8-3b417fc6c398 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:20.082165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-cdfb3fdf-4c9c-4579-b4f8-3b417fc6c398 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 10:34:20.082165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:20.082165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:20.082165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:20.082165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:20.082165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:20.082165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:20.082165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:20.082165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 10:34:20.082165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:20.082165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:20.082165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:20.082165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:20.082165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:20.082165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:20.082165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:20.082165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:20.083271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:20.083271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:20.083271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:20.083271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:20.083271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:20.083271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:20.083271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:20.083271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:20.083271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:20.083271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:20.083271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:20.083271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:20.083271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:20.083271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:20.083271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:20.083271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:20.084097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:20.084097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:20.084097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:20.084097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:20.084097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:20.084097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:20.084097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:20.084097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:20.084097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:20.084097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:20.084097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:20.084097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:20.084097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 10:34:20.084097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:20.084097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 437/885] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 10:34:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:20.084937 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb3fdf-4c9c-4579-b4f8-3b417fc6c398 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:20.149902 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8869a-4e0b-4afa-adb8-24103a3ed6c1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:20.185185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af56b3a-80be-47b7-93fa-9b11a5cb19c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:20.186180 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af56b3a-80be-47b7-93fa-9b11a5cb19c0 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:20.186580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af56b3a-80be-47b7-93fa-9b11a5cb19c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:20.186859 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af56b3a-80be-47b7-93fa-9b11a5cb19c0 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:20.187515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af56b3a-80be-47b7-93fa-9b11a5cb19c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:20.189480 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af56b3a-80be-47b7-93fa-9b11a5cb19c0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:20.204904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb3fdf-4c9c-4579-b4f8-3b417fc6c398 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:20.212663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 449/886] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 10:34:20 2022] POST /identity/v3/services => generated 269 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:34:20.212663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af56b3a-80be-47b7-93fa-9b11a5cb19c0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:20.244437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:20.258146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fec151-0f1b-4f98-9570-146234038da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:20.258945 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fec151-0f1b-4f98-9570-146234038da2 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:20.259363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fec151-0f1b-4f98-9570-146234038da2 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:20.259720 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fec151-0f1b-4f98-9570-146234038da2 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:20.260674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fec151-0f1b-4f98-9570-146234038da2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:20.261127 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fec151-0f1b-4f98-9570-146234038da2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:20.263706 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fec151-0f1b-4f98-9570-146234038da2 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:20.286207 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 438/887] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Sep 11 10:34:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:20.292076 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fec151-0f1b-4f98-9570-146234038da2 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:20.332429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:20.371026 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af56b3a-80be-47b7-93fa-9b11a5cb19c0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:20.424587 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9f3f4-6d4b-4ac9-840e-befcbe7e5dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:20.425121 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9f3f4-6d4b-4ac9-840e-befcbe7e5dfe None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:20.425393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9f3f4-6d4b-4ac9-840e-befcbe7e5dfe None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:20.425657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9f3f4-6d4b-4ac9-840e-befcbe7e5dfe None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:20.426284 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9f3f4-6d4b-4ac9-840e-befcbe7e5dfe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:20.426580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9f3f4-6d4b-4ac9-840e-befcbe7e5dfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:20.427936 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9f3f4-6d4b-4ac9-840e-befcbe7e5dfe None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:20.433387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 450/888] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Sep 11 10:34:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:20.439086 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9f3f4-6d4b-4ac9-840e-befcbe7e5dfe None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:20.442884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fec151-0f1b-4f98-9570-146234038da2 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:20.485237 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1bccc-934e-4b7b-99ae-4647dfe95375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:20.486278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1bccc-934e-4b7b-99ae-4647dfe95375 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:20.486752 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1bccc-934e-4b7b-99ae-4647dfe95375 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:20.487217 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1bccc-934e-4b7b-99ae-4647dfe95375 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:20.551643 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:20.558983 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1bccc-934e-4b7b-99ae-4647dfe95375 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:20.560759 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1bccc-934e-4b7b-99ae-4647dfe95375 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:20.576264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9f3f4-6d4b-4ac9-840e-befcbe7e5dfe None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:20.589487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:20.621343 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec127870-9330-4ab0-83fa-bbc35aa38a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:20.621959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec127870-9330-4ab0-83fa-bbc35aa38a11 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:20.622241 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec127870-9330-4ab0-83fa-bbc35aa38a11 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:20.622508 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec127870-9330-4ab0-83fa-bbc35aa38a11 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:20.623311 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec127870-9330-4ab0-83fa-bbc35aa38a11 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:20.623616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec127870-9330-4ab0-83fa-bbc35aa38a11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:20.625712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec127870-9330-4ab0-83fa-bbc35aa38a11 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:20.632586 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 451/889] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Sep 11 10:34:20 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:20.681047 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 439/890] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:34:20 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 10:34:20.687423 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec127870-9330-4ab0-83fa-bbc35aa38a11 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:20.809759 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec127870-9330-4ab0-83fa-bbc35aa38a11 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:20.850332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ec935-b941-4d7e-b0cc-423032760bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:20.851336 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ec935-b941-4d7e-b0cc-423032760bc9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:20.851827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ec935-b941-4d7e-b0cc-423032760bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:20.852305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ec935-b941-4d7e-b0cc-423032760bc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:20.864165 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ec935-b941-4d7e-b0cc-423032760bc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:20.865963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ec935-b941-4d7e-b0cc-423032760bc9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:20.873334 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:20.882369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ed9ec935-b941-4d7e-b0cc-423032760bc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:20.882369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:20.882369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:20.882369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:20.882369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:20.882369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:20.882369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:20.882369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:20.882369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:20.882369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:20.882369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:20.882369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:20.882369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:20.882369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:20.882369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:20.882369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:20.883368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:20.883368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:20.883368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:20.883368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:20.883368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:20.883368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:20.883368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:20.883368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:20.883368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:20.883368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:20.883368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:20.883368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:20.883368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:20.883368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:20.883368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:20.883368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:20.883368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:20.884352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:20.884352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:20.884352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:20.886561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 452/891] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:20.892363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1bccc-934e-4b7b-99ae-4647dfe95375 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:20.998677 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1bccc-934e-4b7b-99ae-4647dfe95375 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:21.027878 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:21.037414 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ed12c-6330-48ea-b52b-7d5d6f0a38f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:21.038325 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ed12c-6330-48ea-b52b-7d5d6f0a38f4 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:21.038817 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ed12c-6330-48ea-b52b-7d5d6f0a38f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:21.039321 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ed12c-6330-48ea-b52b-7d5d6f0a38f4 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:21.040175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ed12c-6330-48ea-b52b-7d5d6f0a38f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:21.040716 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ed12c-6330-48ea-b52b-7d5d6f0a38f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:21.042302 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ed12c-6330-48ea-b52b-7d5d6f0a38f4 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:21.055573 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 440/892] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:21.061315 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ec935-b941-4d7e-b0cc-423032760bc9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:21.167154 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ec935-b941-4d7e-b0cc-423032760bc9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:21.205700 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccb477-4c52-43d3-a0d9-4a873cbb74cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:21.206328 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccb477-4c52-43d3-a0d9-4a873cbb74cd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:21.206603 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccb477-4c52-43d3-a0d9-4a873cbb74cd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:21.206872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccb477-4c52-43d3-a0d9-4a873cbb74cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:21.213578 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ccb477-4c52-43d3-a0d9-4a873cbb74cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:21.215001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ccb477-4c52-43d3-a0d9-4a873cbb74cd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:21.227084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-a3ccb477-4c52-43d3-a0d9-4a873cbb74cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:21.227084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:21.227084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:21.227084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:21.227084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:21.227084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:21.227084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:21.227084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:21.227084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:21.227084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:21.227084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:21.227084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:21.227084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:34:21.227084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:34:21.227084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:34:21.227994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:34:21.227994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:21.227994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:21.227994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:21.227994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:21.227994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:21.227994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:21.227994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:21.227994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:21.227994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:21.227994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:21.227994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:21.227994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:21.227994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:21.227994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:21.227994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:21.227994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:21.228920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:34:21.228920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:34:21.228920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:34:21.228920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:34:21.228920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:34:21.228920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:34:21.228920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:21.228920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:21.228920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 453/893] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:21.235831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ed12c-6330-48ea-b52b-7d5d6f0a38f4 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:21.342298 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ed12c-6330-48ea-b52b-7d5d6f0a38f4 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:21.378582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63b65e-a979-42a6-a3a6-d3a1205e38a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:21.379587 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63b65e-a979-42a6-a3a6-d3a1205e38a3 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:21.380120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63b65e-a979-42a6-a3a6-d3a1205e38a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:21.380634 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63b65e-a979-42a6-a3a6-d3a1205e38a3 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:21.381549 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63b65e-a979-42a6-a3a6-d3a1205e38a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:21.382062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63b65e-a979-42a6-a3a6-d3a1205e38a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:21.383703 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63b65e-a979-42a6-a3a6-d3a1205e38a3 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:21.397586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 441/894] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:34:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:21.405697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccb477-4c52-43d3-a0d9-4a873cbb74cd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:21.467575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:21.511157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccb477-4c52-43d3-a0d9-4a873cbb74cd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:21.546243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c614f-c809-4a43-a3a6-6c241c6b392d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:21.547804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c614f-c809-4a43-a3a6-6c241c6b392d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:21.548294 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c614f-c809-4a43-a3a6-6c241c6b392d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:21.548814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c614f-c809-4a43-a3a6-6c241c6b392d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:21.549763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c614f-c809-4a43-a3a6-6c241c6b392d None admin] RBAC: Adding query filter params (role.id=8896f3c145b84c85a4ddf8a6b17422b2, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=bdc800f1d4174b5cba4f6f496207ec95) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:21.550283 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c614f-c809-4a43-a3a6-6c241c6b392d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:21.551888 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c614f-c809-4a43-a3a6-6c241c6b392d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:21.557891 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 454/895] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:34:21 2022] GET /identity/v3/role_assignments?user.id=bdc800f1d4174b5cba4f6f496207ec95&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=8896f3c145b84c85a4ddf8a6b17422b2 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:22.139844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae30e39-b451-4f3a-bd08-b3a87877cdb9 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:22.140391 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae30e39-b451-4f3a-bd08-b3a87877cdb9 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:22.140391 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae30e39-b451-4f3a-bd08-b3a87877cdb9 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:22.142059 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 442/896] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:22.147425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c5cbd-91de-4c76-82e0-9319ed8272ff None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:22.147820 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c5cbd-91de-4c76-82e0-9319ed8272ff None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:22.148008 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c5cbd-91de-4c76-82e0-9319ed8272ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:22.166126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c42c5cbd-91de-4c76-82e0-9319ed8272ff None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:22.167326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c42c5cbd-91de-4c76-82e0-9319ed8272ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:22.241690 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 455/897] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:22.491383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599db02-5a7a-4f94-8e21-bdbce0342bd4 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:22.491571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599db02-5a7a-4f94-8e21-bdbce0342bd4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:22.491852 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599db02-5a7a-4f94-8e21-bdbce0342bd4 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:22.493447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 443/898] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:22.498867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3ac3b-5751-4d07-a8fc-d577dd380648 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:22.499162 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3ac3b-5751-4d07-a8fc-d577dd380648 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:22.499441 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3ac3b-5751-4d07-a8fc-d577dd380648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:22.509978 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599db02-5a7a-4f94-8e21-bdbce0342bd4 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:22.522305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-33d3ac3b-5751-4d07-a8fc-d577dd380648 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:22.523845 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-33d3ac3b-5751-4d07-a8fc-d577dd380648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:22.568249 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:22.579144 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:22.603068 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 456/899] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:22.630018 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599db02-5a7a-4f94-8e21-bdbce0342bd4 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:22.668313 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc07cd6-0477-4dca-bb67-3b35303bb8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:22.669422 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc07cd6-0477-4dca-bb67-3b35303bb8ab None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:22.669932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc07cd6-0477-4dca-bb67-3b35303bb8ab None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:22.670469 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc07cd6-0477-4dca-bb67-3b35303bb8ab None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:22.671270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc07cd6-0477-4dca-bb67-3b35303bb8ab None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:22.672993 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc07cd6-0477-4dca-bb67-3b35303bb8ab None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:22.684861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-5cc07cd6-0477-4dca-bb67-3b35303bb8ab None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 10:34:22.684861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:22.684861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:22.684861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:22.684861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:22.684861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:22.684861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:22.684861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:22.684861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 10:34:22.684861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:22.684861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:22.684861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:22.684861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:22.684861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:22.684861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:22.684861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:22.684861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:22.685976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:22.685976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:22.685976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:22.685976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:22.685976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:22.685976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:22.685976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:22.685976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:22.685976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:22.685976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:22.685976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:22.685976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:22.685976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:22.685976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:22.685976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:22.685976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:22.686833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:22.686833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:22.686833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:22.686833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:22.686833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:22.686833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:22.686833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:22.686833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:22.686833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:22.686833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:22.686833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:22.686833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:22.686833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 10:34:22.686833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:22.690541 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 444/900] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:34:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:22.697017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3ac3b-5751-4d07-a8fc-d577dd380648 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:22.811945 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3ac3b-5751-4d07-a8fc-d577dd380648 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:22.851948 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44e2e7-11a2-45bd-a904-48e6ce17193b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:22.852849 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44e2e7-11a2-45bd-a904-48e6ce17193b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:22.853295 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44e2e7-11a2-45bd-a904-48e6ce17193b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:22.853731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44e2e7-11a2-45bd-a904-48e6ce17193b None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:22.854547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44e2e7-11a2-45bd-a904-48e6ce17193b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:22.854991 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44e2e7-11a2-45bd-a904-48e6ce17193b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:22.856500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44e2e7-11a2-45bd-a904-48e6ce17193b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:22.862242 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 457/901] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:34:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:22.868578 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc07cd6-0477-4dca-bb67-3b35303bb8ab None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:22.903075 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44e2e7-11a2-45bd-a904-48e6ce17193b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:22.957413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:22.977675 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc07cd6-0477-4dca-bb67-3b35303bb8ab None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:22.995039 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:23.017435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44e2e7-11a2-45bd-a904-48e6ce17193b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:23.020233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0452f7-ac0f-4a9e-8ff8-a743bd9bcd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:23.021423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0452f7-ac0f-4a9e-8ff8-a743bd9bcd3e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:23.021878 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0452f7-ac0f-4a9e-8ff8-a743bd9bcd3e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:23.022378 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0452f7-ac0f-4a9e-8ff8-a743bd9bcd3e None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:23.023597 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0452f7-ac0f-4a9e-8ff8-a743bd9bcd3e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:23.024108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0452f7-ac0f-4a9e-8ff8-a743bd9bcd3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:23.026035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0452f7-ac0f-4a9e-8ff8-a743bd9bcd3e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:23.031472 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 445/902] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:34:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:23.032468 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f83c3-eab7-44f1-93f6-c35fdbaeafe2 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:23.032785 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f83c3-eab7-44f1-93f6-c35fdbaeafe2 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:23.033065 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f83c3-eab7-44f1-93f6-c35fdbaeafe2 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:23.034392 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 446/903] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:23.037550 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f83c3-eab7-44f1-93f6-c35fdbaeafe2 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:23.058558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef088e5b-8de5-470d-966a-ded4d318d6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:23.059186 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef088e5b-8de5-470d-966a-ded4d318d6e3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:23.059464 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef088e5b-8de5-470d-966a-ded4d318d6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:23.059742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef088e5b-8de5-470d-966a-ded4d318d6e3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:23.060324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef088e5b-8de5-470d-966a-ded4d318d6e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:23.061718 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef088e5b-8de5-470d-966a-ded4d318d6e3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:23.071017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ef088e5b-8de5-470d-966a-ded4d318d6e3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 10:34:23.071017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:23.071017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:23.071017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:23.071017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:23.071017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:23.071017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:23.071017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:23.071017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 10:34:23.071017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:23.071017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:23.071017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:23.071017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:23.071017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:23.071017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:23.071017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:23.071931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:23.071931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:23.071931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:23.071931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:23.071931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:23.071931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:23.071931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:23.071931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:23.071931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:23.071931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:23.071931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:23.071931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:23.071931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:23.071931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:23.071931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:23.071931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:23.071931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:23.073400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:23.073400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:23.073400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:23.073400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:23.073400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:23.073400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:23.073400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:23.073400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:23.073400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:23.073400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:23.073400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:23.073400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:23.073400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 10:34:23.073400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:23.073400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 458/904] 10.222.0.20 () {56 vars in 1132 bytes} [Sun Sep 11 10:34:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:23.074181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9d7d4-2ed3-48e5-942d-4a4584661ea2 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:23.074181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9d7d4-2ed3-48e5-942d-4a4584661ea2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:23.074579 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9d7d4-2ed3-48e5-942d-4a4584661ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:23.095594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-46e9d7d4-2ed3-48e5-942d-4a4584661ea2 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:23.097128 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-46e9d7d4-2ed3-48e5-942d-4a4584661ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:23.148291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f83c3-eab7-44f1-93f6-c35fdbaeafe2 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:23.170643 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 459/905] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:23.192571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f75ca2-e808-42df-9cc1-1bbda05f3b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:23.192784 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9d7d4-2ed3-48e5-942d-4a4584661ea2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:23.192887 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f75ca2-e808-42df-9cc1-1bbda05f3b1d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:23.192887 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f75ca2-e808-42df-9cc1-1bbda05f3b1d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:23.192887 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f75ca2-e808-42df-9cc1-1bbda05f3b1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:23.192887 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f75ca2-e808-42df-9cc1-1bbda05f3b1d None admin] RBAC: Adding query filter params (interface=public, service_id=3ee447022aa44685888f58fa53458ff7, region_id=RegionOne) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:23.192887 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f75ca2-e808-42df-9cc1-1bbda05f3b1d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:23.192887 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f75ca2-e808-42df-9cc1-1bbda05f3b1d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:23.199739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 447/906] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Sep 11 10:34:23 2022] GET /identity/v3/endpoints?service_id=3ee447022aa44685888f58fa53458ff7&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:23.206636 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f75ca2-e808-42df-9cc1-1bbda05f3b1d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:23.237032 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:23.264394 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:23.305835 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9d7d4-2ed3-48e5-942d-4a4584661ea2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:23.342934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f75ca2-e808-42df-9cc1-1bbda05f3b1d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:23.351516 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f1867-6956-42fa-997f-c9a00745400d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:23.352122 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f1867-6956-42fa-997f-c9a00745400d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:23.352875 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f1867-6956-42fa-997f-c9a00745400d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:23.353149 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f1867-6956-42fa-997f-c9a00745400d None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:23.353780 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f1867-6956-42fa-997f-c9a00745400d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:23.354479 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f1867-6956-42fa-997f-c9a00745400d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:23.356121 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f1867-6956-42fa-997f-c9a00745400d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:23.362490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 460/907] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 10:34:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:23.368271 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f1867-6956-42fa-997f-c9a00745400d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:23.381008 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3fa0b-adb2-4c9d-a511-d776860c5459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:23.382004 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3fa0b-adb2-4c9d-a511-d776860c5459 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:23.382502 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3fa0b-adb2-4c9d-a511-d776860c5459 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:23.382968 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3fa0b-adb2-4c9d-a511-d776860c5459 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:23.384020 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3fa0b-adb2-4c9d-a511-d776860c5459 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:23.385571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3fa0b-adb2-4c9d-a511-d776860c5459 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:23.392874 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 448/908] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Sep 11 10:34:23 2022] GET /identity/v3/services => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:34:23.480257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3fa0b-adb2-4c9d-a511-d776860c5459 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:23.483830 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f1867-6956-42fa-997f-c9a00745400d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:23.487488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:23.535260 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c7f40-00d5-4aa2-9235-1cf8ec49f84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:23.535947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c7f40-00d5-4aa2-9235-1cf8ec49f84a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:23.536229 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c7f40-00d5-4aa2-9235-1cf8ec49f84a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:23.536497 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c7f40-00d5-4aa2-9235-1cf8ec49f84a None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:23.537187 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c7f40-00d5-4aa2-9235-1cf8ec49f84a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:23.537487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c7f40-00d5-4aa2-9235-1cf8ec49f84a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:23.539017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c7f40-00d5-4aa2-9235-1cf8ec49f84a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:23.548649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 461/909] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 10:34:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:23.552765 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c7f40-00d5-4aa2-9235-1cf8ec49f84a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:23.616043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3fa0b-adb2-4c9d-a511-d776860c5459 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:23.619869 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:23.660799 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d6431-0670-42ff-beb4-9b3d37cbac90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:23.661514 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d6431-0670-42ff-beb4-9b3d37cbac90 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:23.661791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d6431-0670-42ff-beb4-9b3d37cbac90 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:23.662063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d6431-0670-42ff-beb4-9b3d37cbac90 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:23.662898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d6431-0670-42ff-beb4-9b3d37cbac90 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:23.664398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d6431-0670-42ff-beb4-9b3d37cbac90 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:23.676831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c7f40-00d5-4aa2-9235-1cf8ec49f84a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:23.683657 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 449/910] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 10:34:23 2022] POST /identity/v3/services => generated 241 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:34:23.729368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1d050-e72c-4246-8e3f-a6e67fc9b1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:23.730041 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1d050-e72c-4246-8e3f-a6e67fc9b1b9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:23.730324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1d050-e72c-4246-8e3f-a6e67fc9b1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:23.730598 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1d050-e72c-4246-8e3f-a6e67fc9b1b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:23.731374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1d050-e72c-4246-8e3f-a6e67fc9b1b9 None admin] RBAC: Adding query filter params (interface=public, service_id=1bcd85c1284545a3a08ca04592f03c3b, region_id=RegionOne) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:23.731688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1d050-e72c-4246-8e3f-a6e67fc9b1b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:23.733115 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1d050-e72c-4246-8e3f-a6e67fc9b1b9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:23.739819 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 462/911] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Sep 11 10:34:23 2022] GET /identity/v3/endpoints?service_id=1bcd85c1284545a3a08ca04592f03c3b&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:23.745589 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d6431-0670-42ff-beb4-9b3d37cbac90 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:23.764926 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d309d0a-0913-4b1e-98f9-43f9be6206bb None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:23.765234 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d309d0a-0913-4b1e-98f9-43f9be6206bb None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:23.766286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d309d0a-0913-4b1e-98f9-43f9be6206bb None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:23.768031 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 463/912] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:23.773315 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6c7c1-9a97-4a3d-9a34-19a1e2494b60 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:23.773638 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6c7c1-9a97-4a3d-9a34-19a1e2494b60 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:23.773872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6c7c1-9a97-4a3d-9a34-19a1e2494b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:23.795221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-aad6c7c1-9a97-4a3d-9a34-19a1e2494b60 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:23.796580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-aad6c7c1-9a97-4a3d-9a34-19a1e2494b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:23.827634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:23.878221 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d6431-0670-42ff-beb4-9b3d37cbac90 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:23.885562 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 464/913] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 10:34:23.918552 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b738a-3721-4786-9b7a-531ded5d15f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:23.919210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b738a-3721-4786-9b7a-531ded5d15f7 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:23.919489 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b738a-3721-4786-9b7a-531ded5d15f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:23.919757 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b738a-3721-4786-9b7a-531ded5d15f7 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:23.920417 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b738a-3721-4786-9b7a-531ded5d15f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:23.921878 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b738a-3721-4786-9b7a-531ded5d15f7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:23.932875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 450/914] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Sep 11 10:34:23 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:34:24.200918 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6c7c1-9a97-4a3d-9a34-19a1e2494b60 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:24.305234 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6c7c1-9a97-4a3d-9a34-19a1e2494b60 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:24.340334 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa526c-e19b-4c82-8262-a65144079b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:24.341010 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa526c-e19b-4c82-8262-a65144079b45 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:24.341291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa526c-e19b-4c82-8262-a65144079b45 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:24.341559 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa526c-e19b-4c82-8262-a65144079b45 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:24.352808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa526c-e19b-4c82-8262-a65144079b45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:34:24.358004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-c0aa526c-e19b-4c82-8262-a65144079b45 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 10:34:24.358004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:24.358004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:24.358004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:24.358004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:24.358004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:24.358004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:24.358004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:24.358004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:24.358004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:24.358004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:24.358004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:24.358004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:34:24.358004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:34:24.358004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:34:24.358004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:34:24.359017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:34:24.359017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:34:24.359017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:34:24.359017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:34:24.359017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:24.359017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:24.359017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:24.359017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:24.359017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:24.359017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:24.359017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:24.359017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:24.359017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:24.359017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:24.359017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:24.359017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:24.360409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:24.360409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:24.360409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:24.360409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:24.360409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:34:24.360409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:34:24.360409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:34:24.360409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:34:24.360409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:34:24.360409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:34:24.360409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 10:34:24.360409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:24.360409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 465/915] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Sep 11 10:34:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:24.366873 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b738a-3721-4786-9b7a-531ded5d15f7 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:24.414161 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:24.482442 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b738a-3721-4786-9b7a-531ded5d15f7 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:24.518556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1019a78-70d7-4cf8-be6b-4174da005cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:24.519537 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019a78-70d7-4cf8-be6b-4174da005cdc None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:24.520106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019a78-70d7-4cf8-be6b-4174da005cdc None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:24.520639 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019a78-70d7-4cf8-be6b-4174da005cdc None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:24.521497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1019a78-70d7-4cf8-be6b-4174da005cdc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:24.522005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1019a78-70d7-4cf8-be6b-4174da005cdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:24.523558 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1019a78-70d7-4cf8-be6b-4174da005cdc None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:24.532540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 451/916] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Sep 11 10:34:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:24.540583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa526c-e19b-4c82-8262-a65144079b45 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:24.558331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:24.646050 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa526c-e19b-4c82-8262-a65144079b45 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:24.681919 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885eec8f-beae-4db4-ac7b-0b73e785d622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:24.682551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885eec8f-beae-4db4-ac7b-0b73e785d622 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:24.682825 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885eec8f-beae-4db4-ac7b-0b73e785d622 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:24.683094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885eec8f-beae-4db4-ac7b-0b73e785d622 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:24.694420 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885eec8f-beae-4db4-ac7b-0b73e785d622 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:24.695915 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885eec8f-beae-4db4-ac7b-0b73e785d622 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:24.722684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-885eec8f-beae-4db4-ac7b-0b73e785d622 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:24.722684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:24.722684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:24.722684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:24.722684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:24.722684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:24.722684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:24.722684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:24.722684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:24.722684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:24.722684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:24.722684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:24.722684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:24.722684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:24.722684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:24.722684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:24.723630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:24.723630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:24.723630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:24.723630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:24.723630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:24.723630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:24.723630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:24.723630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:24.723630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:24.723630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:24.723630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:24.723630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:24.723630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:24.723630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:24.723630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:24.723630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:24.723630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:24.724513 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:24.724513 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:24.724513 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:24.724513 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 466/917] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:24.730923 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1019a78-70d7-4cf8-be6b-4174da005cdc None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:24.840945 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:24.849125 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1019a78-70d7-4cf8-be6b-4174da005cdc None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:24.884347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981c575-dc26-4262-a83d-9ff5c9bfec6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:24.884978 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981c575-dc26-4262-a83d-9ff5c9bfec6c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:24.885253 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981c575-dc26-4262-a83d-9ff5c9bfec6c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:24.885821 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981c575-dc26-4262-a83d-9ff5c9bfec6c None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:24.886602 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981c575-dc26-4262-a83d-9ff5c9bfec6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:24.886903 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981c575-dc26-4262-a83d-9ff5c9bfec6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:24.888295 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981c575-dc26-4262-a83d-9ff5c9bfec6c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:24.901487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 452/918] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:24.909631 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885eec8f-beae-4db4-ac7b-0b73e785d622 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:24.981073 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:25.014128 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885eec8f-beae-4db4-ac7b-0b73e785d622 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:25.048941 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7878c-8e7b-4787-b93a-d955eab4618e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:25.049906 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7878c-8e7b-4787-b93a-d955eab4618e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:25.050408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7878c-8e7b-4787-b93a-d955eab4618e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:25.050891 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7878c-8e7b-4787-b93a-d955eab4618e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:25.059992 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7878c-8e7b-4787-b93a-d955eab4618e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:25.061716 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7878c-8e7b-4787-b93a-d955eab4618e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:25.074682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-80d7878c-8e7b-4787-b93a-d955eab4618e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 10:34:25.074682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:25.074682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:25.074682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:25.074682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:25.074682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:25.074682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:25.074682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:25.074682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:25.074682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:25.074682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:25.074682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:25.074682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:34:25.074682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:34:25.074682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:34:25.074682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:34:25.075639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:25.075639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:25.075639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:34:25.075639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:25.075639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:34:25.075639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:25.075639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:25.075639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:25.075639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:25.075639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:25.075639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:25.075639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:25.075639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:25.075639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:25.075639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:25.075639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:25.075639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:25.075639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:25.076649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:25.076649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:25.076649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:34:25.076649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:34:25.076649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:34:25.076649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:34:25.076649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:34:25.076649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:34:25.076649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 10:34:25.076649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:25.076649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 467/919] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Sep 11 10:34:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:25.084270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981c575-dc26-4262-a83d-9ff5c9bfec6c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:25.203342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981c575-dc26-4262-a83d-9ff5c9bfec6c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:25.239220 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa96be-be09-4f22-9e2d-3cb7a6813577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:25.239822 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa96be-be09-4f22-9e2d-3cb7a6813577 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:25.240096 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa96be-be09-4f22-9e2d-3cb7a6813577 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:25.240367 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa96be-be09-4f22-9e2d-3cb7a6813577 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:25.241129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa96be-be09-4f22-9e2d-3cb7a6813577 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:25.241429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa96be-be09-4f22-9e2d-3cb7a6813577 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:25.242857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa96be-be09-4f22-9e2d-3cb7a6813577 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:25.261862 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 453/920] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Sep 11 10:34:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:25.267694 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7878c-8e7b-4787-b93a-d955eab4618e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:25.372523 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7878c-8e7b-4787-b93a-d955eab4618e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:25.402957 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:25.408097 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115bf0d-d942-4d5f-af7e-41293df88967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:25.408754 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115bf0d-d942-4d5f-af7e-41293df88967 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:25.409032 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115bf0d-d942-4d5f-af7e-41293df88967 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:25.409353 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115bf0d-d942-4d5f-af7e-41293df88967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:25.420707 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115bf0d-d942-4d5f-af7e-41293df88967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:25.422148 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115bf0d-d942-4d5f-af7e-41293df88967 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:25.436316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-3115bf0d-d942-4d5f-af7e-41293df88967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:25.436316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:25.436316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:25.436316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:25.436316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:25.436316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:25.436316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:25.436316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:25.436316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:25.436316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:25.436316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:25.436316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:25.436316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:25.436316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:25.436316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:25.436316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:25.437287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:25.437287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:25.437287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:25.437287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:25.437287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:25.437287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:25.437287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:25.437287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:25.437287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:25.437287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:25.437287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:25.437287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:25.437287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:25.437287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:25.437287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:25.437287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:25.437287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:25.438745 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:25.438745 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:25.438745 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:25.439595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 468/921] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:25.445836 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa96be-be09-4f22-9e2d-3cb7a6813577 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:25.460972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:25.560732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa96be-be09-4f22-9e2d-3cb7a6813577 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:25.599732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de391b9e-1b4a-4431-abe6-1dc4e48eb0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:25.600335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de391b9e-1b4a-4431-abe6-1dc4e48eb0dd None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:25.600636 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de391b9e-1b4a-4431-abe6-1dc4e48eb0dd None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:25.600909 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de391b9e-1b4a-4431-abe6-1dc4e48eb0dd None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:25.601554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de391b9e-1b4a-4431-abe6-1dc4e48eb0dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:25.601853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de391b9e-1b4a-4431-abe6-1dc4e48eb0dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:25.603221 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de391b9e-1b4a-4431-abe6-1dc4e48eb0dd None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:25.615474 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 454/922] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:25.621177 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115bf0d-d942-4d5f-af7e-41293df88967 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:25.655058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d557ca-50e4-40cf-ba45-360d2ed5beec None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:25.657104 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d557ca-50e4-40cf-ba45-360d2ed5beec None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:25.657400 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d557ca-50e4-40cf-ba45-360d2ed5beec None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:25.659766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 455/923] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:34:25.665949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dc5bc-5b0c-4810-a75b-379c829295ce None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:25.666245 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dc5bc-5b0c-4810-a75b-379c829295ce None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:25.666512 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dc5bc-5b0c-4810-a75b-379c829295ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:25.691097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-fa8dc5bc-5b0c-4810-a75b-379c829295ce None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:25.692584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fa8dc5bc-5b0c-4810-a75b-379c829295ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:25.742515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115bf0d-d942-4d5f-af7e-41293df88967 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:25.784580 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 456/924] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 10:34:25.784580 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:25.786176 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69e4ff-a2db-4542-a599-0f7f6aa59c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:25.786176 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e4ff-a2db-4542-a599-0f7f6aa59c81 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:25.786176 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e4ff-a2db-4542-a599-0f7f6aa59c81 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:25.786446 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e4ff-a2db-4542-a599-0f7f6aa59c81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:25.795039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69e4ff-a2db-4542-a599-0f7f6aa59c81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:25.796490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69e4ff-a2db-4542-a599-0f7f6aa59c81 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:25.808965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-4d69e4ff-a2db-4542-a599-0f7f6aa59c81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:25.808965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:25.808965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:25.808965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:25.808965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:25.808965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:25.808965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:25.808965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:25.808965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:25.808965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:25.808965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:25.808965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:25.808965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:34:25.808965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:34:25.808965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:34:25.809873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:34:25.809873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:25.809873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:25.809873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:25.809873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:25.809873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:25.809873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:25.809873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:25.809873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:25.809873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:25.809873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:25.809873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:25.809873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:25.809873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:25.809873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:25.809873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:25.809873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:25.810776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:34:25.810776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:34:25.810776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:34:25.810776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:34:25.810776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:34:25.810776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:34:25.810776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:25.810776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:25.810776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 469/925] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:25.817071 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8dc5bc-5b0c-4810-a75b-379c829295ce None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:25.920742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8dc5bc-5b0c-4810-a75b-379c829295ce None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:25.956406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132bd07-40c7-464d-bf0c-1cbe229dd860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:25.957049 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132bd07-40c7-464d-bf0c-1cbe229dd860 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:25.957342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132bd07-40c7-464d-bf0c-1cbe229dd860 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:25.957624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132bd07-40c7-464d-bf0c-1cbe229dd860 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:25.958325 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132bd07-40c7-464d-bf0c-1cbe229dd860 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:25.958634 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132bd07-40c7-464d-bf0c-1cbe229dd860 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:25.960134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132bd07-40c7-464d-bf0c-1cbe229dd860 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:25.973001 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 457/926] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:34:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:25.978816 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69e4ff-a2db-4542-a599-0f7f6aa59c81 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:26.028625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:26.070275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132bd07-40c7-464d-bf0c-1cbe229dd860 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:26.096298 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69e4ff-a2db-4542-a599-0f7f6aa59c81 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:26.139068 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60e88d-9d4f-4422-8c72-51b354117918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:26.139757 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60e88d-9d4f-4422-8c72-51b354117918 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:26.140046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60e88d-9d4f-4422-8c72-51b354117918 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:26.140329 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60e88d-9d4f-4422-8c72-51b354117918 None admin] PATH_INFO: `/v3/projects/cd477d464e9f48149879362d04db9b9e/users/bdc800f1d4174b5cba4f6f496207ec95/roles/8896f3c145b84c85a4ddf8a6b17422b2` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:26.143391 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60e88d-9d4f-4422-8c72-51b354117918 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd477d464e9f48149879362d04db9b9e, user_id=bdc800f1d4174b5cba4f6f496207ec95, role_id=8896f3c145b84c85a4ddf8a6b17422b2)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:26.144932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60e88d-9d4f-4422-8c72-51b354117918 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:26.154342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:26.166408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 470/927] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:34:25 2022] PUT /identity/v3/projects/cd477d464e9f48149879362d04db9b9e/users/bdc800f1d4174b5cba4f6f496207ec95/roles/8896f3c145b84c85a4ddf8a6b17422b2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:34:26.166408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9513957-a2cb-4af6-8e89-63a92afd6530 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:26.166408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9513957-a2cb-4af6-8e89-63a92afd6530 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:26.166408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9513957-a2cb-4af6-8e89-63a92afd6530 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:26.166408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 471/928] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:26.178423 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1b417-1cf8-4aa8-8ef4-3a1e06b5f01e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:26.178736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1b417-1cf8-4aa8-8ef4-3a1e06b5f01e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:26.178987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1b417-1cf8-4aa8-8ef4-3a1e06b5f01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:26.204416 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2fb1b417-1cf8-4aa8-8ef4-3a1e06b5f01e None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:26.206453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2fb1b417-1cf8-4aa8-8ef4-3a1e06b5f01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:26.217846 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132bd07-40c7-464d-bf0c-1cbe229dd860 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:26.259579 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066072de-fecc-4261-9de8-a828280d00ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:26.260144 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066072de-fecc-4261-9de8-a828280d00ce None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:26.260424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066072de-fecc-4261-9de8-a828280d00ce None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:26.260735 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066072de-fecc-4261-9de8-a828280d00ce None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:26.261335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066072de-fecc-4261-9de8-a828280d00ce None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:26.262731 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066072de-fecc-4261-9de8-a828280d00ce None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:26.272428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-066072de-fecc-4261-9de8-a828280d00ce None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 10:34:26.272428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:26.272428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:26.272428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:26.272428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:26.272428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:26.272428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:26.272428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:26.272428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 10:34:26.272428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:26.272428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:26.272428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:26.272428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:26.272428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:26.272428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:26.272428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:26.272428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:26.273740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:26.273740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:26.273740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:26.273740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:26.273740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:26.273740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:26.273740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:26.273740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:26.273740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:26.273740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:26.273740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:26.273740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:26.273740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:26.273740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:26.273740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:26.273740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:26.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:26.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:26.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:26.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:26.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:26.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:26.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:26.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:26.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:26.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:26.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:26.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:26.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 10:34:26.274845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:26.278754 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 458/929] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:34:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:26.280196 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295a239-d346-4f3a-a330-619bd794d550 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:26.280484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295a239-d346-4f3a-a330-619bd794d550 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:26.280792 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295a239-d346-4f3a-a330-619bd794d550 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:26.282951 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 459/930] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:26.283710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295a239-d346-4f3a-a330-619bd794d550 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:26.301688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 472/931] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:26.303928 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b9d7d-67a8-4b9c-ba50-73597805d74a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:26.304398 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b9d7d-67a8-4b9c-ba50-73597805d74a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:26.304870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b9d7d-67a8-4b9c-ba50-73597805d74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:26.329824 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-540b9d7d-67a8-4b9c-ba50-73597805d74a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:26.331175 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-540b9d7d-67a8-4b9c-ba50-73597805d74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:26.367159 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:26.417006 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 473/932] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:26.428288 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295a239-d346-4f3a-a330-619bd794d550 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:26.455608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:26.469406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a20bd-ead5-4a15-a6ab-bc9c9e484e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:26.470322 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a20bd-ead5-4a15-a6ab-bc9c9e484e16 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:26.470804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a20bd-ead5-4a15-a6ab-bc9c9e484e16 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:26.471530 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a20bd-ead5-4a15-a6ab-bc9c9e484e16 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:26.472365 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a20bd-ead5-4a15-a6ab-bc9c9e484e16 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:26.472900 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a20bd-ead5-4a15-a6ab-bc9c9e484e16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:26.474675 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a20bd-ead5-4a15-a6ab-bc9c9e484e16 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:26.480127 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 460/933] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:34:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:26.485585 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b9d7d-67a8-4b9c-ba50-73597805d74a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:26.590709 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a20bd-ead5-4a15-a6ab-bc9c9e484e16 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:26.601786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b9d7d-67a8-4b9c-ba50-73597805d74a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:26.641439 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8843ac5-34c8-4452-b65a-187f01dcb65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:26.642278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8843ac5-34c8-4452-b65a-187f01dcb65c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:26.642464 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8843ac5-34c8-4452-b65a-187f01dcb65c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:26.642708 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8843ac5-34c8-4452-b65a-187f01dcb65c None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:26.643344 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8843ac5-34c8-4452-b65a-187f01dcb65c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:26.643644 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8843ac5-34c8-4452-b65a-187f01dcb65c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:26.645307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8843ac5-34c8-4452-b65a-187f01dcb65c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:26.651416 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 474/934] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 10:34:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:26.656289 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8843ac5-34c8-4452-b65a-187f01dcb65c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:26.685408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:26.733532 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a20bd-ead5-4a15-a6ab-bc9c9e484e16 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:26.765036 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8843ac5-34c8-4452-b65a-187f01dcb65c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:26.772841 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ba2d4-6a0d-41dc-bd21-eb6c21668336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:26.773470 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ba2d4-6a0d-41dc-bd21-eb6c21668336 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:26.773744 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ba2d4-6a0d-41dc-bd21-eb6c21668336 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:26.774013 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ba2d4-6a0d-41dc-bd21-eb6c21668336 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:26.774588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ba2d4-6a0d-41dc-bd21-eb6c21668336 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:26.775940 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ba2d4-6a0d-41dc-bd21-eb6c21668336 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:26.785218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-1e4ba2d4-6a0d-41dc-bd21-eb6c21668336 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 10:34:26.785218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:26.785218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:26.785218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:26.785218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:26.785218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:26.785218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:26.785218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:26.785218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 10:34:26.785218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:26.785218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:26.785218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:26.785218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:26.785218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:26.785218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:26.785218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:26.786149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:26.786149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:26.786149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:26.786149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:26.786149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:26.786149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:26.786149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:26.786149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:26.786149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:26.786149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:26.786149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:26.786149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:26.786149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:26.786149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:26.786149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:26.786149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:26.786149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:26.787053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:26.787053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:26.787053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:26.787053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:26.787053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:26.787053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:26.787053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:26.787053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:26.787053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:26.787053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:26.787053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:26.787053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:26.787053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 10:34:26.787053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:26.787053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 461/935] 10.222.0.20 () {56 vars in 1132 bytes} [Sun Sep 11 10:34:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:34:26.787835 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ba2d4-6a0d-41dc-bd21-eb6c21668336 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:26.807198 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79333950-31fb-4616-bfc1-d326ebcc8680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:26.808070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79333950-31fb-4616-bfc1-d326ebcc8680 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:26.808760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79333950-31fb-4616-bfc1-d326ebcc8680 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:26.809043 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79333950-31fb-4616-bfc1-d326ebcc8680 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:26.809726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79333950-31fb-4616-bfc1-d326ebcc8680 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:26.811501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79333950-31fb-4616-bfc1-d326ebcc8680 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:26.834088 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 475/936] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:34:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:34:26.835728 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79333950-31fb-4616-bfc1-d326ebcc8680 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:26.845379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:26.914477 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ba2d4-6a0d-41dc-bd21-eb6c21668336 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:26.963727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:26.977328 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420de1c-ce0c-4175-99d3-1d5eda4bbf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:26.978356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420de1c-ce0c-4175-99d3-1d5eda4bbf0f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:26.978725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420de1c-ce0c-4175-99d3-1d5eda4bbf0f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:26.979066 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420de1c-ce0c-4175-99d3-1d5eda4bbf0f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:26.979738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420de1c-ce0c-4175-99d3-1d5eda4bbf0f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:26.981950 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420de1c-ce0c-4175-99d3-1d5eda4bbf0f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:26.992998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79333950-31fb-4616-bfc1-d326ebcc8680 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:26.994554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-a420de1c-ce0c-4175-99d3-1d5eda4bbf0f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 10:34:26.994554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:26.994554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:26.994554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:26.994554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:26.994554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:26.994554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:26.994554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:26.994554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 10:34:26.994554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:26.994554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:26.994554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:26.994554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:26.994554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:26.994554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:26.994554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:26.994554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:26.995538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:26.995538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:26.995538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:26.995538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:26.995538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:26.995538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:26.995538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:26.995538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:26.995538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:26.995538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:26.995538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:26.995538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:26.995538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:26.995538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:26.995538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:26.995538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:26.996374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:26.996374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:26.996374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:26.996374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:26.996374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:26.996374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:26.996374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:26.996374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:26.996374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:26.996374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:26.996374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:26.996374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:26.996374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 10:34:26.996374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:27.001101 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 462/937] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 10:34:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:27.002099 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420de1c-ce0c-4175-99d3-1d5eda4bbf0f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:27.040394 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e4dd8-991a-4a64-b57c-2b84cdfb83aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:27.041396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e4dd8-991a-4a64-b57c-2b84cdfb83aa None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:27.042007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e4dd8-991a-4a64-b57c-2b84cdfb83aa None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:27.042452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e4dd8-991a-4a64-b57c-2b84cdfb83aa None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:27.043816 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e4dd8-991a-4a64-b57c-2b84cdfb83aa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:27.044305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e4dd8-991a-4a64-b57c-2b84cdfb83aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:27.046103 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e4dd8-991a-4a64-b57c-2b84cdfb83aa None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:27.051818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 476/938] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 10:34:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:27.059871 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e4dd8-991a-4a64-b57c-2b84cdfb83aa None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:27.137155 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420de1c-ce0c-4175-99d3-1d5eda4bbf0f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:27.157104 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:27.183359 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211112c-3414-46df-9dea-8fd55ee191e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:27.184124 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211112c-3414-46df-9dea-8fd55ee191e3 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:27.184402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211112c-3414-46df-9dea-8fd55ee191e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:27.184927 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211112c-3414-46df-9dea-8fd55ee191e3 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:27.185791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211112c-3414-46df-9dea-8fd55ee191e3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:27.187123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211112c-3414-46df-9dea-8fd55ee191e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:27.188135 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211112c-3414-46df-9dea-8fd55ee191e3 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:27.190179 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e4dd8-991a-4a64-b57c-2b84cdfb83aa None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:27.196924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 463/939] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Sep 11 10:34:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:27.205623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211112c-3414-46df-9dea-8fd55ee191e3 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:27.234300 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de6b29-409f-4ff5-bff2-78bfcd8d53c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:27.235401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de6b29-409f-4ff5-bff2-78bfcd8d53c1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:27.235823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de6b29-409f-4ff5-bff2-78bfcd8d53c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:27.236449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de6b29-409f-4ff5-bff2-78bfcd8d53c1 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:27.237678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de6b29-409f-4ff5-bff2-78bfcd8d53c1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:27.238411 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de6b29-409f-4ff5-bff2-78bfcd8d53c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:27.240617 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de6b29-409f-4ff5-bff2-78bfcd8d53c1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:27.247459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 477/940] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 10:34:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:27.253672 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de6b29-409f-4ff5-bff2-78bfcd8d53c1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:27.267275 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:27.337262 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211112c-3414-46df-9dea-8fd55ee191e3 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:27.368369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de6b29-409f-4ff5-bff2-78bfcd8d53c1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:27.380187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f6d48-8529-48bf-b9fb-4fd246e16136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:27.381139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f6d48-8529-48bf-b9fb-4fd246e16136 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:27.381625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f6d48-8529-48bf-b9fb-4fd246e16136 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:27.382132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f6d48-8529-48bf-b9fb-4fd246e16136 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:27.382967 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f6d48-8529-48bf-b9fb-4fd246e16136 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:27.383472 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f6d48-8529-48bf-b9fb-4fd246e16136 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:27.385187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f6d48-8529-48bf-b9fb-4fd246e16136 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:27.396328 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 464/941] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Sep 11 10:34:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:27.397484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f6d48-8529-48bf-b9fb-4fd246e16136 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:27.409107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1114f61-d29c-4fbd-a702-518f8d7689f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:27.409714 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1114f61-d29c-4fbd-a702-518f8d7689f1 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:27.409991 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1114f61-d29c-4fbd-a702-518f8d7689f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:27.410260 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1114f61-d29c-4fbd-a702-518f8d7689f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:27.411388 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1114f61-d29c-4fbd-a702-518f8d7689f1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:27.413158 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1114f61-d29c-4fbd-a702-518f8d7689f1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:27.446616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 478/942] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:34:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:34:27.450083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:27.525288 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f6d48-8529-48bf-b9fb-4fd246e16136 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:27.574488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69708fb2-d3af-4865-b684-c6b18c37ab91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:27.575107 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69708fb2-d3af-4865-b684-c6b18c37ab91 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:27.575441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69708fb2-d3af-4865-b684-c6b18c37ab91 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:27.575718 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69708fb2-d3af-4865-b684-c6b18c37ab91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:27.576432 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69708fb2-d3af-4865-b684-c6b18c37ab91 None admin] RBAC: Adding query filter params (interface=public, service_id=7707048eafbd450db5e7c2e724697de7, region_id=RegionOne) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:27.576780 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69708fb2-d3af-4865-b684-c6b18c37ab91 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:27.578969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69708fb2-d3af-4865-b684-c6b18c37ab91 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:27.585010 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 465/943] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Sep 11 10:34:27 2022] GET /identity/v3/endpoints?service_id=7707048eafbd450db5e7c2e724697de7&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:27.590748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1114f61-d29c-4fbd-a702-518f8d7689f1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:27.663273 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:27.699250 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1114f61-d29c-4fbd-a702-518f8d7689f1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:27.733835 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00161662-7f2b-44f1-a11d-609aac99e8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:27.734567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00161662-7f2b-44f1-a11d-609aac99e8a8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:27.735325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00161662-7f2b-44f1-a11d-609aac99e8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:27.735598 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00161662-7f2b-44f1-a11d-609aac99e8a8 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:27.736203 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00161662-7f2b-44f1-a11d-609aac99e8a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:27.737599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00161662-7f2b-44f1-a11d-609aac99e8a8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:27.743834 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 479/944] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Sep 11 10:34:27 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:34:28.461528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55043a1d-dd33-424b-a686-92e5b493392f None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:28.461872 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55043a1d-dd33-424b-a686-92e5b493392f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:28.462201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55043a1d-dd33-424b-a686-92e5b493392f None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:28.463828 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 466/945] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:28.469610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b7116-84c9-46be-ae29-6dfc4086e7db None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:28.470055 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b7116-84c9-46be-ae29-6dfc4086e7db None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:28.470225 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b7116-84c9-46be-ae29-6dfc4086e7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:28.489434 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-dd6b7116-84c9-46be-ae29-6dfc4086e7db None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:28.490642 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-dd6b7116-84c9-46be-ae29-6dfc4086e7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:28.564714 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 480/946] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:28.831465 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55043a1d-dd33-424b-a686-92e5b493392f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:28.936507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:28.942530 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55043a1d-dd33-424b-a686-92e5b493392f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:28.978860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c916b-fdc7-4d56-b829-15d07eea6319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:28.979697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c916b-fdc7-4d56-b829-15d07eea6319 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:28.980138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c916b-fdc7-4d56-b829-15d07eea6319 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:28.980576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c916b-fdc7-4d56-b829-15d07eea6319 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:28.993458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c916b-fdc7-4d56-b829-15d07eea6319 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:34:28.998865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-336c916b-fdc7-4d56-b829-15d07eea6319 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 10:34:28.998865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:28.998865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:28.998865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:28.998865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:28.998865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:28.998865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:28.998865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:28.998865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:28.998865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:28.998865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:28.998865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:28.998865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:34:28.998865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:34:28.998865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:34:28.998865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:34:29.000142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:34:29.000142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:34:29.000142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:34:29.000142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:34:29.000142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:29.000142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:29.000142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:29.000142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:29.000142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:29.000142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:29.000142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:29.000142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:29.000142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:29.000142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:29.000142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:29.000142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:29.001233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:29.001233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:29.001233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:29.001233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:29.001233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:34:29.001233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:34:29.001233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:34:29.001233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:34:29.001233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:34:29.001233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:34:29.001233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 10:34:29.001233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:29.003471 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 467/947] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Sep 11 10:34:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:29.010010 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b7116-84c9-46be-ae29-6dfc4086e7db None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:29.073010 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:29.114284 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b7116-84c9-46be-ae29-6dfc4086e7db None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:29.117461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7e24b-c0e0-4300-9e8e-3a8c5dcb87c6 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:29.117753 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7e24b-c0e0-4300-9e8e-3a8c5dcb87c6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:29.118033 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7e24b-c0e0-4300-9e8e-3a8c5dcb87c6 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:29.120086 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 468/948] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:29.125924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62a446-8105-4743-91fe-3d4fe547dab4 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:29.126205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62a446-8105-4743-91fe-3d4fe547dab4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:29.126485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62a446-8105-4743-91fe-3d4fe547dab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:29.150497 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa305e-e273-46d4-8fd7-2af6d182dad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:29.151116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa305e-e273-46d4-8fd7-2af6d182dad6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:29.151395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa305e-e273-46d4-8fd7-2af6d182dad6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:29.151667 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa305e-e273-46d4-8fd7-2af6d182dad6 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:29.152333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa305e-e273-46d4-8fd7-2af6d182dad6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:29.152683 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa305e-e273-46d4-8fd7-2af6d182dad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:29.153489 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-8a62a446-8105-4743-91fe-3d4fe547dab4 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:29.154043 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa305e-e273-46d4-8fd7-2af6d182dad6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:29.155122 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8a62a446-8105-4743-91fe-3d4fe547dab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:29.169014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 481/949] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Sep 11 10:34:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:29.170319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa305e-e273-46d4-8fd7-2af6d182dad6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:29.259053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 469/950] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 10:34:29.281872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa305e-e273-46d4-8fd7-2af6d182dad6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:29.308578 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:29.321688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea51e2-da7a-4398-afe6-42b0b93c3266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:29.322325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea51e2-da7a-4398-afe6-42b0b93c3266 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:29.322608 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea51e2-da7a-4398-afe6-42b0b93c3266 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:29.322881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea51e2-da7a-4398-afe6-42b0b93c3266 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:29.333736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea51e2-da7a-4398-afe6-42b0b93c3266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:29.335175 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea51e2-da7a-4398-afe6-42b0b93c3266 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:29.350056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-f3ea51e2-da7a-4398-afe6-42b0b93c3266 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:29.350056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:29.350056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:29.350056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:29.350056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:29.350056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:29.350056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:29.350056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:29.350056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:29.350056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:29.350056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:29.350056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:29.350056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:29.350056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:29.350056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:29.350056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:29.351072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:29.351072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:29.351072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:29.351072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:29.351072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:29.351072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:29.351072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:29.351072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:29.351072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:29.351072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:29.351072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:29.351072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:29.351072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:29.351072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:29.351072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:29.351072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:29.351072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:29.352242 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:29.352242 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:29.352242 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:29.352242 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 482/951] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:29.361928 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62a446-8105-4743-91fe-3d4fe547dab4 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:29.458618 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:29.473192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62a446-8105-4743-91fe-3d4fe547dab4 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:29.509436 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a641032-bbff-445c-a29a-e6061dae5238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:29.510245 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a641032-bbff-445c-a29a-e6061dae5238 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:29.510526 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a641032-bbff-445c-a29a-e6061dae5238 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:29.510798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a641032-bbff-445c-a29a-e6061dae5238 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:29.511440 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a641032-bbff-445c-a29a-e6061dae5238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:29.511738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a641032-bbff-445c-a29a-e6061dae5238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:29.513145 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a641032-bbff-445c-a29a-e6061dae5238 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:29.525951 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 470/952] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:29.531746 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea51e2-da7a-4398-afe6-42b0b93c3266 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:29.565795 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a641032-bbff-445c-a29a-e6061dae5238 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:29.653493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea51e2-da7a-4398-afe6-42b0b93c3266 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:29.690892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b599e4c-0611-450c-abea-7b3e1e9df160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:29.691531 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b599e4c-0611-450c-abea-7b3e1e9df160 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:29.691812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b599e4c-0611-450c-abea-7b3e1e9df160 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:29.692085 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b599e4c-0611-450c-abea-7b3e1e9df160 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:29.700083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b599e4c-0611-450c-abea-7b3e1e9df160 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:29.701553 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b599e4c-0611-450c-abea-7b3e1e9df160 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:29.704105 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a641032-bbff-445c-a29a-e6061dae5238 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:29.712815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-1b599e4c-0611-450c-abea-7b3e1e9df160 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 10:34:29.712815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:29.712815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:29.712815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:29.712815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:29.712815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:29.712815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:29.712815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:29.712815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:29.712815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:29.712815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:29.712815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:29.712815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:34:29.712815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:34:29.712815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:34:29.712815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:34:29.713790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:29.713790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:29.713790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:34:29.713790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:29.713790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:34:29.713790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:29.713790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:29.713790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:29.713790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:29.713790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:29.713790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:29.713790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:29.713790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:29.713790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:29.713790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:29.713790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:29.713790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:29.713790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:29.714755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:29.714755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:29.714755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:34:29.714755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:34:29.714755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:34:29.714755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:34:29.714755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:34:29.714755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:34:29.714755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 10:34:29.714755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:29.720882 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 483/953] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Sep 11 10:34:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:29.722306 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cd0ce-0c63-487b-a0fa-6b189a2bdf99 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:29.722647 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cd0ce-0c63-487b-a0fa-6b189a2bdf99 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:29.722919 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cd0ce-0c63-487b-a0fa-6b189a2bdf99 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:29.724111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 484/954] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:29.725864 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cd0ce-0c63-487b-a0fa-6b189a2bdf99 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:29.744746 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fdfb6-4347-49c2-bdf5-02959791dd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:29.745828 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fdfb6-4347-49c2-bdf5-02959791dd53 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:29.746324 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fdfb6-4347-49c2-bdf5-02959791dd53 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:29.746788 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fdfb6-4347-49c2-bdf5-02959791dd53 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:29.747717 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fdfb6-4347-49c2-bdf5-02959791dd53 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:29.749453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fdfb6-4347-49c2-bdf5-02959791dd53 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:29.753136 dv-cinder-856460-3-smb devstack@keystone.service[88076]: WARNING keystone.server.flask.common [None req-945fdfb6-4347-49c2-bdf5-02959791dd53 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 11 10:34:29.761444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:29.772912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.sql.core [None req-945fdfb6-4347-49c2-bdf5-02959791dd53 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 10:34:29.772912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 11 10:34:29.772912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [parameters: {'id': '1cd1d0417858438799b182c3e216c14e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 11 10:34:29.772912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88076) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 10:34:29.789495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-945fdfb6-4347-49c2-bdf5-02959791dd53 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1cd1d0417858438799b182c3e216c14e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1cd1d0417858438799b182c3e216c14e. Sep 11 10:34:29.789495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:29.789495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 10:34:29.789495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 10:34:29.789495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 10:34:29.789495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 10:34:29.789495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 10:34:29.789495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 10:34:29.789495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 10:34:29.789495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application conn.query(q) Sep 11 10:34:29.789495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 10:34:29.789495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 10:34:29.789495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 10:34:29.790309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application result.read() Sep 11 10:34:29.790309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 10:34:29.790309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 10:34:29.790309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 10:34:29.790309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 10:34:29.790309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 10:34:29.790309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 10:34:29.790309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 10:34:29.790309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 10:34:29.790309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 10:34:29.790309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:29.790309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 10:34:29.790309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:29.790309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:29.790309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 10:34:29.790309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 10:34:29.790309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 11 10:34:29.790309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 11 10:34:29.791277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 10:34:29.791277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application next(self.gen) Sep 11 10:34:29.791277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 10:34:29.791277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application yield resource Sep 11 10:34:29.791277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 10:34:29.791277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application next(self.gen) Sep 11 10:34:29.791277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 10:34:29.791277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 10:34:29.791277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 10:34:29.791277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 10:34:29.791277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 10:34:29.791277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise self.value Sep 11 10:34:29.791277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 10:34:29.791277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 10:34:29.791277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 10:34:29.791277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application session.commit() Sep 11 10:34:29.791277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 10:34:29.792180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 10:34:29.792180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 10:34:29.792180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 10:34:29.792180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 10:34:29.792180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self.session.flush() Sep 11 10:34:29.792180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 10:34:29.792180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 10:34:29.792180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 10:34:29.792180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 10:34:29.792180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 10:34:29.792180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application compat.raise_( Sep 11 10:34:29.792180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 10:34:29.792180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception Sep 11 10:34:29.792180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 10:34:29.792180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 10:34:29.792180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 10:34:29.792180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 10:34:29.793092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 10:34:29.793092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 10:34:29.793092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 10:34:29.793092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 10:34:29.793092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 11 10:34:29.793092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 11 10:34:29.793092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 10:34:29.793092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 10:34:29.793092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 10:34:29.793092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 10:34:29.793092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 10:34:29.793092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 10:34:29.793092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 10:34:29.793092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 10:34:29.793092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 10:34:29.793877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 10:34:29.793877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 10:34:29.793877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception Sep 11 10:34:29.793877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 10:34:29.793877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 10:34:29.793877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 10:34:29.793877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 10:34:29.793877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 10:34:29.793877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 10:34:29.793877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 10:34:29.793877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application conn.query(q) Sep 11 10:34:29.793877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 10:34:29.793877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 10:34:29.793877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 10:34:29.793877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application result.read() Sep 11 10:34:29.793877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 10:34:29.793877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 10:34:29.794736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 10:34:29.794736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 10:34:29.794736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 10:34:29.794736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 10:34:29.794736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 10:34:29.794736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 10:34:29.794736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 10:34:29.794736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 11 10:34:29.794736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [parameters: {'id': '1cd1d0417858438799b182c3e216c14e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 11 10:34:29.794736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 10:34:29.794736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:29.794736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:29.794736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:29.794736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:29.794736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 11 10:34:29.795538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 11 10:34:29.795538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 10:34:29.795538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 10:34:29.795538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 11 10:34:29.795538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:29.795538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:29.795538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:29.795538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:29.795538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:29.795538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:29.795538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:29.795538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:29.795538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:29.795538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:29.795538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:29.795538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:29.795538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:29.796453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:29.796453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 11 10:34:29.796453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 11 10:34:29.796453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:29.796453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:29.796453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 11 10:34:29.796453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 11 10:34:29.796453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1cd1d0417858438799b182c3e216c14e. Sep 11 10:34:29.796453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:29.799282 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 471/955] 10.222.0.20 () {60 vars in 1140 bytes} [Sun Sep 11 10:34:29 2022] POST /identity/v3/projects => generated 262 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:34:29.800831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f612e3-13bf-4f7f-b263-78c0fc459d88 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:29.801113 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f612e3-13bf-4f7f-b263-78c0fc459d88 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:29.801388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f612e3-13bf-4f7f-b263-78c0fc459d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:29.810916 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:29.825331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-c7f612e3-13bf-4f7f-b263-78c0fc459d88 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:29.826932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c7f612e3-13bf-4f7f-b263-78c0fc459d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:29.839605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cd0ce-0c63-487b-a0fa-6b189a2bdf99 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:29.876157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b3063-be23-4b92-a6db-afbbdbe9b856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:29.876791 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b3063-be23-4b92-a6db-afbbdbe9b856 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:29.877075 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b3063-be23-4b92-a6db-afbbdbe9b856 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:29.877345 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b3063-be23-4b92-a6db-afbbdbe9b856 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:29.878070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b3063-be23-4b92-a6db-afbbdbe9b856 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:29.878372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b3063-be23-4b92-a6db-afbbdbe9b856 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:29.879999 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b3063-be23-4b92-a6db-afbbdbe9b856 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:29.899363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 472/956] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:29.900042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f612e3-13bf-4f7f-b263-78c0fc459d88 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:29.914750 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 485/957] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Sep 11 10:34:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:29.917341 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b3063-be23-4b92-a6db-afbbdbe9b856 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:30.027687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f612e3-13bf-4f7f-b263-78c0fc459d88 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:30.033168 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:30.044910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b3063-be23-4b92-a6db-afbbdbe9b856 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:30.063413 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06afc2f-7d51-4c60-84d0-026614bb5c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:30.064039 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06afc2f-7d51-4c60-84d0-026614bb5c9b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:30.064314 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06afc2f-7d51-4c60-84d0-026614bb5c9b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:30.064602 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06afc2f-7d51-4c60-84d0-026614bb5c9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:30.066452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:30.071793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06afc2f-7d51-4c60-84d0-026614bb5c9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:30.073633 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06afc2f-7d51-4c60-84d0-026614bb5c9b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:30.083851 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3b265-39ca-4c04-bbd6-fbeb5f18efb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:30.084450 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3b265-39ca-4c04-bbd6-fbeb5f18efb4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:30.084753 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3b265-39ca-4c04-bbd6-fbeb5f18efb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:30.085029 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3b265-39ca-4c04-bbd6-fbeb5f18efb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:30.085555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-f06afc2f-7d51-4c60-84d0-026614bb5c9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:30.085555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:30.085555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:30.085555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:30.085555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:30.085555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:30.085555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:30.085555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:30.085555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:30.085555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:30.085555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:30.085555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:30.085555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:34:30.085555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:34:30.085555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:34:30.086419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:34:30.086419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:30.086419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:30.086419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:30.086419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:30.086419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:30.086419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:30.086419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:30.086419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:30.086419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:30.086419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:30.086419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:30.086419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:30.086419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:30.086419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:30.086419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:30.086419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:30.088052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:34:30.088052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:34:30.088052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:34:30.088052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:34:30.088052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:34:30.088052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:34:30.088052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:30.088052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:30.088052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 473/958] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:30.088052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef36efc-049f-4634-9647-6b0cd1159a24 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:30.088651 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef36efc-049f-4634-9647-6b0cd1159a24 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:30.088651 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef36efc-049f-4634-9647-6b0cd1159a24 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:30.092477 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 474/959] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:30.093205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef36efc-049f-4634-9647-6b0cd1159a24 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:30.164283 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3b265-39ca-4c04-bbd6-fbeb5f18efb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:30.165746 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3b265-39ca-4c04-bbd6-fbeb5f18efb4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:30.194709 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef36efc-049f-4634-9647-6b0cd1159a24 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:30.232028 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f92d0-5d45-4c4f-9c3e-7497fc1c1803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:30.232663 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f92d0-5d45-4c4f-9c3e-7497fc1c1803 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:30.232950 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f92d0-5d45-4c4f-9c3e-7497fc1c1803 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:30.233226 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f92d0-5d45-4c4f-9c3e-7497fc1c1803 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:30.233901 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f92d0-5d45-4c4f-9c3e-7497fc1c1803 None admin] RBAC: Adding query filter params (name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:30.234230 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f92d0-5d45-4c4f-9c3e-7497fc1c1803 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:30.236192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f92d0-5d45-4c4f-9c3e-7497fc1c1803 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:30.253132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 475/960] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 10:34:30 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:30.254400 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ae5fd-632c-47c9-841d-234fc6ac6ef8 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:30.254687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ae5fd-632c-47c9-841d-234fc6ac6ef8 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:30.254950 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ae5fd-632c-47c9-841d-234fc6ac6ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:30.259922 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:30.272587 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 486/961] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:34:29 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 10:34:30.273418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3b265-39ca-4c04-bbd6-fbeb5f18efb4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:30.280430 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-f05ae5fd-632c-47c9-841d-234fc6ac6ef8 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:30.282193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f05ae5fd-632c-47c9-841d-234fc6ac6ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:30.337541 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:30.357747 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 476/962] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:30.365162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ae5fd-632c-47c9-841d-234fc6ac6ef8 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:30.395138 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3b265-39ca-4c04-bbd6-fbeb5f18efb4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:30.446141 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11eb96c-3440-46f0-843d-6877fee1c72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:30.446786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11eb96c-3440-46f0-843d-6877fee1c72e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:30.447054 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11eb96c-3440-46f0-843d-6877fee1c72e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:30.447324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11eb96c-3440-46f0-843d-6877fee1c72e None admin] PATH_INFO: `/v3/services/compute` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:30.447908 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11eb96c-3440-46f0-843d-6877fee1c72e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:30.450282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11eb96c-3440-46f0-843d-6877fee1c72e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:30.462094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-e11eb96c-3440-46f0-843d-6877fee1c72e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 10:34:30.462094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:30.462094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:30.462094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:30.462094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:30.462094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:30.462094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:30.462094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:30.462094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 10:34:30.462094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:30.462094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:30.462094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:30.462094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:30.462094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:30.462094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:30.462094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:30.462094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:30.463181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:30.463181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:30.463181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:30.463181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:30.463181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:30.463181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:30.463181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:30.463181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:30.463181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:30.463181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:30.463181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:30.463181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:30.463181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:30.463181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:30.463181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:30.463181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:30.464034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:30.464034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:30.464034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:30.464034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:30.464034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:30.464034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:30.464034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:30.464034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:30.464034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:30.464034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:30.464034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:30.464034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:30.464034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 10:34:30.464034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:30.464823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 487/963] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:30.470014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11eb96c-3440-46f0-843d-6877fee1c72e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:30.503103 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ae5fd-632c-47c9-841d-234fc6ac6ef8 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:30.551982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66041bd5-0e82-41c1-b40c-a484ce5b664d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:30.552950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:30.554757 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66041bd5-0e82-41c1-b40c-a484ce5b664d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:30.555609 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66041bd5-0e82-41c1-b40c-a484ce5b664d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:30.556082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66041bd5-0e82-41c1-b40c-a484ce5b664d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:30.572823 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66041bd5-0e82-41c1-b40c-a484ce5b664d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:30.574665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66041bd5-0e82-41c1-b40c-a484ce5b664d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:30.597676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-66041bd5-0e82-41c1-b40c-a484ce5b664d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:30.597676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:30.597676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:30.597676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:30.597676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:30.597676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:30.597676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:30.597676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:30.597676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:30.597676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:30.597676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:30.597676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:30.597676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:30.597676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:30.597676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:30.597676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:30.598673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:30.598673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:30.598673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:30.598673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:30.598673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:30.598673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:30.598673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:30.598673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:30.598673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:30.598673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:30.598673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:30.598673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:30.598673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:30.598673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:30.598673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:30.598673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:30.598673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:30.599543 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:30.599543 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:30.599543 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:30.602127 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 477/964] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:30.603485 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11eb96c-3440-46f0-843d-6877fee1c72e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:30.612731 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66041bd5-0e82-41c1-b40c-a484ce5b664d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:30.643121 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac56ed8-8a6f-41ee-b0c8-c28e3b751468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:30.643733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac56ed8-8a6f-41ee-b0c8-c28e3b751468 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:30.644015 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac56ed8-8a6f-41ee-b0c8-c28e3b751468 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:30.644303 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac56ed8-8a6f-41ee-b0c8-c28e3b751468 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:30.644957 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac56ed8-8a6f-41ee-b0c8-c28e3b751468 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:30.645260 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac56ed8-8a6f-41ee-b0c8-c28e3b751468 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:30.646629 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac56ed8-8a6f-41ee-b0c8-c28e3b751468 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:30.648354 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:30.651500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 488/965] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 10:34:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:30.652439 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac56ed8-8a6f-41ee-b0c8-c28e3b751468 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:30.731173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66041bd5-0e82-41c1-b40c-a484ce5b664d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:30.761626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac56ed8-8a6f-41ee-b0c8-c28e3b751468 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:30.769146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a98d5-2db7-4a32-9940-e92482792cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:30.770008 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a98d5-2db7-4a32-9940-e92482792cac None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:30.770603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a98d5-2db7-4a32-9940-e92482792cac None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:30.771070 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a98d5-2db7-4a32-9940-e92482792cac None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:30.772032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a98d5-2db7-4a32-9940-e92482792cac None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:30.772558 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a98d5-2db7-4a32-9940-e92482792cac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:30.774105 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a98d5-2db7-4a32-9940-e92482792cac None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:30.781638 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:30.793520 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 478/966] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:30.793520 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a98d5-2db7-4a32-9940-e92482792cac None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:30.803614 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23b5c3-80e0-4262-a858-179f61223530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:30.804194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23b5c3-80e0-4262-a858-179f61223530 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:30.804525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23b5c3-80e0-4262-a858-179f61223530 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:30.804834 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23b5c3-80e0-4262-a858-179f61223530 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:30.805707 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23b5c3-80e0-4262-a858-179f61223530 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:30.807327 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23b5c3-80e0-4262-a858-179f61223530 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:30.819214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-3d23b5c3-80e0-4262-a858-179f61223530 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 10:34:30.819214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:30.819214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:30.819214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:30.819214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:30.819214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:30.819214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:30.819214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:30.819214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 10:34:30.819214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:30.819214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:30.819214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:30.819214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:30.819214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:30.819214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:30.819214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:30.819214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:30.820252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:30.820252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:30.820252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:30.820252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:30.820252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:30.820252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:30.820252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:30.820252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:30.820252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:30.820252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:30.820252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:30.820252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:30.820252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:30.820252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:30.820252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:30.820252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:30.825313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:30.825313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:30.825313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:30.825313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:30.825313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:30.825313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:30.825313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:30.825313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:30.825313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:30.825313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:30.825313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:30.825313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:30.825313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 10:34:30.825313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:30.825313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 489/967] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 10:34:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:30.826207 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23b5c3-80e0-4262-a858-179f61223530 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:30.897627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:30.905032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a98d5-2db7-4a32-9940-e92482792cac None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:30.939023 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586da126-a891-4950-bda6-dfad93f748a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:30.939229 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23b5c3-80e0-4262-a858-179f61223530 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:30.939842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586da126-a891-4950-bda6-dfad93f748a0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:30.940128 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586da126-a891-4950-bda6-dfad93f748a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:30.940491 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586da126-a891-4950-bda6-dfad93f748a0 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:30.941075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586da126-a891-4950-bda6-dfad93f748a0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:30.941379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586da126-a891-4950-bda6-dfad93f748a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:30.942740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586da126-a891-4950-bda6-dfad93f748a0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:30.956768 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 479/968] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 10:34:30 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:30.958488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586da126-a891-4950-bda6-dfad93f748a0 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:30.983262 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673a92b-55cf-4e33-9203-deabd6b79333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:30.984422 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673a92b-55cf-4e33-9203-deabd6b79333 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:30.984943 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673a92b-55cf-4e33-9203-deabd6b79333 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:30.985468 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673a92b-55cf-4e33-9203-deabd6b79333 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:30.997181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673a92b-55cf-4e33-9203-deabd6b79333 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:30.999254 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673a92b-55cf-4e33-9203-deabd6b79333 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:31.017338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-f673a92b-55cf-4e33-9203-deabd6b79333 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:31.017338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:31.017338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:31.017338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:31.017338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:31.017338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:31.017338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:31.017338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:31.017338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:31.017338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:31.017338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:31.017338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:31.017338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:34:31.017338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:34:31.017338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:34:31.018297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:34:31.018297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:31.018297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:31.018297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:31.018297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:31.018297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:31.018297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:31.018297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:31.018297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:31.018297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:31.018297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:31.018297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:31.018297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:31.018297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:31.018297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:31.018297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:31.018297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:31.019183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:34:31.019183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:34:31.019183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:34:31.019183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:34:31.019183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:34:31.019183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:34:31.019183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:31.019183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:31.022001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 490/969] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:31.027547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673a92b-55cf-4e33-9203-deabd6b79333 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:31.078682 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586da126-a891-4950-bda6-dfad93f748a0 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:31.096749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:31.120327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e31ca1-438d-49fb-abcb-fd6264eafb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:31.121147 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e31ca1-438d-49fb-abcb-fd6264eafb85 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:31.121782 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e31ca1-438d-49fb-abcb-fd6264eafb85 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:31.122174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e31ca1-438d-49fb-abcb-fd6264eafb85 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:31.122933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e31ca1-438d-49fb-abcb-fd6264eafb85 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:31.123334 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e31ca1-438d-49fb-abcb-fd6264eafb85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:31.124881 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e31ca1-438d-49fb-abcb-fd6264eafb85 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:31.131003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 480/970] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Sep 11 10:34:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:31.138229 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e31ca1-438d-49fb-abcb-fd6264eafb85 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:31.166202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:31.171348 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673a92b-55cf-4e33-9203-deabd6b79333 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:31.211166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc241d-ebe3-4a66-810f-3c112075810d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:31.211944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc241d-ebe3-4a66-810f-3c112075810d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:31.212230 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc241d-ebe3-4a66-810f-3c112075810d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:31.212504 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc241d-ebe3-4a66-810f-3c112075810d None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:31.213584 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc241d-ebe3-4a66-810f-3c112075810d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:31.213961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc241d-ebe3-4a66-810f-3c112075810d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:31.215739 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc241d-ebe3-4a66-810f-3c112075810d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:31.230341 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 491/971] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:34:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:31.237088 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc241d-ebe3-4a66-810f-3c112075810d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:31.276977 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e31ca1-438d-49fb-abcb-fd6264eafb85 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:31.313863 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529c4f9-fedd-4203-9841-1c0a64e8ab73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:31.314463 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529c4f9-fedd-4203-9841-1c0a64e8ab73 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:31.314744 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529c4f9-fedd-4203-9841-1c0a64e8ab73 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:31.315018 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529c4f9-fedd-4203-9841-1c0a64e8ab73 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:31.315655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529c4f9-fedd-4203-9841-1c0a64e8ab73 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:31.315961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529c4f9-fedd-4203-9841-1c0a64e8ab73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:31.317360 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529c4f9-fedd-4203-9841-1c0a64e8ab73 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:31.328481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 481/972] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Sep 11 10:34:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:31.331075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529c4f9-fedd-4203-9841-1c0a64e8ab73 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:31.363183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc241d-ebe3-4a66-810f-3c112075810d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:31.366908 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:31.402157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287a679-48b9-409f-89d8-6f75a4f892c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:31.402928 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287a679-48b9-409f-89d8-6f75a4f892c3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:31.403356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287a679-48b9-409f-89d8-6f75a4f892c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:31.403733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287a679-48b9-409f-89d8-6f75a4f892c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:31.404575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287a679-48b9-409f-89d8-6f75a4f892c3 None admin] RBAC: Adding query filter params (role.id=8896f3c145b84c85a4ddf8a6b17422b2, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=bdc800f1d4174b5cba4f6f496207ec95) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:31.405039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287a679-48b9-409f-89d8-6f75a4f892c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:31.406640 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287a679-48b9-409f-89d8-6f75a4f892c3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:31.418031 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 492/973] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:34:31 2022] GET /identity/v3/role_assignments?user.id=bdc800f1d4174b5cba4f6f496207ec95&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=8896f3c145b84c85a4ddf8a6b17422b2 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:31.447414 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:31.462289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529c4f9-fedd-4203-9841-1c0a64e8ab73 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:31.502603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ff771-9a13-43ff-b6f7-b4f88810de89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:31.503513 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ff771-9a13-43ff-b6f7-b4f88810de89 None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:31.503935 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ff771-9a13-43ff-b6f7-b4f88810de89 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:31.504348 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ff771-9a13-43ff-b6f7-b4f88810de89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:31.505210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ff771-9a13-43ff-b6f7-b4f88810de89 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:31.506747 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ff771-9a13-43ff-b6f7-b4f88810de89 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:31.539109 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 482/974] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:34:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:34:32.531159 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050b69a-359f-452a-845a-d2eeaa320bef None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:32.531688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050b69a-359f-452a-845a-d2eeaa320bef None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:32.531688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050b69a-359f-452a-845a-d2eeaa320bef None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:32.533307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 493/975] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:32.538562 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19828b-c49f-4847-b4cf-23cda8ea09e6 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:32.538941 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19828b-c49f-4847-b4cf-23cda8ea09e6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:32.539107 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19828b-c49f-4847-b4cf-23cda8ea09e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:32.558377 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-ac19828b-c49f-4847-b4cf-23cda8ea09e6 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:32.559551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ac19828b-c49f-4847-b4cf-23cda8ea09e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:32.633420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 483/976] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 10:34:32.904164 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050b69a-359f-452a-845a-d2eeaa320bef None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:33.006558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050b69a-359f-452a-845a-d2eeaa320bef None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:33.041209 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780880fb-acc9-4f25-bab8-689f77baea3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:33.042221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780880fb-acc9-4f25-bab8-689f77baea3c None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:33.042696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780880fb-acc9-4f25-bab8-689f77baea3c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:33.043181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780880fb-acc9-4f25-bab8-689f77baea3c None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:33.044017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780880fb-acc9-4f25-bab8-689f77baea3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:33.045649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780880fb-acc9-4f25-bab8-689f77baea3c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:33.048458 dv-cinder-856460-3-smb devstack@keystone.service[88077]: WARNING keystone.server.flask.common [None req-780880fb-acc9-4f25-bab8-689f77baea3c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 11 10:34:33.063407 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.sql.core [None req-780880fb-acc9-4f25-bab8-689f77baea3c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 10:34:33.063407 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 11 10:34:33.063407 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [parameters: {'user_id': '1e908c2009f948279722411baa1fbe03', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 11 10:34:33.063407 dv-cinder-856460-3-smb devstack@keystone.service[88077]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88077) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 10:34:33.071482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-780880fb-acc9-4f25-bab8-689f77baea3c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 11 10:34:33.071482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:33.071482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 10:34:33.071482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 10:34:33.071482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 10:34:33.071482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 10:34:33.071482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 10:34:33.071482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 10:34:33.071482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 10:34:33.071482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application conn.query(q) Sep 11 10:34:33.071482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 10:34:33.071482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 10:34:33.071482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 10:34:33.071482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result.read() Sep 11 10:34:33.071482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 10:34:33.072364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 10:34:33.072364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 10:34:33.072364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 10:34:33.072364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 10:34:33.072364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 10:34:33.072364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 10:34:33.072364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 10:34:33.072364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 10:34:33.072364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:33.072364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 10:34:33.072364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:33.072364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:33.072364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 10:34:33.072364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 10:34:33.072364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 11 10:34:33.072364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 11 10:34:33.072364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 10:34:33.072364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application next(self.gen) Sep 11 10:34:33.073346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 10:34:33.073346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application yield resource Sep 11 10:34:33.073346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 10:34:33.073346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application next(self.gen) Sep 11 10:34:33.073346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 10:34:33.073346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 10:34:33.073346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 10:34:33.073346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 10:34:33.073346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 10:34:33.073346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise self.value Sep 11 10:34:33.073346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 10:34:33.073346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 10:34:33.073346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 10:34:33.073346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application session.commit() Sep 11 10:34:33.073346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 10:34:33.073346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 10:34:33.073346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 10:34:33.074257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 10:34:33.074257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 10:34:33.074257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.session.flush() Sep 11 10:34:33.074257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 10:34:33.074257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 10:34:33.074257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 10:34:33.074257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 10:34:33.074257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 10:34:33.074257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application compat.raise_( Sep 11 10:34:33.074257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 10:34:33.074257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception Sep 11 10:34:33.074257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 10:34:33.074257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 10:34:33.074257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 10:34:33.074257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 10:34:33.074257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 10:34:33.074257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 10:34:33.075155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 10:34:33.075155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 10:34:33.075155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 11 10:34:33.075155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 11 10:34:33.075155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 10:34:33.075155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 10:34:33.075155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 10:34:33.075155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 10:34:33.075155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 10:34:33.075155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 10:34:33.075155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 10:34:33.075155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 10:34:33.075155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 10:34:33.075155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 10:34:33.075155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 10:34:33.075155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception Sep 11 10:34:33.075989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 10:34:33.075989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 10:34:33.075989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 10:34:33.075989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 10:34:33.075989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 10:34:33.075989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 10:34:33.075989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 10:34:33.075989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application conn.query(q) Sep 11 10:34:33.075989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 10:34:33.075989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 10:34:33.075989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 10:34:33.075989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result.read() Sep 11 10:34:33.075989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 10:34:33.075989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 10:34:33.075989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 10:34:33.075989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 10:34:33.078444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 10:34:33.078444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 10:34:33.078444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 10:34:33.078444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 10:34:33.078444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 10:34:33.078444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 11 10:34:33.078444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [parameters: {'user_id': '1e908c2009f948279722411baa1fbe03', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 11 10:34:33.078444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 10:34:33.078444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:33.078444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:33.078444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:33.078444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:33.078444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:33.078444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:33.078444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:33.080307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:33.080307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:33.080307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:33.080307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:33.080307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:33.080307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:33.080307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:33.080307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 11 10:34:33.080307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 11 10:34:33.080307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:33.080307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:33.080307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:34:33.080307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:33.080307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:34:33.080307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:33.080307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 11 10:34:33.080307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 11 10:34:33.082486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 11 10:34:33.082486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 11 10:34:33.082486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 10:34:33.082486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 10:34:33.082486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 11 10:34:33.082486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:33.085241 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 494/977] 10.222.0.20 () {60 vars in 1131 bytes} [Sun Sep 11 10:34:32 2022] POST /identity/v3/users => generated 160 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:33.096835 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19828b-c49f-4847-b4cf-23cda8ea09e6 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:33.178679 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:33.212483 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19828b-c49f-4847-b4cf-23cda8ea09e6 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:33.218377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c499060-462e-4af9-8f24-27fe53c82968 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:33.219183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c499060-462e-4af9-8f24-27fe53c82968 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:33.219452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c499060-462e-4af9-8f24-27fe53c82968 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:33.224287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 495/978] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:34:33.230020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ae47b-300d-4bfb-9b0d-2f6cb810f59f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:33.230413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ae47b-300d-4bfb-9b0d-2f6cb810f59f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:33.230778 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ae47b-300d-4bfb-9b0d-2f6cb810f59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:33.251438 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ec4ae47b-300d-4bfb-9b0d-2f6cb810f59f None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:33.253305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ec4ae47b-300d-4bfb-9b0d-2f6cb810f59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:33.253836 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa7d5b-c503-4564-9fb3-ae1226c7b4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:33.254635 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa7d5b-c503-4564-9fb3-ae1226c7b4af None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:33.255059 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa7d5b-c503-4564-9fb3-ae1226c7b4af None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:33.255493 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa7d5b-c503-4564-9fb3-ae1226c7b4af None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:33.263250 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa7d5b-c503-4564-9fb3-ae1226c7b4af None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:33.265002 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa7d5b-c503-4564-9fb3-ae1226c7b4af None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:33.279499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-01fa7d5b-c503-4564-9fb3-ae1226c7b4af None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 10:34:33.279499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:33.279499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:33.279499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:33.279499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:33.279499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:33.279499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:33.279499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:33.279499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:33.279499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:33.279499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:33.279499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:33.279499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:34:33.279499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:34:33.279499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:34:33.279499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:34:33.280481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:33.280481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:33.280481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:34:33.280481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:33.280481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:34:33.280481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:33.280481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:33.280481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:33.280481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:33.280481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:33.280481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:33.280481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:33.280481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:33.280481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:33.280481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:33.280481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:33.280481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:33.280481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:33.285499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:33.285499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:33.285499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:34:33.285499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:34:33.285499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:34:33.285499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:34:33.285499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:34:33.285499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:34:33.285499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 10:34:33.285499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:33.285499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 484/979] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:34:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:33.288162 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:33.288990 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa7d5b-c503-4564-9fb3-ae1226c7b4af None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:33.340686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 496/980] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:33.407410 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa7d5b-c503-4564-9fb3-ae1226c7b4af None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:33.438478 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:33.445382 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d7b66-4bc1-4031-89ec-db70555403d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:33.446248 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d7b66-4bc1-4031-89ec-db70555403d1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:33.446726 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d7b66-4bc1-4031-89ec-db70555403d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:33.447197 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d7b66-4bc1-4031-89ec-db70555403d1 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:33.448108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d7b66-4bc1-4031-89ec-db70555403d1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:33.448635 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d7b66-4bc1-4031-89ec-db70555403d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:33.450270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d7b66-4bc1-4031-89ec-db70555403d1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:33.487520 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 485/981] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 10:34:33 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:33.613365 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ae47b-300d-4bfb-9b0d-2f6cb810f59f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:33.709343 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265bb34-a2e7-4de9-ae6d-95f727c85bdc None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:33.709825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265bb34-a2e7-4de9-ae6d-95f727c85bdc None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:33.709825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265bb34-a2e7-4de9-ae6d-95f727c85bdc None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:33.711173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 486/982] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:34:33.716852 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2d219-19f6-42bf-b470-ba9cae656fbe None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:33.717131 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2d219-19f6-42bf-b470-ba9cae656fbe None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:33.717402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2d219-19f6-42bf-b470-ba9cae656fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:33.739597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ae47b-300d-4bfb-9b0d-2f6cb810f59f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:33.741156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-4aa2d219-19f6-42bf-b470-ba9cae656fbe None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:33.742107 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-4aa2d219-19f6-42bf-b470-ba9cae656fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:33.779257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dc331-c8f0-4f03-be89-e8c64034ea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:33.779886 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dc331-c8f0-4f03-be89-e8c64034ea9b None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:33.780242 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dc331-c8f0-4f03-be89-e8c64034ea9b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:33.780512 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dc331-c8f0-4f03-be89-e8c64034ea9b None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:33.781823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dc331-c8f0-4f03-be89-e8c64034ea9b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:33.783303 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dc331-c8f0-4f03-be89-e8c64034ea9b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:33.806442 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 497/983] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 10:34:33 2022] POST /identity/v3/services => generated 242 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:34:33.807917 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a27427-0014-4190-b550-9ef9486d8ea0 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:33.808203 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a27427-0014-4190-b550-9ef9486d8ea0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:33.808475 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a27427-0014-4190-b550-9ef9486d8ea0 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:33.810159 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 498/984] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:33.816499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0ecd6-d7d6-4a8c-9407-c4bc3b5be4f9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:33.816846 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0ecd6-d7d6-4a8c-9407-c4bc3b5be4f9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:33.817130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0ecd6-d7d6-4a8c-9407-c4bc3b5be4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:33.832143 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 487/985] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 10:34:33.838362 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-5fd0ecd6-d7d6-4a8c-9407-c4bc3b5be4f9 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:33.839671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5fd0ecd6-d7d6-4a8c-9407-c4bc3b5be4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:33.857996 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:33.923447 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 499/986] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 10:34:34.100071 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2d219-19f6-42bf-b470-ba9cae656fbe None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:34.191549 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0ecd6-d7d6-4a8c-9407-c4bc3b5be4f9 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:34.209874 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2d219-19f6-42bf-b470-ba9cae656fbe None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:34.225708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:34.249970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5884d-72d2-4967-9a41-235e52fe73dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:34.250746 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5884d-72d2-4967-9a41-235e52fe73dc None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:34.251148 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5884d-72d2-4967-9a41-235e52fe73dc None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:34.251528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5884d-72d2-4967-9a41-235e52fe73dc None admin] PATH_INFO: `/v3/services/image` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:34.252239 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5884d-72d2-4967-9a41-235e52fe73dc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:34.253759 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5884d-72d2-4967-9a41-235e52fe73dc None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:34.262576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-7fa5884d-72d2-4967-9a41-235e52fe73dc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 10:34:34.262576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:34.262576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:34.262576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:34.262576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:34.262576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:34.262576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:34.262576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:34.262576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 10:34:34.262576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:34.262576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:34.262576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:34.262576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:34.262576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:34.262576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:34.262576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:34.262576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:34.263565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:34.263565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:34.263565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:34.263565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:34.263565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:34.263565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:34.263565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:34.263565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:34.263565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:34.263565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:34.263565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:34.263565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:34.263565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:34.263565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:34.263565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:34.263565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:34.265173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:34.265173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:34.265173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:34.265173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:34.265173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:34.265173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:34.265173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:34.265173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:34.265173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:34.265173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:34.265173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:34.265173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:34.265173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 10:34:34.265173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:34.265173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 488/987] 10.222.0.20 () {56 vars in 1105 bytes} [Sun Sep 11 10:34:34 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:34.269865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5884d-72d2-4967-9a41-235e52fe73dc None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:34.300124 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0ecd6-d7d6-4a8c-9407-c4bc3b5be4f9 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:34.340333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013916ca-05d0-4a89-97be-5b0299d90ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:34.341104 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013916ca-05d0-4a89-97be-5b0299d90ea4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:34.341448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013916ca-05d0-4a89-97be-5b0299d90ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:34.341783 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013916ca-05d0-4a89-97be-5b0299d90ea4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:34.342427 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013916ca-05d0-4a89-97be-5b0299d90ea4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:34.343952 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013916ca-05d0-4a89-97be-5b0299d90ea4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:34.352961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-013916ca-05d0-4a89-97be-5b0299d90ea4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 10:34:34.352961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:34.352961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:34.352961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:34.352961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:34.352961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:34.352961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:34.352961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:34.352961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 10:34:34.352961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:34.352961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:34.352961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:34.352961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:34.352961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:34.352961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:34.352961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:34.352961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:34.354166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:34.354166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:34.354166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:34.354166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:34.354166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:34.354166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:34.354166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:34.354166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:34.354166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:34.354166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:34.354166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:34.354166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:34.354166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:34.354166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:34.354166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:34.354166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:34.355236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:34.355236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:34.355236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:34.355236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:34.355236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:34.355236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:34.355236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:34.355236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:34.355236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:34.355236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:34.355236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:34.355236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:34.355236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 10:34:34.355236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:34.356042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 500/988] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 10:34:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:34.362001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013916ca-05d0-4a89-97be-5b0299d90ea4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:34.378172 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:34.383550 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5884d-72d2-4967-9a41-235e52fe73dc None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:34.419538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c80035-038e-4605-8cc0-be6b33c4baae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:34.420141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c80035-038e-4605-8cc0-be6b33c4baae None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:34.420415 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c80035-038e-4605-8cc0-be6b33c4baae None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:34.420746 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c80035-038e-4605-8cc0-be6b33c4baae None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:34.421398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c80035-038e-4605-8cc0-be6b33c4baae None admin] RBAC: Adding query filter params (name=image) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:34.421728 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c80035-038e-4605-8cc0-be6b33c4baae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:34.423077 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c80035-038e-4605-8cc0-be6b33c4baae None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:34.428156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 489/989] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:34.433563 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c80035-038e-4605-8cc0-be6b33c4baae None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:34.465407 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013916ca-05d0-4a89-97be-5b0299d90ea4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:34.477930 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:34.505954 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b596fd-2b43-44f3-8ddf-20f15e020f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:34.506560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b596fd-2b43-44f3-8ddf-20f15e020f11 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:34.506835 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b596fd-2b43-44f3-8ddf-20f15e020f11 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:34.507104 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b596fd-2b43-44f3-8ddf-20f15e020f11 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:34.507729 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b596fd-2b43-44f3-8ddf-20f15e020f11 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:34.508027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b596fd-2b43-44f3-8ddf-20f15e020f11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:34.510340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b596fd-2b43-44f3-8ddf-20f15e020f11 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:34.515896 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 501/990] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Sep 11 10:34:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:34.521539 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b596fd-2b43-44f3-8ddf-20f15e020f11 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:34.541442 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c80035-038e-4605-8cc0-be6b33c4baae None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:34.578256 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568e201-a3fc-49e0-8f5f-af5349870f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:34.578865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568e201-a3fc-49e0-8f5f-af5349870f45 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:34.579140 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568e201-a3fc-49e0-8f5f-af5349870f45 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:34.579409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568e201-a3fc-49e0-8f5f-af5349870f45 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:34.580038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568e201-a3fc-49e0-8f5f-af5349870f45 None admin] RBAC: Adding query filter params (type=image) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:34.580336 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568e201-a3fc-49e0-8f5f-af5349870f45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:34.581725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568e201-a3fc-49e0-8f5f-af5349870f45 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:34.586380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 490/991] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:34 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:34.609642 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:34.636262 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b596fd-2b43-44f3-8ddf-20f15e020f11 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:34.674801 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7f179-fb54-4968-b297-82d55527893a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:34.675419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7f179-fb54-4968-b297-82d55527893a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:34.675698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7f179-fb54-4968-b297-82d55527893a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:34.675969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7f179-fb54-4968-b297-82d55527893a None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:34.676639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7f179-fb54-4968-b297-82d55527893a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:34.676944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7f179-fb54-4968-b297-82d55527893a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:34.678341 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7f179-fb54-4968-b297-82d55527893a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:34.689057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 502/992] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Sep 11 10:34:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:34.690769 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568e201-a3fc-49e0-8f5f-af5349870f45 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:34.810139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568e201-a3fc-49e0-8f5f-af5349870f45 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:34.817735 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:34.850359 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36f99e-6ecd-4bb1-8d51-ad9d0e6e142e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:34.850969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36f99e-6ecd-4bb1-8d51-ad9d0e6e142e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:34.851247 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36f99e-6ecd-4bb1-8d51-ad9d0e6e142e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:34.851518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36f99e-6ecd-4bb1-8d51-ad9d0e6e142e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:34.852230 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36f99e-6ecd-4bb1-8d51-ad9d0e6e142e None admin] RBAC: Adding query filter params (interface=admin, service_id=7707048eafbd450db5e7c2e724697de7, region_id=RegionOne) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:34.852538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36f99e-6ecd-4bb1-8d51-ad9d0e6e142e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:34.853955 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36f99e-6ecd-4bb1-8d51-ad9d0e6e142e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:34.864653 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 491/993] 10.222.0.20 () {56 vars in 1249 bytes} [Sun Sep 11 10:34:34 2022] GET /identity/v3/endpoints?service_id=7707048eafbd450db5e7c2e724697de7&interface=admin®ion_id=RegionOne => generated 193 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:34.866199 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7f179-fb54-4968-b297-82d55527893a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:34.967549 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7f179-fb54-4968-b297-82d55527893a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:35.000891 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a839a1a-2a67-4965-8992-82e074ec3627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:35.001492 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a839a1a-2a67-4965-8992-82e074ec3627 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:35.001764 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a839a1a-2a67-4965-8992-82e074ec3627 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:35.002034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a839a1a-2a67-4965-8992-82e074ec3627 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:35.002632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a839a1a-2a67-4965-8992-82e074ec3627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:35.003975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a839a1a-2a67-4965-8992-82e074ec3627 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:35.014591 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 503/994] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Sep 11 10:34:34 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:34:36.031699 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c1758-f412-4613-bec6-6298596177a9 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:36.032187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c1758-f412-4613-bec6-6298596177a9 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:36.032187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c1758-f412-4613-bec6-6298596177a9 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:36.033664 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 492/995] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:36.038804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220e375-a80f-4c2a-9b97-7a41317c7ee2 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:36.039245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220e375-a80f-4c2a-9b97-7a41317c7ee2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:36.039394 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220e375-a80f-4c2a-9b97-7a41317c7ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:36.053327 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:36.059245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7220e375-a80f-4c2a-9b97-7a41317c7ee2 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:36.060430 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7220e375-a80f-4c2a-9b97-7a41317c7ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:36.127584 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 504/996] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:36.395099 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c1758-f412-4613-bec6-6298596177a9 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:36.497332 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c1758-f412-4613-bec6-6298596177a9 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:36.530528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab4fe7-6d10-48b0-995a-584d2615ea7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:36.531242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab4fe7-6d10-48b0-995a-584d2615ea7c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:36.531522 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab4fe7-6d10-48b0-995a-584d2615ea7c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:36.531793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab4fe7-6d10-48b0-995a-584d2615ea7c None admin] PATH_INFO: `/v3/services/compute` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:36.532376 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab4fe7-6d10-48b0-995a-584d2615ea7c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:36.533765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab4fe7-6d10-48b0-995a-584d2615ea7c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:36.543398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-0bab4fe7-6d10-48b0-995a-584d2615ea7c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 10:34:36.543398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:36.543398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:36.543398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:36.543398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:36.543398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:36.543398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:36.543398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:36.543398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 10:34:36.543398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:36.543398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:36.543398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:36.543398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:36.543398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:36.543398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:36.543398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:36.543398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:36.544441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:36.544441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:36.544441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:36.544441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:36.544441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:36.544441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:36.544441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:36.544441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:36.544441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:36.544441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:36.544441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:36.544441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:36.544441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:36.544441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:36.544441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:36.544441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:36.545687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:36.545687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:36.545687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:36.545687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:36.545687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:36.545687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:36.545687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:36.545687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:36.545687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:36.545687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:36.545687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:36.545687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:36.545687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 10:34:36.545687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:36.549134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 493/997] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:36.552791 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220e375-a80f-4c2a-9b97-7a41317c7ee2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:36.657854 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220e375-a80f-4c2a-9b97-7a41317c7ee2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:36.692681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5971b77-7fcb-406c-bcdb-f5792ecd3df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:36.693295 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5971b77-7fcb-406c-bcdb-f5792ecd3df5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:36.693576 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5971b77-7fcb-406c-bcdb-f5792ecd3df5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:36.693905 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5971b77-7fcb-406c-bcdb-f5792ecd3df5 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:36.694596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5971b77-7fcb-406c-bcdb-f5792ecd3df5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:36.694906 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5971b77-7fcb-406c-bcdb-f5792ecd3df5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:36.696267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5971b77-7fcb-406c-bcdb-f5792ecd3df5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:36.698099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:36.707646 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 505/998] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 10:34:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:36.711682 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab4fe7-6d10-48b0-995a-584d2615ea7c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:36.728856 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9800e71-4089-4cd8-9aa0-b79e15e39ec4 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:36.729322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9800e71-4089-4cd8-9aa0-b79e15e39ec4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:36.729598 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9800e71-4089-4cd8-9aa0-b79e15e39ec4 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:36.732770 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 506/999] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:36.737662 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808194f-cad9-4504-8a5b-a8a4de30a75d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:36.737943 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808194f-cad9-4504-8a5b-a8a4de30a75d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:36.738217 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808194f-cad9-4504-8a5b-a8a4de30a75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:36.753479 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:36.758090 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e808194f-cad9-4504-8a5b-a8a4de30a75d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:36.759293 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e808194f-cad9-4504-8a5b-a8a4de30a75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:36.825727 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab4fe7-6d10-48b0-995a-584d2615ea7c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:36.836597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 507/1000] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:36.860284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed2cb4-165f-4737-a09d-dac1eb7b5cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:36.860911 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed2cb4-165f-4737-a09d-dac1eb7b5cd4 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:36.861189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed2cb4-165f-4737-a09d-dac1eb7b5cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:36.861461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed2cb4-165f-4737-a09d-dac1eb7b5cd4 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:36.862087 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed2cb4-165f-4737-a09d-dac1eb7b5cd4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:36.862390 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed2cb4-165f-4737-a09d-dac1eb7b5cd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:36.863740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed2cb4-165f-4737-a09d-dac1eb7b5cd4 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:36.872756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 494/1001] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 10:34:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:36.875343 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808194f-cad9-4504-8a5b-a8a4de30a75d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:36.974074 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808194f-cad9-4504-8a5b-a8a4de30a75d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:37.002306 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:37.009032 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578b0a8-2188-43b9-b4a2-5b9957a5bfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:37.009636 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578b0a8-2188-43b9-b4a2-5b9957a5bfcc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:37.009914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578b0a8-2188-43b9-b4a2-5b9957a5bfcc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:37.010185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578b0a8-2188-43b9-b4a2-5b9957a5bfcc None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:37.010878 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578b0a8-2188-43b9-b4a2-5b9957a5bfcc None admin] RBAC: Adding query filter params (interface=public, service_id=2b4dc0a44569401da48ad8403ea7ea27, region_id=RegionOne) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:37.011185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578b0a8-2188-43b9-b4a2-5b9957a5bfcc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:37.012536 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578b0a8-2188-43b9-b4a2-5b9957a5bfcc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:37.018310 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 508/1002] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Sep 11 10:34:36 2022] GET /identity/v3/endpoints?service_id=2b4dc0a44569401da48ad8403ea7ea27&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:37.023797 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed2cb4-165f-4737-a09d-dac1eb7b5cd4 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:37.111465 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578b0a8-2188-43b9-b4a2-5b9957a5bfcc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:37.129011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:37.133378 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed2cb4-165f-4737-a09d-dac1eb7b5cd4 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:37.170248 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f5703-38d9-474e-ac19-b59a98e8fbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:37.170855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f5703-38d9-474e-ac19-b59a98e8fbe1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:37.171137 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f5703-38d9-474e-ac19-b59a98e8fbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:37.171924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f5703-38d9-474e-ac19-b59a98e8fbe1 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:37.172556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f5703-38d9-474e-ac19-b59a98e8fbe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:37.173948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f5703-38d9-474e-ac19-b59a98e8fbe1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:37.180095 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 495/1003] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Sep 11 10:34:37 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:34:37.181306 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e965c-2f83-4c4b-a07a-c34fa846a3b2 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:37.181683 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e965c-2f83-4c4b-a07a-c34fa846a3b2 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:37.181970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e965c-2f83-4c4b-a07a-c34fa846a3b2 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:37.183648 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 496/1004] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:37.189947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba9034-514d-4490-89c7-ea6f2411c61d None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:37.190254 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba9034-514d-4490-89c7-ea6f2411c61d None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:37.190497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba9034-514d-4490-89c7-ea6f2411c61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:37.210184 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-f3ba9034-514d-4490-89c7-ea6f2411c61d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:37.211433 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f3ba9034-514d-4490-89c7-ea6f2411c61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:37.237611 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578b0a8-2188-43b9-b4a2-5b9957a5bfcc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:37.277967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e3503-e19e-46e9-9442-8925f5b3ffaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:37.278968 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e3503-e19e-46e9-9442-8925f5b3ffaf None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:37.279265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e3503-e19e-46e9-9442-8925f5b3ffaf None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:37.279686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e3503-e19e-46e9-9442-8925f5b3ffaf None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:37.280364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e3503-e19e-46e9-9442-8925f5b3ffaf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:37.281887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e3503-e19e-46e9-9442-8925f5b3ffaf None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:37.287214 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 497/1005] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 10:34:37.310049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 509/1006] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 10:34:37 2022] POST /identity/v3/services => generated 242 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:34:37.565139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba9034-514d-4490-89c7-ea6f2411c61d None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:37.662040 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:37.673058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba9034-514d-4490-89c7-ea6f2411c61d None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:37.719674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9ac1d-eb56-48a2-9c6f-8811c43ca6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:37.720393 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9ac1d-eb56-48a2-9c6f-8811c43ca6e2 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:37.720770 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9ac1d-eb56-48a2-9c6f-8811c43ca6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:37.721439 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9ac1d-eb56-48a2-9c6f-8811c43ca6e2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:37.722104 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9ac1d-eb56-48a2-9c6f-8811c43ca6e2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:37.723535 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9ac1d-eb56-48a2-9c6f-8811c43ca6e2 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:37.732429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-a0d9ac1d-eb56-48a2-9c6f-8811c43ca6e2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 10:34:37.732429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:37.732429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:37.732429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:37.732429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:37.732429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:37.732429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:37.732429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:37.732429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 10:34:37.732429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:37.732429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:37.732429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:37.732429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:37.732429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:37.732429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:37.732429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:37.732429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:37.733702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:37.733702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:37.733702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:37.733702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:37.733702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:37.733702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:37.733702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:37.733702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:37.733702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:37.733702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:37.733702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:37.733702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:37.733702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:37.733702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:37.733702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:37.733702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:37.735178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:37.735178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:37.735178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:37.735178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:37.735178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:37.735178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:37.735178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:37.735178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:37.735178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:37.735178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:37.735178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:37.735178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:37.735178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 10:34:37.735178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:37.735178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 498/1007] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 10:34:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:37.740197 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e3503-e19e-46e9-9442-8925f5b3ffaf None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:37.797601 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:37.847133 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e3503-e19e-46e9-9442-8925f5b3ffaf None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:37.880187 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17daad-50d8-45ca-86f6-4959b6a7759b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:37.880827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17daad-50d8-45ca-86f6-4959b6a7759b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:37.881110 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17daad-50d8-45ca-86f6-4959b6a7759b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:37.881381 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17daad-50d8-45ca-86f6-4959b6a7759b None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:37.882017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17daad-50d8-45ca-86f6-4959b6a7759b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:37.882317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17daad-50d8-45ca-86f6-4959b6a7759b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:37.883738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17daad-50d8-45ca-86f6-4959b6a7759b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:37.890745 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 510/1008] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Sep 11 10:34:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:37.896336 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9ac1d-eb56-48a2-9c6f-8811c43ca6e2 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:37.996594 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9ac1d-eb56-48a2-9c6f-8811c43ca6e2 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:38.030282 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da42919-b588-44ba-88ee-97e5843559eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:38.030952 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da42919-b588-44ba-88ee-97e5843559eb None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:38.031234 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da42919-b588-44ba-88ee-97e5843559eb None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:38.031512 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da42919-b588-44ba-88ee-97e5843559eb None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:38.032144 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da42919-b588-44ba-88ee-97e5843559eb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:38.032448 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da42919-b588-44ba-88ee-97e5843559eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:38.033863 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da42919-b588-44ba-88ee-97e5843559eb None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:38.043494 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 499/1009] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Sep 11 10:34:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:38.044636 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17daad-50d8-45ca-86f6-4959b6a7759b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:38.147692 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17daad-50d8-45ca-86f6-4959b6a7759b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:38.164084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:38.181287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdab16b-4c40-46b9-b09d-fe94acf35d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:38.181918 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdab16b-4c40-46b9-b09d-fe94acf35d92 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:38.182307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdab16b-4c40-46b9-b09d-fe94acf35d92 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:38.182664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdab16b-4c40-46b9-b09d-fe94acf35d92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:38.183423 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdab16b-4c40-46b9-b09d-fe94acf35d92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:38.184986 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdab16b-4c40-46b9-b09d-fe94acf35d92 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:38.201008 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 511/1010] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:34:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:34:39.333272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f23f4-c17d-4999-ae7d-865d6e9d27c2 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:39.333829 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f23f4-c17d-4999-ae7d-865d6e9d27c2 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:39.333829 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f23f4-c17d-4999-ae7d-865d6e9d27c2 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:39.335287 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 500/1011] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:39.340244 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2b7a8-6c19-4188-8b40-81819f5ea0a2 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:39.340644 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2b7a8-6c19-4188-8b40-81819f5ea0a2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:39.340832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2b7a8-6c19-4188-8b40-81819f5ea0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:39.359782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-15e2b7a8-6c19-4188-8b40-81819f5ea0a2 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:39.360995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-15e2b7a8-6c19-4188-8b40-81819f5ea0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:39.435295 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 512/1012] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:39 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:39.543645 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b676a-4dfb-4fdf-97e2-a28498c02c9e None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:39.544588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b676a-4dfb-4fdf-97e2-a28498c02c9e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:39.544588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b676a-4dfb-4fdf-97e2-a28498c02c9e None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:39.545699 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 501/1013] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:39.551533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b9793-531f-4623-90e7-7495e095f7a2 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:39.551821 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b9793-531f-4623-90e7-7495e095f7a2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:39.552095 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b9793-531f-4623-90e7-7495e095f7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:39.570556 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b41b9793-531f-4623-90e7-7495e095f7a2 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:39.571734 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b41b9793-531f-4623-90e7-7495e095f7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:39.639040 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 513/1014] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:39 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:39.717911 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b676a-4dfb-4fdf-97e2-a28498c02c9e None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:39.737867 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:39.823084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b676a-4dfb-4fdf-97e2-a28498c02c9e None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:39.856961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0a3d0-b712-4d80-8de8-17806d3f4584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:39.857588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0a3d0-b712-4d80-8de8-17806d3f4584 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:39.857874 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0a3d0-b712-4d80-8de8-17806d3f4584 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:39.858146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0a3d0-b712-4d80-8de8-17806d3f4584 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:39.858731 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0a3d0-b712-4d80-8de8-17806d3f4584 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:39.860145 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0a3d0-b712-4d80-8de8-17806d3f4584 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:39.868877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-b4c0a3d0-b712-4d80-8de8-17806d3f4584 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 10:34:39.868877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:39.868877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:39.868877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:39.868877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:39.868877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:39.868877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:39.868877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:39.868877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 10:34:39.868877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:39.868877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:39.868877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:39.868877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:39.868877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:39.868877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:39.868877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:39.868877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:39.869849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:39.869849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:39.869849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:39.869849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:39.869849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:39.869849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:39.869849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:39.869849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:39.869849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:39.869849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:39.869849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:39.869849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:39.869849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:39.869849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:39.869849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:39.869849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:39.870665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:39.870665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:39.870665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:39.870665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:39.870665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:39.870665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:39.870665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:39.870665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:39.870665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:39.870665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:39.870665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:39.870665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:39.870665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 10:34:39.870665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:39.872868 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 502/1015] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:39.876703 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b9793-531f-4623-90e7-7495e095f7a2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:39.910865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0a3d0-b712-4d80-8de8-17806d3f4584 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:39.912843 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:39.983696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b9793-531f-4623-90e7-7495e095f7a2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:40.001784 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:40.022620 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3c9ec-3647-443b-bee1-e623519788a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:40.023342 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3c9ec-3647-443b-bee1-e623519788a7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:40.023850 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3c9ec-3647-443b-bee1-e623519788a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:40.024351 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3c9ec-3647-443b-bee1-e623519788a7 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:40.025288 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0a3d0-b712-4d80-8de8-17806d3f4584 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:40.025411 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3c9ec-3647-443b-bee1-e623519788a7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:40.025588 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3c9ec-3647-443b-bee1-e623519788a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:40.027399 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3c9ec-3647-443b-bee1-e623519788a7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:40.036594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 514/1016] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 10:34:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:40.039879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3c9ec-3647-443b-bee1-e623519788a7 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:40.068947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb86792-2d3b-4195-8a71-0a7965c57b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:40.069586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb86792-2d3b-4195-8a71-0a7965c57b63 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:40.069866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb86792-2d3b-4195-8a71-0a7965c57b63 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:40.070137 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb86792-2d3b-4195-8a71-0a7965c57b63 None admin] PATH_INFO: `/v3/services/image` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:40.070721 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb86792-2d3b-4195-8a71-0a7965c57b63 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:40.072086 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb86792-2d3b-4195-8a71-0a7965c57b63 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:40.081111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-beb86792-2d3b-4195-8a71-0a7965c57b63 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 10:34:40.081111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:40.081111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:40.081111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:40.081111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:40.081111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:40.081111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:40.081111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:40.081111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 10:34:40.081111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:40.081111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:40.081111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:40.081111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:40.081111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:40.081111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:40.081111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:40.081111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:40.082089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:40.082089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:40.082089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:40.082089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:40.082089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:40.082089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:40.082089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:40.082089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:40.082089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:40.082089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:40.082089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:40.082089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:40.082089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:40.082089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:40.082089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:40.082089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:40.082949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:40.082949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:40.082949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:40.082949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:40.082949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:40.082949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:40.082949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:40.082949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:40.082949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:40.082949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:40.082949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:40.082949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:40.082949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 10:34:40.082949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:40.082949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 503/1017] 10.222.0.20 () {56 vars in 1105 bytes} [Sun Sep 11 10:34:39 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:34:40.088086 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb86792-2d3b-4195-8a71-0a7965c57b63 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:40.144020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:40.149071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3c9ec-3647-443b-bee1-e623519788a7 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:40.187842 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31578de-1e32-46f6-ace0-e3284d29f75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:40.188442 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31578de-1e32-46f6-ace0-e3284d29f75f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:40.189282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31578de-1e32-46f6-ace0-e3284d29f75f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:40.189563 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31578de-1e32-46f6-ace0-e3284d29f75f None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:40.190206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31578de-1e32-46f6-ace0-e3284d29f75f None admin] RBAC: Adding query filter params (type=compute) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:40.190515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31578de-1e32-46f6-ace0-e3284d29f75f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:40.191881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31578de-1e32-46f6-ace0-e3284d29f75f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:40.197012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 515/1018] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 10:34:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:40.202004 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb86792-2d3b-4195-8a71-0a7965c57b63 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:40.202614 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31578de-1e32-46f6-ace0-e3284d29f75f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:40.239335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf0db6-2275-43b3-a624-a6856a794111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:40.240202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf0db6-2275-43b3-a624-a6856a794111 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:40.240661 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf0db6-2275-43b3-a624-a6856a794111 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:40.241079 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf0db6-2275-43b3-a624-a6856a794111 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:40.241872 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf0db6-2275-43b3-a624-a6856a794111 None admin] RBAC: Adding query filter params (name=image) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:40.242320 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf0db6-2275-43b3-a624-a6856a794111 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:40.243899 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf0db6-2275-43b3-a624-a6856a794111 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:40.249325 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 504/1019] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:40.254825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf0db6-2275-43b3-a624-a6856a794111 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:40.267259 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:40.313422 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31578de-1e32-46f6-ace0-e3284d29f75f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:40.351712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f6965-ce26-4596-94e5-a8f6eda2ae8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:40.352349 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f6965-ce26-4596-94e5-a8f6eda2ae8b None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:40.352624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f6965-ce26-4596-94e5-a8f6eda2ae8b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:40.352900 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f6965-ce26-4596-94e5-a8f6eda2ae8b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:40.353572 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f6965-ce26-4596-94e5-a8f6eda2ae8b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:40.354932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f6965-ce26-4596-94e5-a8f6eda2ae8b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:40.371261 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf0db6-2275-43b3-a624-a6856a794111 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:40.380267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 516/1020] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:34:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:34:40.397309 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e702b-4373-4c3e-b9d0-0ef9b932af84 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:40.397629 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e702b-4373-4c3e-b9d0-0ef9b932af84 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:40.397919 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e702b-4373-4c3e-b9d0-0ef9b932af84 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:40.399544 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 517/1021] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:34:40.405374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebfcfd-4c22-4984-a80d-410640c1a85a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:40.405662 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebfcfd-4c22-4984-a80d-410640c1a85a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:40.406505 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebfcfd-4c22-4984-a80d-410640c1a85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:40.421134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc53808-809d-4ecb-aa12-c46f11118d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:40.422140 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc53808-809d-4ecb-aa12-c46f11118d9d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:40.422462 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc53808-809d-4ecb-aa12-c46f11118d9d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:40.422703 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc53808-809d-4ecb-aa12-c46f11118d9d None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:40.423446 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc53808-809d-4ecb-aa12-c46f11118d9d None admin] RBAC: Adding query filter params (type=image) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:40.423778 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc53808-809d-4ecb-aa12-c46f11118d9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:40.425204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc53808-809d-4ecb-aa12-c46f11118d9d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:40.425684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-61ebfcfd-4c22-4984-a80d-410640c1a85a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:40.426928 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-61ebfcfd-4c22-4984-a80d-410640c1a85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:40.435832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 505/1022] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:40.437623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc53808-809d-4ecb-aa12-c46f11118d9d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:40.443904 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:40.512945 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 518/1023] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 10:34:40.515987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:40.553065 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc53808-809d-4ecb-aa12-c46f11118d9d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:40.589122 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04176545-5a25-4e6d-8dab-e2478ff717ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:40.589830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04176545-5a25-4e6d-8dab-e2478ff717ad None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:40.590109 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04176545-5a25-4e6d-8dab-e2478ff717ad None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:40.590386 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04176545-5a25-4e6d-8dab-e2478ff717ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:40.591088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04176545-5a25-4e6d-8dab-e2478ff717ad None admin] RBAC: Adding query filter params (interface=public, service_id=26628ebcbb0e4d38b4982f1f5cb48ad6, region_id=RegionOne) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:40.591392 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04176545-5a25-4e6d-8dab-e2478ff717ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:40.592785 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04176545-5a25-4e6d-8dab-e2478ff717ad None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:40.598822 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 506/1024] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Sep 11 10:34:40 2022] GET /identity/v3/endpoints?service_id=26628ebcbb0e4d38b4982f1f5cb48ad6&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:40.604931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebfcfd-4c22-4984-a80d-410640c1a85a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:40.710319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebfcfd-4c22-4984-a80d-410640c1a85a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:40.748267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32485a21-2030-40b7-bac0-4c83073e92ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:40.748909 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32485a21-2030-40b7-bac0-4c83073e92ea None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:40.749178 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32485a21-2030-40b7-bac0-4c83073e92ea None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:40.749470 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32485a21-2030-40b7-bac0-4c83073e92ea None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:40.750071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32485a21-2030-40b7-bac0-4c83073e92ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:40.751420 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32485a21-2030-40b7-bac0-4c83073e92ea None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:40.762801 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 519/1025] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Sep 11 10:34:40 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:34:40.783954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04176545-5a25-4e6d-8dab-e2478ff717ad None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:40.897238 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04176545-5a25-4e6d-8dab-e2478ff717ad None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:40.928597 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:40.934656 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474cf65-89f5-496a-8ad5-0f4cf77e0d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:40.935294 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474cf65-89f5-496a-8ad5-0f4cf77e0d7c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:40.935590 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474cf65-89f5-496a-8ad5-0f4cf77e0d7c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:40.935839 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474cf65-89f5-496a-8ad5-0f4cf77e0d7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:40.937812 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474cf65-89f5-496a-8ad5-0f4cf77e0d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:40.939621 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474cf65-89f5-496a-8ad5-0f4cf77e0d7c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:40.941293 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 507/1026] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:40.947125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32485a21-2030-40b7-bac0-4c83073e92ea None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:40.963783 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:41.058745 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32485a21-2030-40b7-bac0-4c83073e92ea None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:41.092996 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8ca3e-752e-48b5-bb24-2ad71ff86479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:41.093639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8ca3e-752e-48b5-bb24-2ad71ff86479 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:41.093907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8ca3e-752e-48b5-bb24-2ad71ff86479 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:41.094175 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8ca3e-752e-48b5-bb24-2ad71ff86479 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:41.094812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8ca3e-752e-48b5-bb24-2ad71ff86479 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:41.096483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8ca3e-752e-48b5-bb24-2ad71ff86479 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:41.128641 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 520/1027] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 10:34:40 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:34:42.679728 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617bab4-a93a-4b60-95ba-3dd6163b4dd9 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:42.680250 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617bab4-a93a-4b60-95ba-3dd6163b4dd9 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:42.680250 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617bab4-a93a-4b60-95ba-3dd6163b4dd9 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:42.681690 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 508/1028] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:42.687486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d24558-06f3-4f11-a2fa-2e21900dec8e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:42.687912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d24558-06f3-4f11-a2fa-2e21900dec8e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:42.688167 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d24558-06f3-4f11-a2fa-2e21900dec8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:42.711158 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f2d24558-06f3-4f11-a2fa-2e21900dec8e None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:42.712113 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f2d24558-06f3-4f11-a2fa-2e21900dec8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:42.772844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:42.792093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 521/1029] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:42.941970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3adeb-4e34-4da8-9501-781e1be09143 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:42.942171 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3adeb-4e34-4da8-9501-781e1be09143 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:42.942617 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3adeb-4e34-4da8-9501-781e1be09143 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:42.943963 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 509/1030] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:42.949455 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8003f-111a-496f-ab14-954f8f6f4edf None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:42.949749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8003f-111a-496f-ab14-954f8f6f4edf None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:42.950055 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8003f-111a-496f-ab14-954f8f6f4edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:42.969260 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-1ea8003f-111a-496f-ab14-954f8f6f4edf None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:42.970453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1ea8003f-111a-496f-ab14-954f8f6f4edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:43.036563 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 522/1031] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:43.059922 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3adeb-4e34-4da8-9501-781e1be09143 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:43.162110 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3adeb-4e34-4da8-9501-781e1be09143 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:43.200849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8d6dd-f42d-40cb-b4be-e68c5b335906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:43.201435 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8d6dd-f42d-40cb-b4be-e68c5b335906 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:43.201716 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8d6dd-f42d-40cb-b4be-e68c5b335906 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:43.201994 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8d6dd-f42d-40cb-b4be-e68c5b335906 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:43.213984 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8d6dd-f42d-40cb-b4be-e68c5b335906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:34:43.219056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-6ef8d6dd-f42d-40cb-b4be-e68c5b335906 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 10:34:43.219056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:43.219056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:43.219056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:43.219056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:43.219056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:43.219056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:43.219056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:43.219056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:43.219056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:43.219056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:43.219056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:43.219056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:34:43.219056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:34:43.219056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:34:43.219056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:34:43.220003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:34:43.220003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:34:43.220003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:34:43.220003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:34:43.220003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:43.220003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:43.220003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:43.220003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:43.220003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:43.220003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:43.220003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:43.220003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:43.220003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:43.220003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:43.220003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:43.220003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:43.221556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:43.221556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:43.221556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:43.221556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:43.221556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:34:43.221556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:34:43.221556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:34:43.221556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:34:43.221556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:34:43.221556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:34:43.221556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 10:34:43.221556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:43.224891 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 510/1032] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Sep 11 10:34:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:43.226457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8003f-111a-496f-ab14-954f8f6f4edf None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:43.308966 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da57fbf-8e52-4d87-bfd9-bc04f2b87e90 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:43.309250 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da57fbf-8e52-4d87-bfd9-bc04f2b87e90 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:43.309531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da57fbf-8e52-4d87-bfd9-bc04f2b87e90 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:43.312148 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 511/1033] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:34:43.312873 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da57fbf-8e52-4d87-bfd9-bc04f2b87e90 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:43.326503 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8003f-111a-496f-ab14-954f8f6f4edf None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:43.351326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:43.363394 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670610b-d669-4013-97a6-62abb1e799d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:43.363998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670610b-d669-4013-97a6-62abb1e799d2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:43.364278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670610b-d669-4013-97a6-62abb1e799d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:43.364579 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670610b-d669-4013-97a6-62abb1e799d2 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:43.365238 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670610b-d669-4013-97a6-62abb1e799d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:43.365542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670610b-d669-4013-97a6-62abb1e799d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:43.366935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670610b-d669-4013-97a6-62abb1e799d2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:43.375005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:43.380890 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 523/1034] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Sep 11 10:34:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:43.380890 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596da22-51d9-4443-9aef-581340610920 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:43.380890 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596da22-51d9-4443-9aef-581340610920 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:43.380890 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596da22-51d9-4443-9aef-581340610920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:43.395610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d596da22-51d9-4443-9aef-581340610920 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:43.396839 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d596da22-51d9-4443-9aef-581340610920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:43.417707 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da57fbf-8e52-4d87-bfd9-bc04f2b87e90 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:43.451952 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974a993-5e51-4057-9d54-6024bf161f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:43.452598 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974a993-5e51-4057-9d54-6024bf161f7d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:43.452913 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974a993-5e51-4057-9d54-6024bf161f7d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:43.453198 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974a993-5e51-4057-9d54-6024bf161f7d None admin] PATH_INFO: `/v3/services/image` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:43.453780 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974a993-5e51-4057-9d54-6024bf161f7d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:43.455131 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974a993-5e51-4057-9d54-6024bf161f7d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:43.461151 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 524/1035] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:43.461971 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596da22-51d9-4443-9aef-581340610920 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:43.463830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-5974a993-5e51-4057-9d54-6024bf161f7d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 10:34:43.463830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:43.463830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:34:43.463830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:34:43.463830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:34:43.463830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:34:43.463830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:34:43.463830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:43.463830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 10:34:43.463830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:43.463830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:34:43.463830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:43.463830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:43.463830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:43.463830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:43.463830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:43.463830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:43.465058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:43.465058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:43.465058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:43.465058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:43.465058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:43.465058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:43.465058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:34:43.465058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:34:43.465058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:34:43.465058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:34:43.465058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:43.465058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:43.465058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:43.465058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:43.465058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:43.465058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:43.465907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:43.465907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:43.465907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:43.465907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:43.465907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:43.465907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:43.465907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:43.465907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:43.465907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:43.465907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:43.465907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:34:43.465907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:34:43.465907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 10:34:43.465907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:43.465907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 512/1036] 10.222.0.20 () {56 vars in 1105 bytes} [Sun Sep 11 10:34:43 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:43.471462 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974a993-5e51-4057-9d54-6024bf161f7d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:43.569233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596da22-51d9-4443-9aef-581340610920 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:43.584249 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974a993-5e51-4057-9d54-6024bf161f7d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:43.585854 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:43.604807 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6de772-c54b-41c0-9144-75441bf3a208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:43.605447 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6de772-c54b-41c0-9144-75441bf3a208 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:43.605726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6de772-c54b-41c0-9144-75441bf3a208 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:43.605999 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6de772-c54b-41c0-9144-75441bf3a208 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:43.610040 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:43.617025 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6de772-c54b-41c0-9144-75441bf3a208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:43.618451 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6de772-c54b-41c0-9144-75441bf3a208 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:43.621853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622d06f-2f5c-4ca8-9e74-d0a9559650a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:43.622456 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622d06f-2f5c-4ca8-9e74-d0a9559650a2 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:43.622732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622d06f-2f5c-4ca8-9e74-d0a9559650a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:43.623025 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622d06f-2f5c-4ca8-9e74-d0a9559650a2 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:43.623656 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622d06f-2f5c-4ca8-9e74-d0a9559650a2 None admin] RBAC: Adding query filter params (name=image) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:43.623956 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622d06f-2f5c-4ca8-9e74-d0a9559650a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:43.626258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622d06f-2f5c-4ca8-9e74-d0a9559650a2 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:43.631728 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 513/1037] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:43.633725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-dd6de772-c54b-41c0-9144-75441bf3a208 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:43.633725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:43.633725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:43.633725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:43.633725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:43.633725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:43.633725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:43.633725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:43.633725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:43.633725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:43.633725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:43.633725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:43.633725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:43.633725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:43.633725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:43.633725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:43.634658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:43.634658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:43.634658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:43.634658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:43.634658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:43.634658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:43.634658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:43.634658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:43.634658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:43.634658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:43.634658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:43.634658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:43.634658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:43.634658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:43.634658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:43.634658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:43.634658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:43.635585 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:43.635585 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:43.635585 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:43.637322 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622d06f-2f5c-4ca8-9e74-d0a9559650a2 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:43.639677 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 525/1038] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:43.641051 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6de772-c54b-41c0-9144-75441bf3a208 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:43.750577 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622d06f-2f5c-4ca8-9e74-d0a9559650a2 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:43.758041 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6de772-c54b-41c0-9144-75441bf3a208 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:43.784212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ea4bb-6e39-48f3-9c0d-b00cf2201d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:43.784856 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ea4bb-6e39-48f3-9c0d-b00cf2201d4c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:43.785138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ea4bb-6e39-48f3-9c0d-b00cf2201d4c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:43.785411 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ea4bb-6e39-48f3-9c0d-b00cf2201d4c None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:43.786045 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ea4bb-6e39-48f3-9c0d-b00cf2201d4c None admin] RBAC: Adding query filter params (type=image) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:43.786350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ea4bb-6e39-48f3-9c0d-b00cf2201d4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:43.787715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ea4bb-6e39-48f3-9c0d-b00cf2201d4c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:43.792583 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 514/1039] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:43.793290 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ea4bb-6e39-48f3-9c0d-b00cf2201d4c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:43.801762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53310e80-cd80-48f4-897e-d4e79fa49079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:43.802637 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53310e80-cd80-48f4-897e-d4e79fa49079 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:43.803054 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53310e80-cd80-48f4-897e-d4e79fa49079 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:43.803475 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53310e80-cd80-48f4-897e-d4e79fa49079 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:43.804528 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53310e80-cd80-48f4-897e-d4e79fa49079 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:43.804894 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53310e80-cd80-48f4-897e-d4e79fa49079 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:43.806258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53310e80-cd80-48f4-897e-d4e79fa49079 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:43.818685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 526/1040] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:43.819642 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53310e80-cd80-48f4-897e-d4e79fa49079 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:43.846386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:43.851440 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:43.899941 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ea4bb-6e39-48f3-9c0d-b00cf2201d4c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:43.917745 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53310e80-cd80-48f4-897e-d4e79fa49079 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:43.934025 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf46ca-71e5-473b-ad56-29fa8ebd98a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:43.934654 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf46ca-71e5-473b-ad56-29fa8ebd98a1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:43.934930 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf46ca-71e5-473b-ad56-29fa8ebd98a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:43.935208 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf46ca-71e5-473b-ad56-29fa8ebd98a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:43.936316 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf46ca-71e5-473b-ad56-29fa8ebd98a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:43.938797 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf46ca-71e5-473b-ad56-29fa8ebd98a1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:43.940372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 515/1041] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:43.941167 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf46ca-71e5-473b-ad56-29fa8ebd98a1 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:43.951275 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74915b2e-b01f-460e-b142-7e52970caf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:43.951882 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74915b2e-b01f-460e-b142-7e52970caf41 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:43.952177 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74915b2e-b01f-460e-b142-7e52970caf41 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:43.952985 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74915b2e-b01f-460e-b142-7e52970caf41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:43.953640 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74915b2e-b01f-460e-b142-7e52970caf41 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:43.954981 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74915b2e-b01f-460e-b142-7e52970caf41 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:43.974132 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 527/1042] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:34:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:34:43.974835 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74915b2e-b01f-460e-b142-7e52970caf41 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:44.067091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf46ca-71e5-473b-ad56-29fa8ebd98a1 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:44.082513 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:44.091854 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:44.110920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74915b2e-b01f-460e-b142-7e52970caf41 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:44.111929 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b671264-24e7-41a0-940c-bfa8579e0db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:44.112829 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b671264-24e7-41a0-940c-bfa8579e0db7 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:44.113118 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b671264-24e7-41a0-940c-bfa8579e0db7 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:44.114393 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b671264-24e7-41a0-940c-bfa8579e0db7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:44.125776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b671264-24e7-41a0-940c-bfa8579e0db7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:44.128076 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b671264-24e7-41a0-940c-bfa8579e0db7 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:44.142297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-1b671264-24e7-41a0-940c-bfa8579e0db7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 10:34:44.142297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:44.142297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:44.142297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:44.142297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:44.142297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:44.142297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:44.142297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:44.142297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:44.142297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:44.142297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:44.142297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:44.142297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:34:44.142297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:34:44.142297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:34:44.142297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:34:44.143419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:44.143419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:44.143419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:34:44.143419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:44.143419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:34:44.143419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:44.143419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:44.143419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:44.143419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:44.143419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:44.143419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:44.143419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:44.143419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:44.143419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:44.143419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:44.143419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:44.143419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:44.143419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:44.144369 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:44.144369 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:44.144369 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:34:44.144369 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:34:44.144369 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:34:44.144369 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:34:44.144369 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:34:44.144369 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:34:44.144369 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 10:34:44.144369 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:44.144369 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 516/1043] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Sep 11 10:34:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:44.149506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b671264-24e7-41a0-940c-bfa8579e0db7 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:44.150143 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee719b-b919-4900-aa99-9e2f7ed3e401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:44.150766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee719b-b919-4900-aa99-9e2f7ed3e401 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:44.151044 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee719b-b919-4900-aa99-9e2f7ed3e401 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:44.151367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee719b-b919-4900-aa99-9e2f7ed3e401 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:44.152085 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee719b-b919-4900-aa99-9e2f7ed3e401 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:44.154637 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee719b-b919-4900-aa99-9e2f7ed3e401 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:44.179654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 528/1044] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 10:34:43 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:34:44.266299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b671264-24e7-41a0-940c-bfa8579e0db7 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:44.303068 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b406a87-a0d8-4332-bb64-c1a7bf33057b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:44.303687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b406a87-a0d8-4332-bb64-c1a7bf33057b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:44.303960 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b406a87-a0d8-4332-bb64-c1a7bf33057b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:44.304229 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b406a87-a0d8-4332-bb64-c1a7bf33057b None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:44.305010 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b406a87-a0d8-4332-bb64-c1a7bf33057b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:44.305381 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b406a87-a0d8-4332-bb64-c1a7bf33057b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:44.306890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b406a87-a0d8-4332-bb64-c1a7bf33057b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:44.331208 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 517/1045] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Sep 11 10:34:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:44.333111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee719b-b919-4900-aa99-9e2f7ed3e401 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:44.439535 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee719b-b919-4900-aa99-9e2f7ed3e401 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:44.474918 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb438a9-5274-462b-a7ee-501a57d86889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:44.475534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb438a9-5274-462b-a7ee-501a57d86889 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:44.475814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb438a9-5274-462b-a7ee-501a57d86889 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:44.476089 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb438a9-5274-462b-a7ee-501a57d86889 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:44.480431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:44.547217 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb438a9-5274-462b-a7ee-501a57d86889 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:44.548586 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb438a9-5274-462b-a7ee-501a57d86889 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:44.645884 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 529/1046] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:34:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 10:34:44.651508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b406a87-a0d8-4332-bb64-c1a7bf33057b None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:44.691847 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:44.759973 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b406a87-a0d8-4332-bb64-c1a7bf33057b None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:44.794472 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a4daa-36a0-40e8-8cf2-a827e2c02ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:44.795104 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a4daa-36a0-40e8-8cf2-a827e2c02ced None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:44.795431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a4daa-36a0-40e8-8cf2-a827e2c02ced None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:44.795706 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a4daa-36a0-40e8-8cf2-a827e2c02ced None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:44.805855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a4daa-36a0-40e8-8cf2-a827e2c02ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:44.807306 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a4daa-36a0-40e8-8cf2-a827e2c02ced None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:44.821555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-5a5a4daa-36a0-40e8-8cf2-a827e2c02ced None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:44.821555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:44.821555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:44.821555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:44.821555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:44.821555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:44.821555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:44.821555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:44.821555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:44.821555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:44.821555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:44.821555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:44.821555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:44.821555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:44.821555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:44.821555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:44.822508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:44.822508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:44.822508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:44.822508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:44.822508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:44.822508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:44.822508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:44.822508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:44.822508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:44.822508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:44.822508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:44.822508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:44.822508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:44.822508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:44.822508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:44.822508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:44.822508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:44.823398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:44.823398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:44.823398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:44.827894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 518/1047] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:44.829358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb438a9-5274-462b-a7ee-501a57d86889 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:44.863988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:44.933696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb438a9-5274-462b-a7ee-501a57d86889 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:44.967609 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a8704-dbd7-44b6-92b5-510d1a0843d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:44.969132 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a8704-dbd7-44b6-92b5-510d1a0843d5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:44.969586 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a8704-dbd7-44b6-92b5-510d1a0843d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:44.970031 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a8704-dbd7-44b6-92b5-510d1a0843d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:44.970865 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a8704-dbd7-44b6-92b5-510d1a0843d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:44.971606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a8704-dbd7-44b6-92b5-510d1a0843d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:44.973149 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a8704-dbd7-44b6-92b5-510d1a0843d5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:44.984820 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 530/1048] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:44.990669 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a4daa-36a0-40e8-8cf2-a827e2c02ced None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:45.083037 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:45.094182 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a4daa-36a0-40e8-8cf2-a827e2c02ced None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:45.129157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d5f5a-ca7a-4a55-837f-28f3042f18ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:45.129816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d5f5a-ca7a-4a55-837f-28f3042f18ea None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:45.130096 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d5f5a-ca7a-4a55-837f-28f3042f18ea None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:45.130369 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d5f5a-ca7a-4a55-837f-28f3042f18ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:45.138063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d5f5a-ca7a-4a55-837f-28f3042f18ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:45.139535 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d5f5a-ca7a-4a55-837f-28f3042f18ea None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:45.151274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-e37d5f5a-ca7a-4a55-837f-28f3042f18ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:45.151274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:45.151274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:45.151274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:45.151274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:45.151274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:45.151274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:45.151274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:45.151274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:45.151274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:45.151274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:45.151274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:45.151274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:34:45.151274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:34:45.151274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:34:45.152169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:34:45.152169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:45.152169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:45.152169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:45.152169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:45.152169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:45.152169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:45.152169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:45.152169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:45.152169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:45.152169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:45.152169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:45.152169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:45.152169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:45.152169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:45.152169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:45.152169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:45.153092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:34:45.153092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:34:45.153092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:34:45.153092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:34:45.153092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:34:45.153092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:34:45.153092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:45.153092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:45.156701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 519/1049] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:34:45.158977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a8704-dbd7-44b6-92b5-510d1a0843d5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:45.257685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:45.264133 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a8704-dbd7-44b6-92b5-510d1a0843d5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:45.298048 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e809cab-abe0-4415-9642-72a10a44f3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:45.298643 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e809cab-abe0-4415-9642-72a10a44f3ab None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:45.298916 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e809cab-abe0-4415-9642-72a10a44f3ab None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:45.299180 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e809cab-abe0-4415-9642-72a10a44f3ab None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:45.299863 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e809cab-abe0-4415-9642-72a10a44f3ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:45.300163 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e809cab-abe0-4415-9642-72a10a44f3ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:45.301601 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e809cab-abe0-4415-9642-72a10a44f3ab None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:45.316633 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 531/1050] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:34:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:45.319849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d5f5a-ca7a-4a55-837f-28f3042f18ea None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:45.419598 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d5f5a-ca7a-4a55-837f-28f3042f18ea None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:45.455351 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539a258-3665-480d-ae98-3b89dd746d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:45.455939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539a258-3665-480d-ae98-3b89dd746d38 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:45.456028 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539a258-3665-480d-ae98-3b89dd746d38 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:45.456292 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539a258-3665-480d-ae98-3b89dd746d38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:45.457178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539a258-3665-480d-ae98-3b89dd746d38 None admin] RBAC: Adding query filter params (role.id=8896f3c145b84c85a4ddf8a6b17422b2, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=b642a1d00de940429fc1cc6131ac22b1) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:45.457486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539a258-3665-480d-ae98-3b89dd746d38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:45.458894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539a258-3665-480d-ae98-3b89dd746d38 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:45.464458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 520/1051] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:34:45 2022] GET /identity/v3/role_assignments?user.id=b642a1d00de940429fc1cc6131ac22b1&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=8896f3c145b84c85a4ddf8a6b17422b2 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:46.191656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c3a65-6964-48b6-901f-2318d6beed21 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:46.192175 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c3a65-6964-48b6-901f-2318d6beed21 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:46.192175 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c3a65-6964-48b6-901f-2318d6beed21 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:46.193736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 532/1052] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:46.198727 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bb3f0-ce2f-4542-bae6-94ed2863c090 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:46.199147 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bb3f0-ce2f-4542-bae6-94ed2863c090 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:46.199330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bb3f0-ce2f-4542-bae6-94ed2863c090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:46.218605 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-829bb3f0-ce2f-4542-bae6-94ed2863c090 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:46.219796 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-829bb3f0-ce2f-4542-bae6-94ed2863c090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:46.229457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:46.288949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 521/1053] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:46.447226 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576076f6-fe60-4b5f-bdba-0b4cf624a047 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:46.447519 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576076f6-fe60-4b5f-bdba-0b4cf624a047 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:46.447695 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576076f6-fe60-4b5f-bdba-0b4cf624a047 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:46.449215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 533/1054] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:46.454892 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95313a66-ff5d-4515-999e-dd17ef8a42cb None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:46.455182 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95313a66-ff5d-4515-999e-dd17ef8a42cb None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:46.455457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95313a66-ff5d-4515-999e-dd17ef8a42cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:46.473908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-95313a66-ff5d-4515-999e-dd17ef8a42cb None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:46.475090 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-95313a66-ff5d-4515-999e-dd17ef8a42cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:46.542841 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 522/1055] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:46.565378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576076f6-fe60-4b5f-bdba-0b4cf624a047 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:46.668092 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576076f6-fe60-4b5f-bdba-0b4cf624a047 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:46.703413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215f5f9-80e4-4df9-bf0a-7de020fad9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:46.703942 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215f5f9-80e4-4df9-bf0a-7de020fad9fd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:46.704220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215f5f9-80e4-4df9-bf0a-7de020fad9fd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:46.704492 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215f5f9-80e4-4df9-bf0a-7de020fad9fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:46.736898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:46.780612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215f5f9-80e4-4df9-bf0a-7de020fad9fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:46.782376 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215f5f9-80e4-4df9-bf0a-7de020fad9fd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:46.810970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95313a66-ff5d-4515-999e-dd17ef8a42cb None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:46.888390 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:46.890741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 534/1056] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:34:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 10:34:46.896077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215f5f9-80e4-4df9-bf0a-7de020fad9fd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:46.918491 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95313a66-ff5d-4515-999e-dd17ef8a42cb None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:46.956691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:46.962791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be1c58-d290-462b-9373-80633666efdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:46.963481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be1c58-d290-462b-9373-80633666efdb None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:46.963766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be1c58-d290-462b-9373-80633666efdb None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:46.964045 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be1c58-d290-462b-9373-80633666efdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:46.975505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be1c58-d290-462b-9373-80633666efdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:34:46.980317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-30be1c58-d290-462b-9373-80633666efdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:34:46.980317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:46.980317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:46.980317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:46.980317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:46.980317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:46.980317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:46.980317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:46.980317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:46.980317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:46.980317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:46.980317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:46.980317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:34:46.980317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:34:46.980317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:34:46.980317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:34:46.981286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:34:46.981286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:34:46.981286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:34:46.981286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:34:46.981286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:46.981286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:46.981286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:46.981286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:46.981286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:46.981286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:46.981286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:46.981286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:46.981286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:46.981286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:46.981286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:46.981286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:46.982132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:46.982132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:46.982132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:46.982132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:46.982132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:34:46.982132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:34:46.982132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:34:46.982132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:34:46.982132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:34:46.982132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:34:46.982132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:34:46.982132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:46.982132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 523/1057] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:34:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:46.987983 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be1c58-d290-462b-9373-80633666efdb None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:47.007216 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215f5f9-80e4-4df9-bf0a-7de020fad9fd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:47.041565 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688b19a-0f12-40a1-876d-518d234bcf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:47.042495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688b19a-0f12-40a1-876d-518d234bcf73 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:47.042954 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688b19a-0f12-40a1-876d-518d234bcf73 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:47.043413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688b19a-0f12-40a1-876d-518d234bcf73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:47.054573 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688b19a-0f12-40a1-876d-518d234bcf73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:47.056206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688b19a-0f12-40a1-876d-518d234bcf73 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:47.072612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-4688b19a-0f12-40a1-876d-518d234bcf73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:47.072612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:47.072612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:47.072612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:47.072612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:47.072612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:47.072612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:47.072612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:47.072612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:47.072612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:47.072612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:47.072612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:47.072612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:47.072612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:47.072612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:47.072612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:47.073713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:47.073713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:47.073713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:47.073713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:47.073713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:47.073713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:47.073713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:47.073713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:47.073713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:47.073713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:47.073713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:47.073713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:47.073713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:47.073713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:47.073713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:47.073713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:47.073713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:47.074841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:47.074841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:47.074841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:47.076763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 535/1058] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:34:47.082560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688b19a-0f12-40a1-876d-518d234bcf73 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:47.099488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be1c58-d290-462b-9373-80633666efdb None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:47.140671 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad0fd6-df8d-444f-867c-7f72ec6b1e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:47.141439 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad0fd6-df8d-444f-867c-7f72ec6b1e7c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:47.141749 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad0fd6-df8d-444f-867c-7f72ec6b1e7c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:47.142063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad0fd6-df8d-444f-867c-7f72ec6b1e7c None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:47.142742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad0fd6-df8d-444f-867c-7f72ec6b1e7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:47.143078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad0fd6-df8d-444f-867c-7f72ec6b1e7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:47.144517 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad0fd6-df8d-444f-867c-7f72ec6b1e7c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:47.146179 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:47.156128 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 524/1059] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:34:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:47.161559 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad0fd6-df8d-444f-867c-7f72ec6b1e7c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:47.196029 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688b19a-0f12-40a1-876d-518d234bcf73 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:47.207521 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:47.232485 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b517c18-1aed-46cc-821a-11d45334cfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:47.233216 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b517c18-1aed-46cc-821a-11d45334cfa2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:47.233525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b517c18-1aed-46cc-821a-11d45334cfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:47.233803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b517c18-1aed-46cc-821a-11d45334cfa2 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:47.234446 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b517c18-1aed-46cc-821a-11d45334cfa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:47.234751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b517c18-1aed-46cc-821a-11d45334cfa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:47.236108 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b517c18-1aed-46cc-821a-11d45334cfa2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:47.258991 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 536/1060] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:47.277544 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad0fd6-df8d-444f-867c-7f72ec6b1e7c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:47.316048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0fc6b-883f-42c1-bd55-22c97b872cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:47.316730 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0fc6b-883f-42c1-bd55-22c97b872cbb None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:47.317014 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0fc6b-883f-42c1-bd55-22c97b872cbb None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:47.317292 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0fc6b-883f-42c1-bd55-22c97b872cbb None admin] PATH_INFO: `/v3/users/1643080bc5214b99b739bc82a0ed9587` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:47.332787 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0fc6b-883f-42c1-bd55-22c97b872cbb None admin] RBAC: Authorizing `identity:get_user(user_id=1643080bc5214b99b739bc82a0ed9587)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:47.334262 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0fc6b-883f-42c1-bd55-22c97b872cbb None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:47.336096 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 525/1061] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:34:47 2022] GET /identity/v3/users/1643080bc5214b99b739bc82a0ed9587 => generated 285 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:47.341967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b517c18-1aed-46cc-821a-11d45334cfa2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:47.453938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b517c18-1aed-46cc-821a-11d45334cfa2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:47.489174 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62bb53-0844-47af-85bf-6b951004febe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:47.489722 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62bb53-0844-47af-85bf-6b951004febe None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:47.490001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62bb53-0844-47af-85bf-6b951004febe None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:47.490274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62bb53-0844-47af-85bf-6b951004febe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:47.531268 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:47.565649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62bb53-0844-47af-85bf-6b951004febe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:47.567317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62bb53-0844-47af-85bf-6b951004febe None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:47.620818 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3759e-d27b-4af3-8f57-334e5d41d988 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:47.621107 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3759e-d27b-4af3-8f57-334e5d41d988 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:47.621385 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3759e-d27b-4af3-8f57-334e5d41d988 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:47.622736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 526/1062] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:34:47.628341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0b264-97b5-4855-8063-8129ee39df1f None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:47.628650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0b264-97b5-4855-8063-8129ee39df1f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:47.628925 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0b264-97b5-4855-8063-8129ee39df1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:47.646303 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-98e0b264-97b5-4855-8063-8129ee39df1f None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:47.647475 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-98e0b264-97b5-4855-8063-8129ee39df1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:47.670608 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 537/1063] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:34:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 10:34:47.677993 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62bb53-0844-47af-85bf-6b951004febe None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:47.698318 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:47.719096 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 527/1064] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:47.745820 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:47.777644 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62bb53-0844-47af-85bf-6b951004febe None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:47.809550 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678968b0-1b0b-42b9-b0de-a9ea03f6c032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:47.810166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678968b0-1b0b-42b9-b0de-a9ea03f6c032 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:47.810438 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678968b0-1b0b-42b9-b0de-a9ea03f6c032 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:47.810704 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678968b0-1b0b-42b9-b0de-a9ea03f6c032 None admin] PATH_INFO: `/v3/projects/2d6e17a99e4c4d0e9a353450e8a8b5b9` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:47.812365 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678968b0-1b0b-42b9-b0de-a9ea03f6c032 None admin] RBAC: Authorizing `identity:get_project(project_id=2d6e17a99e4c4d0e9a353450e8a8b5b9)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:47.813807 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678968b0-1b0b-42b9-b0de-a9ea03f6c032 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:47.815573 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 538/1065] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:34:47 2022] GET /identity/v3/projects/2d6e17a99e4c4d0e9a353450e8a8b5b9 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:47.821611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0b264-97b5-4855-8063-8129ee39df1f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:47.917301 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0b264-97b5-4855-8063-8129ee39df1f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:47.950674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c9be0-5303-447c-8512-03a4b08468a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:47.951271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c9be0-5303-447c-8512-03a4b08468a6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:47.951548 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c9be0-5303-447c-8512-03a4b08468a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:47.951819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c9be0-5303-447c-8512-03a4b08468a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:47.953145 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c9be0-5303-447c-8512-03a4b08468a6 None admin] RBAC: Adding query filter params (role.id=529cb3511f3a498b9b7169ed5b0f6b8e, scope.project.id=2d6e17a99e4c4d0e9a353450e8a8b5b9, user.id=1643080bc5214b99b739bc82a0ed9587) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:47.953453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c9be0-5303-447c-8512-03a4b08468a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:47.954870 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c9be0-5303-447c-8512-03a4b08468a6 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:47.960106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 528/1066] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:34:47 2022] GET /identity/v3/role_assignments?user.id=1643080bc5214b99b739bc82a0ed9587&scope.project.id=2d6e17a99e4c4d0e9a353450e8a8b5b9&role.id=529cb3511f3a498b9b7169ed5b0f6b8e => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:47.997603 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678968b0-1b0b-42b9-b0de-a9ea03f6c032 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:48.101312 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678968b0-1b0b-42b9-b0de-a9ea03f6c032 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:48.136267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1eb68-985d-42d4-8ea5-a53e8b188028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:48.136920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1eb68-985d-42d4-8ea5-a53e8b188028 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:48.137195 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1eb68-985d-42d4-8ea5-a53e8b188028 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:48.137461 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1eb68-985d-42d4-8ea5-a53e8b188028 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:48.140038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:48.148655 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1eb68-985d-42d4-8ea5-a53e8b188028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:34:48.153413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-19d1eb68-985d-42d4-8ea5-a53e8b188028 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 10:34:48.153413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:48.153413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:48.153413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:48.153413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:48.153413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:48.153413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:48.153413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:48.153413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:48.153413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:48.153413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:48.153413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:48.153413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:34:48.153413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:34:48.153413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:34:48.153413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:34:48.154419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:34:48.154419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:34:48.154419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:34:48.154419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:34:48.154419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:48.154419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:48.154419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:48.154419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:48.154419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:48.154419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:48.154419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:48.154419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:48.154419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:48.154419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:48.154419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:48.154419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:48.155249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:48.155249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:48.155249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:48.155249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:48.155249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:34:48.155249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:34:48.155249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:34:48.155249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:34:48.155249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:34:48.155249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:34:48.155249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 10:34:48.155249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:48.155249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 539/1067] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Sep 11 10:34:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:48.161262 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c9be0-5303-447c-8512-03a4b08468a6 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:48.209551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:48.261125 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c9be0-5303-447c-8512-03a4b08468a6 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:48.295268 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a514e2c-f64b-4e4d-86f8-e744ba1959a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:48.295864 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a514e2c-f64b-4e4d-86f8-e744ba1959a6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:48.296163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a514e2c-f64b-4e4d-86f8-e744ba1959a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:48.296432 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a514e2c-f64b-4e4d-86f8-e744ba1959a6 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:48.297124 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a514e2c-f64b-4e4d-86f8-e744ba1959a6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:48.297427 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a514e2c-f64b-4e4d-86f8-e744ba1959a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:48.298778 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a514e2c-f64b-4e4d-86f8-e744ba1959a6 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:48.306875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 529/1068] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Sep 11 10:34:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:48.312584 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1eb68-985d-42d4-8ea5-a53e8b188028 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:48.408764 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1eb68-985d-42d4-8ea5-a53e8b188028 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:48.441538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd78be6-832e-4523-8198-59280943d258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:48.442161 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd78be6-832e-4523-8198-59280943d258 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:48.442438 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd78be6-832e-4523-8198-59280943d258 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:48.442706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd78be6-832e-4523-8198-59280943d258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:48.452832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd78be6-832e-4523-8198-59280943d258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:48.454257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd78be6-832e-4523-8198-59280943d258 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:48.468923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ddd78be6-832e-4523-8198-59280943d258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:48.468923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:48.468923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:48.468923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:48.468923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:48.468923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:48.468923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:48.468923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:48.468923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:48.468923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:48.468923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:48.468923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:48.468923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:48.468923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:48.468923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:48.468923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:48.469935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:48.469935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:48.469935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:48.469935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:48.469935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:48.469935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:48.469935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:48.469935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:48.469935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:48.469935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:48.469935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:48.469935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:48.469935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:48.469935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:48.469935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:48.469935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:48.469935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:48.476000 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:48.476000 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:48.476000 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:48.476000 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 540/1069] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:48.476278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a514e2c-f64b-4e4d-86f8-e744ba1959a6 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:48.573097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a514e2c-f64b-4e4d-86f8-e744ba1959a6 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:48.583172 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:48.606867 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6571b-7032-4593-a9bf-f026e054b4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:48.607475 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6571b-7032-4593-a9bf-f026e054b4b1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:48.607756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6571b-7032-4593-a9bf-f026e054b4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:48.608032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6571b-7032-4593-a9bf-f026e054b4b1 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:48.609205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6571b-7032-4593-a9bf-f026e054b4b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:48.609513 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6571b-7032-4593-a9bf-f026e054b4b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:48.610878 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6571b-7032-4593-a9bf-f026e054b4b1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:48.622526 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 530/1070] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:48.628760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd78be6-832e-4523-8198-59280943d258 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:48.676812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:48.733019 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd78be6-832e-4523-8198-59280943d258 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:48.765426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b431eec-141f-48a1-ae9e-51823c9c0e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:48.766048 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b431eec-141f-48a1-ae9e-51823c9c0e43 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:48.766326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b431eec-141f-48a1-ae9e-51823c9c0e43 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:48.766604 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b431eec-141f-48a1-ae9e-51823c9c0e43 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:48.773679 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b431eec-141f-48a1-ae9e-51823c9c0e43 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:48.775092 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b431eec-141f-48a1-ae9e-51823c9c0e43 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:48.786435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-8b431eec-141f-48a1-ae9e-51823c9c0e43 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 10:34:48.786435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:48.786435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:48.786435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:48.786435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:48.786435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:48.786435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:48.786435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:48.786435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:48.786435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:48.786435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:48.786435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:48.786435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:34:48.786435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:34:48.786435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:34:48.786435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:34:48.787567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:48.787567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:48.787567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:34:48.787567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:48.787567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:34:48.787567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:48.787567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:48.787567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:48.787567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:48.787567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:48.787567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:48.787567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:48.787567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:48.787567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:48.787567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:48.787567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:48.787567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:48.787567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:48.788599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:48.788599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:48.788599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:34:48.788599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:34:48.788599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:34:48.788599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:34:48.788599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:34:48.788599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:34:48.788599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 10:34:48.788599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:48.788599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 541/1071] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Sep 11 10:34:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:48.793329 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6571b-7032-4593-a9bf-f026e054b4b1 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:48.893208 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6571b-7032-4593-a9bf-f026e054b4b1 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:48.927463 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42066f99-38f9-4a62-8f01-afd2429f4156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:48.928101 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42066f99-38f9-4a62-8f01-afd2429f4156 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:48.928418 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42066f99-38f9-4a62-8f01-afd2429f4156 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:48.928758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42066f99-38f9-4a62-8f01-afd2429f4156 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:48.929514 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42066f99-38f9-4a62-8f01-afd2429f4156 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:48.929854 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42066f99-38f9-4a62-8f01-afd2429f4156 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:48.931303 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42066f99-38f9-4a62-8f01-afd2429f4156 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:48.948260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 531/1072] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Sep 11 10:34:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:48.954666 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b431eec-141f-48a1-ae9e-51823c9c0e43 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:49.050900 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b431eec-141f-48a1-ae9e-51823c9c0e43 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:49.059452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:49.083591 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646318c5-19b3-49db-b9cd-c661f18fb012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:49.084210 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646318c5-19b3-49db-b9cd-c661f18fb012 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:49.084488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646318c5-19b3-49db-b9cd-c661f18fb012 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:49.084787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646318c5-19b3-49db-b9cd-c661f18fb012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:49.094928 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646318c5-19b3-49db-b9cd-c661f18fb012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:49.096647 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646318c5-19b3-49db-b9cd-c661f18fb012 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:49.110748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-646318c5-19b3-49db-b9cd-c661f18fb012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:49.110748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:49.110748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:49.110748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:49.110748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:49.110748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:49.110748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:49.110748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:49.110748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:49.110748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:49.110748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:49.110748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:49.110748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:49.110748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:49.110748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:49.110748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:49.111828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:49.111828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:49.111828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:49.111828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:49.111828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:49.111828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:49.111828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:49.111828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:49.111828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:49.111828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:49.111828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:49.111828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:49.111828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:49.111828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:49.111828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:49.111828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:49.111828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:49.113159 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:49.113159 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:49.113159 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:49.113159 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 542/1073] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:49.117589 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42066f99-38f9-4a62-8f01-afd2429f4156 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:49.146276 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:49.216092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42066f99-38f9-4a62-8f01-afd2429f4156 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:49.250097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747275a-6a10-44df-a15b-6e87a70a3b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:49.250693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747275a-6a10-44df-a15b-6e87a70a3b9f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:49.250964 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747275a-6a10-44df-a15b-6e87a70a3b9f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:49.251229 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747275a-6a10-44df-a15b-6e87a70a3b9f None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:49.251862 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747275a-6a10-44df-a15b-6e87a70a3b9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:49.252159 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747275a-6a10-44df-a15b-6e87a70a3b9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:49.253547 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747275a-6a10-44df-a15b-6e87a70a3b9f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:49.264391 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 532/1074] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:49.270568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646318c5-19b3-49db-b9cd-c661f18fb012 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:49.366751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646318c5-19b3-49db-b9cd-c661f18fb012 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:49.398952 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc39d0-3e39-451c-96a9-5995fe23f8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:49.399511 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc39d0-3e39-451c-96a9-5995fe23f8f4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:49.399787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc39d0-3e39-451c-96a9-5995fe23f8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:49.400058 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc39d0-3e39-451c-96a9-5995fe23f8f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:49.406974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc39d0-3e39-451c-96a9-5995fe23f8f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:49.408380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc39d0-3e39-451c-96a9-5995fe23f8f4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:49.419243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-fdbc39d0-3e39-451c-96a9-5995fe23f8f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:49.419243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:49.419243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:49.419243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:49.419243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:49.419243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:49.419243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:49.419243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:49.419243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:49.419243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:49.419243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:49.419243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:49.419243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:34:49.419243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:34:49.419243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:34:49.420156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:34:49.420156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:49.420156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:49.420156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:49.420156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:49.420156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:49.420156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:49.420156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:49.420156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:49.420156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:49.420156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:49.420156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:49.420156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:49.420156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:49.420156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:49.420156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:49.420156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:49.421166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:34:49.421166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:34:49.421166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:34:49.421166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:34:49.421166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:34:49.421166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:34:49.421166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:49.421166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:49.421166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 543/1075] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:49.426110 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747275a-6a10-44df-a15b-6e87a70a3b9f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:49.512774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:49.525399 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747275a-6a10-44df-a15b-6e87a70a3b9f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:49.557544 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09772a-24ee-4ce4-ac9a-ff5c9984999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:49.558139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09772a-24ee-4ce4-ac9a-ff5c9984999a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:49.558418 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09772a-24ee-4ce4-ac9a-ff5c9984999a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:49.558690 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09772a-24ee-4ce4-ac9a-ff5c9984999a None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:49.559377 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09772a-24ee-4ce4-ac9a-ff5c9984999a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:49.559680 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09772a-24ee-4ce4-ac9a-ff5c9984999a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:49.561132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09772a-24ee-4ce4-ac9a-ff5c9984999a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:49.573283 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 533/1076] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:34:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:49.580153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc39d0-3e39-451c-96a9-5995fe23f8f4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:49.601845 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:49.678903 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc39d0-3e39-451c-96a9-5995fe23f8f4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:49.716314 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec916d-bba7-4d0b-a038-7c41cc25ec6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:49.717008 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec916d-bba7-4d0b-a038-7c41cc25ec6d None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:49.717288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec916d-bba7-4d0b-a038-7c41cc25ec6d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:49.717559 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec916d-bba7-4d0b-a038-7c41cc25ec6d None admin] PATH_INFO: `/v3/projects/cd477d464e9f48149879362d04db9b9e/users/b642a1d00de940429fc1cc6131ac22b1/roles/8896f3c145b84c85a4ddf8a6b17422b2` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:49.720152 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec916d-bba7-4d0b-a038-7c41cc25ec6d None admin] RBAC: Authorizing `identity:create_grant(project_id=cd477d464e9f48149879362d04db9b9e, user_id=b642a1d00de940429fc1cc6131ac22b1, role_id=8896f3c145b84c85a4ddf8a6b17422b2)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:49.721849 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec916d-bba7-4d0b-a038-7c41cc25ec6d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:49.736064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 544/1077] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:34:49 2022] PUT /identity/v3/projects/cd477d464e9f48149879362d04db9b9e/users/b642a1d00de940429fc1cc6131ac22b1/roles/8896f3c145b84c85a4ddf8a6b17422b2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:34:50.079213 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa40068-066c-4975-bb83-477ee6deb972 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:50.079498 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa40068-066c-4975-bb83-477ee6deb972 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:50.079772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa40068-066c-4975-bb83-477ee6deb972 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:50.081222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 534/1078] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:50.086447 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca8a08-81ed-41bb-9f96-094f8eb3988a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:50.086730 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca8a08-81ed-41bb-9f96-094f8eb3988a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:50.087002 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca8a08-81ed-41bb-9f96-094f8eb3988a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:50.105577 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-13ca8a08-81ed-41bb-9f96-094f8eb3988a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:50.106754 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-13ca8a08-81ed-41bb-9f96-094f8eb3988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:50.170174 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 545/1079] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:50.437877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa40068-066c-4975-bb83-477ee6deb972 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:50.536758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa40068-066c-4975-bb83-477ee6deb972 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:50.569197 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862872da-6bc8-4286-a4ca-8d3a6f74291d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:50.569829 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862872da-6bc8-4286-a4ca-8d3a6f74291d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:50.570107 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862872da-6bc8-4286-a4ca-8d3a6f74291d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:50.570379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862872da-6bc8-4286-a4ca-8d3a6f74291d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:50.581916 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862872da-6bc8-4286-a4ca-8d3a6f74291d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:34:50.586934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-862872da-6bc8-4286-a4ca-8d3a6f74291d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:34:50.586934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:50.586934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:50.586934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:50.586934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:50.586934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:50.586934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:50.586934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:50.586934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:50.586934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:50.586934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:50.586934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:50.586934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:34:50.586934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:34:50.586934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:34:50.586934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:34:50.588111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:34:50.588111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:34:50.588111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:34:50.588111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:34:50.588111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:50.588111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:50.588111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:50.588111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:50.588111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:50.588111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:50.588111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:50.588111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:50.588111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:50.588111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:50.588111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:50.588111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:50.589275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:50.589275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:50.589275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:50.589275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:50.589275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:34:50.589275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:34:50.589275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:34:50.589275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:34:50.589275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:34:50.589275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:34:50.589275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:34:50.589275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:50.589275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 535/1080] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:34:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:50.594872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca8a08-81ed-41bb-9f96-094f8eb3988a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:50.606514 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:50.692259 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca8a08-81ed-41bb-9f96-094f8eb3988a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:50.729832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ec35c-9d3a-4af8-9ecd-387ee7be7c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:50.730431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ec35c-9d3a-4af8-9ecd-387ee7be7c47 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:50.730705 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ec35c-9d3a-4af8-9ecd-387ee7be7c47 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:50.730970 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ec35c-9d3a-4af8-9ecd-387ee7be7c47 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:50.731621 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ec35c-9d3a-4af8-9ecd-387ee7be7c47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:50.731923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ec35c-9d3a-4af8-9ecd-387ee7be7c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:50.733802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ec35c-9d3a-4af8-9ecd-387ee7be7c47 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:50.741668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 546/1081] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:34:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:50.747360 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862872da-6bc8-4286-a4ca-8d3a6f74291d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:50.758988 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:50.844825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862872da-6bc8-4286-a4ca-8d3a6f74291d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:50.878158 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35032778-e3da-4260-b71a-396fc6418e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:50.878774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35032778-e3da-4260-b71a-396fc6418e28 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:50.879048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35032778-e3da-4260-b71a-396fc6418e28 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:50.879319 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35032778-e3da-4260-b71a-396fc6418e28 None admin] PATH_INFO: `/v3/users/1643080bc5214b99b739bc82a0ed9587` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:50.880420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35032778-e3da-4260-b71a-396fc6418e28 None admin] RBAC: Authorizing `identity:get_user(user_id=1643080bc5214b99b739bc82a0ed9587)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:50.881874 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35032778-e3da-4260-b71a-396fc6418e28 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:50.883587 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 536/1082] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:34:50 2022] GET /identity/v3/users/1643080bc5214b99b739bc82a0ed9587 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:50.889324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ec35c-9d3a-4af8-9ecd-387ee7be7c47 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:50.957615 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:50.986654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ec35c-9d3a-4af8-9ecd-387ee7be7c47 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:51.019411 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8c5ac-05ba-44b3-a4bd-7bccb77a1e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:51.020034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8c5ac-05ba-44b3-a4bd-7bccb77a1e28 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:51.020312 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8c5ac-05ba-44b3-a4bd-7bccb77a1e28 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:51.020609 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8c5ac-05ba-44b3-a4bd-7bccb77a1e28 None admin] PATH_INFO: `/v3/projects/2d6e17a99e4c4d0e9a353450e8a8b5b9` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:51.021714 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8c5ac-05ba-44b3-a4bd-7bccb77a1e28 None admin] RBAC: Authorizing `identity:get_project(project_id=2d6e17a99e4c4d0e9a353450e8a8b5b9)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:51.023129 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8c5ac-05ba-44b3-a4bd-7bccb77a1e28 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:51.024786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 547/1083] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:34:50 2022] GET /identity/v3/projects/2d6e17a99e4c4d0e9a353450e8a8b5b9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:51.030774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35032778-e3da-4260-b71a-396fc6418e28 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:51.105909 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:51.130028 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35032778-e3da-4260-b71a-396fc6418e28 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:51.163310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad217c5-69d1-44a1-b328-6a567bc9f65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:51.163965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad217c5-69d1-44a1-b328-6a567bc9f65c None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:51.164263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad217c5-69d1-44a1-b328-6a567bc9f65c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:51.164524 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad217c5-69d1-44a1-b328-6a567bc9f65c None admin] PATH_INFO: `/v3/projects/2d6e17a99e4c4d0e9a353450e8a8b5b9/users/1643080bc5214b99b739bc82a0ed9587/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:51.166421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad217c5-69d1-44a1-b328-6a567bc9f65c None admin] RBAC: Authorizing `identity:create_grant(project_id=2d6e17a99e4c4d0e9a353450e8a8b5b9, user_id=1643080bc5214b99b739bc82a0ed9587, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:51.167847 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad217c5-69d1-44a1-b328-6a567bc9f65c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:51.180911 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 537/1084] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:34:51 2022] PUT /identity/v3/projects/2d6e17a99e4c4d0e9a353450e8a8b5b9/users/1643080bc5214b99b739bc82a0ed9587/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:34:51.854761 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404530-ccd2-4a57-b8df-5a812abe7f4b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:51.855330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404530-ccd2-4a57-b8df-5a812abe7f4b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:51.855330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404530-ccd2-4a57-b8df-5a812abe7f4b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:51.856685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 548/1085] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:51.862074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea9b84-a2f4-4e91-a6a1-eaac2816d79f None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:51.862527 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea9b84-a2f4-4e91-a6a1-eaac2816d79f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:51.862627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea9b84-a2f4-4e91-a6a1-eaac2816d79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:51.881036 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-f7ea9b84-a2f4-4e91-a6a1-eaac2816d79f None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:51.882205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f7ea9b84-a2f4-4e91-a6a1-eaac2816d79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:51.947152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 538/1086] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 10:34:52.215327 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17404530-ccd2-4a57-b8df-5a812abe7f4b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:52.313171 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17404530-ccd2-4a57-b8df-5a812abe7f4b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:52.345546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1464dc-18e2-49da-a59b-8e0ead1a9c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:52.346412 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1464dc-18e2-49da-a59b-8e0ead1a9c10 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:52.346685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1464dc-18e2-49da-a59b-8e0ead1a9c10 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:52.346951 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1464dc-18e2-49da-a59b-8e0ead1a9c10 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:52.354089 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:52.357824 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1464dc-18e2-49da-a59b-8e0ead1a9c10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:34:52.362751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ed1464dc-18e2-49da-a59b-8e0ead1a9c10 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 10:34:52.362751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:52.362751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:52.362751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:52.362751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:52.362751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:52.362751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:52.362751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:52.362751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:52.362751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:52.362751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:52.362751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:52.362751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:34:52.362751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:34:52.362751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:34:52.362751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:34:52.363813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:34:52.363813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:34:52.363813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:34:52.363813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:34:52.363813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:52.363813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:52.363813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:52.363813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:52.363813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:52.363813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:52.363813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:52.363813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:52.363813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:52.363813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:52.363813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:52.363813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:52.364755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:52.364755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:52.364755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:52.364755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:52.364755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:34:52.364755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:34:52.364755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:34:52.364755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:34:52.364755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:34:52.364755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:34:52.364755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 10:34:52.364755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:52.364755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 549/1087] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Sep 11 10:34:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:52.369964 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea9b84-a2f4-4e91-a6a1-eaac2816d79f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:52.433117 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:52.469050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea9b84-a2f4-4e91-a6a1-eaac2816d79f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:52.502379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96991bce-731b-4d18-b133-c525ac5b758f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:52.502972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991bce-731b-4d18-b133-c525ac5b758f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:52.503246 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991bce-731b-4d18-b133-c525ac5b758f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:52.503511 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991bce-731b-4d18-b133-c525ac5b758f None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:52.504160 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96991bce-731b-4d18-b133-c525ac5b758f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:52.504457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96991bce-731b-4d18-b133-c525ac5b758f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:52.505833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96991bce-731b-4d18-b133-c525ac5b758f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:52.513373 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 539/1088] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Sep 11 10:34:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:52.519188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1464dc-18e2-49da-a59b-8e0ead1a9c10 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:52.613351 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1464dc-18e2-49da-a59b-8e0ead1a9c10 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:52.644901 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626ea1a-3a8d-4c0e-8a08-35d5f2fdd811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:52.645510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626ea1a-3a8d-4c0e-8a08-35d5f2fdd811 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:52.645784 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626ea1a-3a8d-4c0e-8a08-35d5f2fdd811 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:52.646050 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626ea1a-3a8d-4c0e-8a08-35d5f2fdd811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:52.656416 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626ea1a-3a8d-4c0e-8a08-35d5f2fdd811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:52.657849 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626ea1a-3a8d-4c0e-8a08-35d5f2fdd811 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:52.671796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-7626ea1a-3a8d-4c0e-8a08-35d5f2fdd811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:52.671796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:52.671796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:52.671796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:52.671796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:52.671796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:52.671796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:52.671796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:52.671796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:52.671796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:52.671796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:52.671796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:52.671796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:52.671796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:52.671796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:52.671796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:52.673240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:52.673240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:52.673240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:52.673240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:52.673240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:52.673240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:52.673240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:52.673240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:52.673240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:52.673240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:52.673240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:52.673240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:52.673240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:52.673240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:52.673240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:52.673240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:52.673240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:52.674456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:52.674456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:52.674456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:52.674456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 550/1089] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:52.678510 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96991bce-731b-4d18-b133-c525ac5b758f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:52.778819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96991bce-731b-4d18-b133-c525ac5b758f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:52.804681 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:52.813667 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9378e21-c78b-4d91-9179-06704d81b36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:52.814270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9378e21-c78b-4d91-9179-06704d81b36d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:52.814575 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9378e21-c78b-4d91-9179-06704d81b36d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:52.814877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9378e21-c78b-4d91-9179-06704d81b36d None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:52.815526 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9378e21-c78b-4d91-9179-06704d81b36d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:52.815828 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9378e21-c78b-4d91-9179-06704d81b36d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:52.817245 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9378e21-c78b-4d91-9179-06704d81b36d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:52.829593 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 540/1090] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:52.835215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626ea1a-3a8d-4c0e-8a08-35d5f2fdd811 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:52.886594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:52.933659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626ea1a-3a8d-4c0e-8a08-35d5f2fdd811 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:52.965951 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77e5f5-8534-43ce-a518-0afe43246413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:52.966580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77e5f5-8534-43ce-a518-0afe43246413 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:52.966855 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77e5f5-8534-43ce-a518-0afe43246413 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:52.967134 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77e5f5-8534-43ce-a518-0afe43246413 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:52.976233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77e5f5-8534-43ce-a518-0afe43246413 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:52.977694 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77e5f5-8534-43ce-a518-0afe43246413 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:52.989060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-5d77e5f5-8534-43ce-a518-0afe43246413 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 10:34:52.989060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:52.989060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:52.989060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:52.989060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:52.989060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:52.989060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:52.989060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:52.989060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:52.989060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:52.989060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:52.989060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:52.989060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:34:52.989060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:34:52.989060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:34:52.989060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:34:52.990140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:52.990140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:52.990140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:34:52.990140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:52.990140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:34:52.990140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:34:52.990140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:52.990140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:52.990140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:52.990140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:52.990140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:52.990140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:52.990140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:52.990140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:52.990140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:52.990140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:52.990140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:52.990140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:52.991189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:52.991189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:52.991189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:34:52.991189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:34:52.991189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:34:52.991189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:34:52.991189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:34:52.991189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:34:52.991189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 10:34:52.991189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:52.991189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 551/1091] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Sep 11 10:34:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:34:52.995878 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9378e21-c78b-4d91-9179-06704d81b36d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:53.092368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9378e21-c78b-4d91-9179-06704d81b36d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:53.129987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b895cb-e2e9-4070-91ef-a840987e9bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:53.130594 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b895cb-e2e9-4070-91ef-a840987e9bc1 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:53.130875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b895cb-e2e9-4070-91ef-a840987e9bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:53.131148 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b895cb-e2e9-4070-91ef-a840987e9bc1 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:53.131876 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b895cb-e2e9-4070-91ef-a840987e9bc1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:53.132184 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b895cb-e2e9-4070-91ef-a840987e9bc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:53.133641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b895cb-e2e9-4070-91ef-a840987e9bc1 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:53.150551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 541/1092] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Sep 11 10:34:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:53.156848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77e5f5-8534-43ce-a518-0afe43246413 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:53.258825 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77e5f5-8534-43ce-a518-0afe43246413 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:53.271038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:53.291709 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e733c4-f981-4d43-aa0f-37c9c669b1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:53.292308 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e733c4-f981-4d43-aa0f-37c9c669b1bd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:53.292609 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e733c4-f981-4d43-aa0f-37c9c669b1bd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:53.292881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e733c4-f981-4d43-aa0f-37c9c669b1bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:53.333407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dd001-01e7-4501-a5e8-a4d72d4526c9 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:53.333690 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dd001-01e7-4501-a5e8-a4d72d4526c9 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:53.333966 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dd001-01e7-4501-a5e8-a4d72d4526c9 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:53.335326 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 542/1093] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:53.340318 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9644f-9e77-4a22-b521-6a6533ea5ef5 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:53.340626 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9644f-9e77-4a22-b521-6a6533ea5ef5 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:53.340909 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9644f-9e77-4a22-b521-6a6533ea5ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:53.358670 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-74b9644f-9e77-4a22-b521-6a6533ea5ef5 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:53.358834 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e733c4-f981-4d43-aa0f-37c9c669b1bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:53.359786 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-74b9644f-9e77-4a22-b521-6a6533ea5ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:53.360227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e733c4-f981-4d43-aa0f-37c9c669b1bd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:53.402703 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:53.427287 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 543/1094] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 10:34:53.460066 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 552/1095] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:34:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 10:34:53.465765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9644f-9e77-4a22-b521-6a6533ea5ef5 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:53.562506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9644f-9e77-4a22-b521-6a6533ea5ef5 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:53.596865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b43c0d-d8a0-4cb3-8e09-7b552423f605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:53.597489 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b43c0d-d8a0-4cb3-8e09-7b552423f605 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:53.597768 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b43c0d-d8a0-4cb3-8e09-7b552423f605 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:53.598039 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b43c0d-d8a0-4cb3-8e09-7b552423f605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:53.607660 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b43c0d-d8a0-4cb3-8e09-7b552423f605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:53.609212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b43c0d-d8a0-4cb3-8e09-7b552423f605 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:53.623258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-d2b43c0d-d8a0-4cb3-8e09-7b552423f605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:53.623258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:53.623258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:53.623258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:53.623258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:53.623258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:53.623258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:53.623258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:53.623258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:53.623258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:53.623258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:53.623258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:53.623258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:34:53.623258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:34:53.623258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:34:53.623258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:34:53.624363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:53.624363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:53.624363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:53.624363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:53.624363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:53.624363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:53.624363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:53.624363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:53.624363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:53.624363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:53.624363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:53.624363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:53.624363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:53.624363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:53.624363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:53.624363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:53.624363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:34:53.625496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:34:53.625496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:34:53.625496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:53.628826 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 544/1096] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:53.629984 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e733c4-f981-4d43-aa0f-37c9c669b1bd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:53.644381 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:53.695934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b43c0d-d8a0-4cb3-8e09-7b552423f605 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:53.728390 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:53.731022 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e733c4-f981-4d43-aa0f-37c9c669b1bd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:53.765181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62402da6-e4be-45b6-b45e-a2e9595cb7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:53.765777 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62402da6-e4be-45b6-b45e-a2e9595cb7dc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:53.766052 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62402da6-e4be-45b6-b45e-a2e9595cb7dc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:53.766319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62402da6-e4be-45b6-b45e-a2e9595cb7dc None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:53.766949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62402da6-e4be-45b6-b45e-a2e9595cb7dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:53.767249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62402da6-e4be-45b6-b45e-a2e9595cb7dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:53.768661 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62402da6-e4be-45b6-b45e-a2e9595cb7dc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:53.779757 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 553/1097] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:53.785239 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62402da6-e4be-45b6-b45e-a2e9595cb7dc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:53.803272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b43c0d-d8a0-4cb3-8e09-7b552423f605 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:53.836627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddca292-d0fc-4ed0-ad7f-0db6cfae9b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:53.837248 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddca292-d0fc-4ed0-ad7f-0db6cfae9b38 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:53.837530 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddca292-d0fc-4ed0-ad7f-0db6cfae9b38 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:53.837800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddca292-d0fc-4ed0-ad7f-0db6cfae9b38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:53.848698 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddca292-d0fc-4ed0-ad7f-0db6cfae9b38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:34:53.853499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:53.853619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-8ddca292-d0fc-4ed0-ad7f-0db6cfae9b38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:34:53.853619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:53.853619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:53.853619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:53.853619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:53.853619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:53.853619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:53.853619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:53.853619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:53.853619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:53.853619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:53.853619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:53.853619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:34:53.853619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:34:53.853619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:34:53.853619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:34:53.854508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:34:53.854508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:34:53.854508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:34:53.854508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:34:53.854508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:53.854508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:53.854508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:53.854508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:53.854508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:53.854508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:53.854508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:53.854508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:53.854508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:53.854508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:53.854508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:53.854508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:53.855341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:53.855341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:53.855341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:53.855341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:53.855341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:34:53.855341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:34:53.855341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:34:53.855341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:34:53.855341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:34:53.855341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:34:53.855341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:34:53.855341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:34:53.855341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 545/1098] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:34:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:34:53.861273 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddca292-d0fc-4ed0-ad7f-0db6cfae9b38 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:53.883335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62402da6-e4be-45b6-b45e-a2e9595cb7dc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:53.915503 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fe386-bf5f-4701-b434-36d281739826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:53.916124 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fe386-bf5f-4701-b434-36d281739826 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:53.916393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fe386-bf5f-4701-b434-36d281739826 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:53.916697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fe386-bf5f-4701-b434-36d281739826 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:53.923242 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fe386-bf5f-4701-b434-36d281739826 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:53.924695 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fe386-bf5f-4701-b434-36d281739826 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:53.935760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-0a6fe386-bf5f-4701-b434-36d281739826 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:53.935760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:34:53.935760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:34:53.935760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:34:53.935760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:34:53.935760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:34:53.935760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:34:53.935760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:34:53.935760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:34:53.935760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:34:53.935760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:34:53.935760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:34:53.935760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:34:53.935760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:34:53.935760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:34:53.937445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:34:53.937445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:34:53.937445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:34:53.937445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:34:53.937445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:34:53.937445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:34:53.937445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:34:53.937445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:34:53.937445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:34:53.937445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:34:53.937445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:34:53.937445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:34:53.937445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:34:53.937445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:34:53.937445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:34:53.937445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:34:53.937445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:34:53.938358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:34:53.938358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:34:53.938358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:34:53.938358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:34:53.938358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:34:53.938358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:34:53.938358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:34:53.938358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:34:53.938358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 554/1099] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:34:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:34:53.943062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fe386-bf5f-4701-b434-36d281739826 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:53.949845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:53.962044 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddca292-d0fc-4ed0-ad7f-0db6cfae9b38 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:53.995337 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d843ac-149e-4da5-8659-a206533037a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:53.995934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d843ac-149e-4da5-8659-a206533037a5 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:53.996488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d843ac-149e-4da5-8659-a206533037a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:53.996488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d843ac-149e-4da5-8659-a206533037a5 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:53.997139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d843ac-149e-4da5-8659-a206533037a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:53.997463 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d843ac-149e-4da5-8659-a206533037a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:53.998814 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d843ac-149e-4da5-8659-a206533037a5 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:54.006991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 546/1100] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:34:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:54.012725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d843ac-149e-4da5-8659-a206533037a5 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:54.043766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fe386-bf5f-4701-b434-36d281739826 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:54.071842 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:54.077359 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee74df-16e7-4a71-9d23-c676c28ee8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:54.077963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee74df-16e7-4a71-9d23-c676c28ee8fa None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:54.078241 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee74df-16e7-4a71-9d23-c676c28ee8fa None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:54.078511 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee74df-16e7-4a71-9d23-c676c28ee8fa None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:54.079199 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee74df-16e7-4a71-9d23-c676c28ee8fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:54.079504 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee74df-16e7-4a71-9d23-c676c28ee8fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:54.081078 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee74df-16e7-4a71-9d23-c676c28ee8fa None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:54.093343 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 555/1101] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:34:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:54.099590 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee74df-16e7-4a71-9d23-c676c28ee8fa None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:54.112221 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d843ac-149e-4da5-8659-a206533037a5 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:54.145240 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1327ef5-bdd5-4ed9-a897-45632569ddc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:54.145887 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1327ef5-bdd5-4ed9-a897-45632569ddc2 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:54.146166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1327ef5-bdd5-4ed9-a897-45632569ddc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:54.146437 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1327ef5-bdd5-4ed9-a897-45632569ddc2 None admin] PATH_INFO: `/v3/users/1643080bc5214b99b739bc82a0ed9587` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:54.147812 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1327ef5-bdd5-4ed9-a897-45632569ddc2 None admin] RBAC: Authorizing `identity:get_user(user_id=1643080bc5214b99b739bc82a0ed9587)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:54.149257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1327ef5-bdd5-4ed9-a897-45632569ddc2 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:54.150833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 547/1102] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:34:54 2022] GET /identity/v3/users/1643080bc5214b99b739bc82a0ed9587 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:54.157072 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1327ef5-bdd5-4ed9-a897-45632569ddc2 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:54.175563 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:54.198434 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee74df-16e7-4a71-9d23-c676c28ee8fa None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:54.232684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526ef6e-eb91-4cde-95fd-ed3dbf34e305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:54.233482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526ef6e-eb91-4cde-95fd-ed3dbf34e305 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:54.233763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526ef6e-eb91-4cde-95fd-ed3dbf34e305 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:54.234035 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526ef6e-eb91-4cde-95fd-ed3dbf34e305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:54.234754 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526ef6e-eb91-4cde-95fd-ed3dbf34e305 None admin] RBAC: Adding query filter params (role.id=8896f3c145b84c85a4ddf8a6b17422b2, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=b642a1d00de940429fc1cc6131ac22b1) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:54.235059 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526ef6e-eb91-4cde-95fd-ed3dbf34e305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:54.236469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526ef6e-eb91-4cde-95fd-ed3dbf34e305 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:54.242710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 556/1103] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:34:54 2022] GET /identity/v3/role_assignments?user.id=b642a1d00de940429fc1cc6131ac22b1&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=8896f3c145b84c85a4ddf8a6b17422b2 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:34:54.258000 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1327ef5-bdd5-4ed9-a897-45632569ddc2 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:54.294851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ea418-f22a-4d55-b6c8-4a891054e84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:54.295477 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ea418-f22a-4d55-b6c8-4a891054e84e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:54.296303 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ea418-f22a-4d55-b6c8-4a891054e84e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:54.296597 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ea418-f22a-4d55-b6c8-4a891054e84e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:54.369265 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ea418-f22a-4d55-b6c8-4a891054e84e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:54.370635 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ea418-f22a-4d55-b6c8-4a891054e84e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:54.389817 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:54.473364 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 548/1104] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:34:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 10:34:54.479618 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526ef6e-eb91-4cde-95fd-ed3dbf34e305 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:54.538343 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:54.582711 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526ef6e-eb91-4cde-95fd-ed3dbf34e305 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:54.615908 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d3cf0-3398-4ce9-833d-a0bed89f1adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:54.616538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d3cf0-3398-4ce9-833d-a0bed89f1adc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:54.616844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d3cf0-3398-4ce9-833d-a0bed89f1adc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:54.617116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d3cf0-3398-4ce9-833d-a0bed89f1adc None admin] PATH_INFO: `/v3/projects/2d6e17a99e4c4d0e9a353450e8a8b5b9` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:54.618225 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d3cf0-3398-4ce9-833d-a0bed89f1adc None admin] RBAC: Authorizing `identity:get_project(project_id=2d6e17a99e4c4d0e9a353450e8a8b5b9)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:54.619723 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d3cf0-3398-4ce9-833d-a0bed89f1adc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:54.621342 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 557/1105] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:34:54 2022] GET /identity/v3/projects/2d6e17a99e4c4d0e9a353450e8a8b5b9 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:54.627710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ea418-f22a-4d55-b6c8-4a891054e84e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:54.736819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ea418-f22a-4d55-b6c8-4a891054e84e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:54.754164 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:54.771383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f09a5-7de1-47b5-864a-23de484b40d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:54.771993 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f09a5-7de1-47b5-864a-23de484b40d5 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:54.772275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f09a5-7de1-47b5-864a-23de484b40d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:54.772584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f09a5-7de1-47b5-864a-23de484b40d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:54.773303 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f09a5-7de1-47b5-864a-23de484b40d5 None admin] RBAC: Adding query filter params (role.id=529cb3511f3a498b9b7169ed5b0f6b8e, scope.project.id=2d6e17a99e4c4d0e9a353450e8a8b5b9, user.id=1643080bc5214b99b739bc82a0ed9587) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:34:54.773614 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f09a5-7de1-47b5-864a-23de484b40d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:54.775035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f09a5-7de1-47b5-864a-23de484b40d5 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:54.781432 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 549/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:34:54 2022] GET /identity/v3/role_assignments?user.id=1643080bc5214b99b739bc82a0ed9587&scope.project.id=2d6e17a99e4c4d0e9a353450e8a8b5b9&role.id=529cb3511f3a498b9b7169ed5b0f6b8e => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:56.953965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cec3f-98ce-4590-913f-048382351390 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:56.954479 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cec3f-98ce-4590-913f-048382351390 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:56.954479 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cec3f-98ce-4590-913f-048382351390 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:56.955831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 558/1107] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:34:56.960923 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2c1c0-f4b9-4a1b-b912-9395c8a033ce None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:56.961358 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2c1c0-f4b9-4a1b-b912-9395c8a033ce None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:56.961461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2c1c0-f4b9-4a1b-b912-9395c8a033ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:56.979469 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-01c2c1c0-f4b9-4a1b-b912-9395c8a033ce None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:56.980602 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-01c2c1c0-f4b9-4a1b-b912-9395c8a033ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:57.044920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 550/1108] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:34:57.315403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cec3f-98ce-4590-913f-048382351390 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:57.412976 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cec3f-98ce-4590-913f-048382351390 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:57.435106 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:57.445928 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11538a0-4246-4490-b915-8b993e0f655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:57.446546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11538a0-4246-4490-b915-8b993e0f655a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:57.446824 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11538a0-4246-4490-b915-8b993e0f655a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:57.447095 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11538a0-4246-4490-b915-8b993e0f655a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:57.448190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11538a0-4246-4490-b915-8b993e0f655a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:57.449635 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11538a0-4246-4490-b915-8b993e0f655a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:57.451181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 559/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:34:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:34:57.457374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2c1c0-f4b9-4a1b-b912-9395c8a033ce None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:34:57.553811 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2c1c0-f4b9-4a1b-b912-9395c8a033ce None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:34:57.566384 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:34:57.587593 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62379498-1691-41e3-9e81-dcb2220a26ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:34:57.588189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62379498-1691-41e3-9e81-dcb2220a26ff None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:57.588468 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62379498-1691-41e3-9e81-dcb2220a26ff None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:57.588770 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62379498-1691-41e3-9e81-dcb2220a26ff None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:57.589413 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62379498-1691-41e3-9e81-dcb2220a26ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:34:57.590829 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62379498-1691-41e3-9e81-dcb2220a26ff None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:34:57.611746 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 551/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 10:34:57 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:34:59.786773 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ddd24-5e27-4e11-bc15-2a878ee1eb79 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:59.787304 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ddd24-5e27-4e11-bc15-2a878ee1eb79 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:59.787304 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ddd24-5e27-4e11-bc15-2a878ee1eb79 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:59.788692 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 560/1111] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:34:59.793774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4fc1a-90d5-47c3-8e17-a429c7e0845d None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:34:59.794156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4fc1a-90d5-47c3-8e17-a429c7e0845d None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:34:59.794316 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4fc1a-90d5-47c3-8e17-a429c7e0845d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:34:59.811977 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-97d4fc1a-90d5-47c3-8e17-a429c7e0845d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:34:59.813174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-97d4fc1a-90d5-47c3-8e17-a429c7e0845d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:34:59.877259 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 552/1112] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:34:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:35:00.143027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ddd24-5e27-4e11-bc15-2a878ee1eb79 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:00.243031 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ddd24-5e27-4e11-bc15-2a878ee1eb79 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:00.274478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566dc32b-90c8-4536-8da1-fbe47bcec6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:00.275080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dc32b-90c8-4536-8da1-fbe47bcec6ad None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:00.275357 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dc32b-90c8-4536-8da1-fbe47bcec6ad None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:00.275622 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dc32b-90c8-4536-8da1-fbe47bcec6ad None admin] PATH_INFO: `/v3/roles/30f1e6f9ddb649d2804d9128b17348f6` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:00.277008 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566dc32b-90c8-4536-8da1-fbe47bcec6ad None admin] RBAC: Authorizing `identity:get_role(role_id=30f1e6f9ddb649d2804d9128b17348f6)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:00.278358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566dc32b-90c8-4536-8da1-fbe47bcec6ad None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:00.279653 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 561/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:35:00 2022] GET /identity/v3/roles/30f1e6f9ddb649d2804d9128b17348f6 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:00.285405 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4fc1a-90d5-47c3-8e17-a429c7e0845d None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:00.378084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:00.381988 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4fc1a-90d5-47c3-8e17-a429c7e0845d None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:00.416147 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929ce6b-70c6-4bc3-b43a-bb8c8877052c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:00.416740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929ce6b-70c6-4bc3-b43a-bb8c8877052c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:00.417019 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929ce6b-70c6-4bc3-b43a-bb8c8877052c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:00.417290 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929ce6b-70c6-4bc3-b43a-bb8c8877052c None admin] PATH_INFO: `/v3/users/286c07f59a9049ceaa9eac413268be8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:00.430281 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929ce6b-70c6-4bc3-b43a-bb8c8877052c None admin] RBAC: Authorizing `identity:get_user(user_id=286c07f59a9049ceaa9eac413268be8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:00.431714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929ce6b-70c6-4bc3-b43a-bb8c8877052c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:00.433318 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 553/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:35:00 2022] GET /identity/v3/users/286c07f59a9049ceaa9eac413268be8e => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:00.439524 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566dc32b-90c8-4536-8da1-fbe47bcec6ad None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:00.496975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:00.536200 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566dc32b-90c8-4536-8da1-fbe47bcec6ad None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:00.568423 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47978833-87dc-45a8-ba1c-be124c779364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:00.569042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47978833-87dc-45a8-ba1c-be124c779364 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:00.569322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47978833-87dc-45a8-ba1c-be124c779364 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:00.569591 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47978833-87dc-45a8-ba1c-be124c779364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:00.633980 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47978833-87dc-45a8-ba1c-be124c779364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:00.635400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47978833-87dc-45a8-ba1c-be124c779364 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:00.690153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:00.731174 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 562/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:35:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 10:35:00.737008 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929ce6b-70c6-4bc3-b43a-bb8c8877052c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:00.832274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929ce6b-70c6-4bc3-b43a-bb8c8877052c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:00.866406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453921f8-8a74-4ccd-9ef0-8bb8114905ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:00.867030 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453921f8-8a74-4ccd-9ef0-8bb8114905ca None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:00.867309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453921f8-8a74-4ccd-9ef0-8bb8114905ca None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:00.867581 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453921f8-8a74-4ccd-9ef0-8bb8114905ca None admin] PATH_INFO: `/v3/projects/2d6e17a99e4c4d0e9a353450e8a8b5b9` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:00.868713 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453921f8-8a74-4ccd-9ef0-8bb8114905ca None admin] RBAC: Authorizing `identity:get_project(project_id=2d6e17a99e4c4d0e9a353450e8a8b5b9)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:00.870128 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453921f8-8a74-4ccd-9ef0-8bb8114905ca None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:00.871754 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 554/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:35:00 2022] GET /identity/v3/projects/2d6e17a99e4c4d0e9a353450e8a8b5b9 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:00.877952 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47978833-87dc-45a8-ba1c-be124c779364 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:00.971715 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47978833-87dc-45a8-ba1c-be124c779364 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:01.003693 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4dbf55-19ec-4683-987e-88bce58311ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:01.004280 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4dbf55-19ec-4683-987e-88bce58311ca None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:01.004579 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4dbf55-19ec-4683-987e-88bce58311ca None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:01.004856 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4dbf55-19ec-4683-987e-88bce58311ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:01.005568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4dbf55-19ec-4683-987e-88bce58311ca None admin] RBAC: Adding query filter params (role.id=30f1e6f9ddb649d2804d9128b17348f6, scope.project.id=2d6e17a99e4c4d0e9a353450e8a8b5b9, user.id=286c07f59a9049ceaa9eac413268be8e) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:35:01.005872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4dbf55-19ec-4683-987e-88bce58311ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:01.007326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4dbf55-19ec-4683-987e-88bce58311ca None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:01.012330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 563/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:35:00 2022] GET /identity/v3/role_assignments?user.id=286c07f59a9049ceaa9eac413268be8e&scope.project.id=2d6e17a99e4c4d0e9a353450e8a8b5b9&role.id=30f1e6f9ddb649d2804d9128b17348f6 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:03.099338 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3f86a-ed3f-4e0d-a529-994b3a446b8c None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:03.099861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3f86a-ed3f-4e0d-a529-994b3a446b8c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:03.099970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3f86a-ed3f-4e0d-a529-994b3a446b8c None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:03.101314 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 555/1118] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:35:03.106477 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b810b-9239-4e4b-a6af-9948e4cbbc58 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:03.106873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b810b-9239-4e4b-a6af-9948e4cbbc58 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:03.107022 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b810b-9239-4e4b-a6af-9948e4cbbc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:03.125488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-703b810b-9239-4e4b-a6af-9948e4cbbc58 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:35:03.126658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-703b810b-9239-4e4b-a6af-9948e4cbbc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:35:03.143100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:03.191306 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 564/1119] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:35:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:35:03.456204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3f86a-ed3f-4e0d-a529-994b3a446b8c None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:03.480522 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:03.554611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3f86a-ed3f-4e0d-a529-994b3a446b8c None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:03.587129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbaa7b4-3c55-4fa4-8bbe-4d9309d4e850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:03.587741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaa7b4-3c55-4fa4-8bbe-4d9309d4e850 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:03.588016 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaa7b4-3c55-4fa4-8bbe-4d9309d4e850 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:03.588281 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaa7b4-3c55-4fa4-8bbe-4d9309d4e850 None admin] PATH_INFO: `/v3/roles/30f1e6f9ddb649d2804d9128b17348f6` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:03.589670 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbaa7b4-3c55-4fa4-8bbe-4d9309d4e850 None admin] RBAC: Authorizing `identity:get_role(role_id=30f1e6f9ddb649d2804d9128b17348f6)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:03.591018 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbaa7b4-3c55-4fa4-8bbe-4d9309d4e850 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:03.592341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 556/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:35:03 2022] GET /identity/v3/roles/30f1e6f9ddb649d2804d9128b17348f6 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:03.598396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b810b-9239-4e4b-a6af-9948e4cbbc58 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:03.697614 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b810b-9239-4e4b-a6af-9948e4cbbc58 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:03.732225 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae57f2e-3641-4a6f-b3fb-a50a71337724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:03.733481 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae57f2e-3641-4a6f-b3fb-a50a71337724 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:03.733762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae57f2e-3641-4a6f-b3fb-a50a71337724 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:03.734029 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae57f2e-3641-4a6f-b3fb-a50a71337724 None admin] PATH_INFO: `/v3/users/286c07f59a9049ceaa9eac413268be8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:03.735138 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae57f2e-3641-4a6f-b3fb-a50a71337724 None admin] RBAC: Authorizing `identity:get_user(user_id=286c07f59a9049ceaa9eac413268be8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:03.736570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae57f2e-3641-4a6f-b3fb-a50a71337724 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:03.738146 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 565/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:35:03 2022] GET /identity/v3/users/286c07f59a9049ceaa9eac413268be8e => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:03.743895 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbaa7b4-3c55-4fa4-8bbe-4d9309d4e850 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:03.830919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:03.839743 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbaa7b4-3c55-4fa4-8bbe-4d9309d4e850 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:03.871704 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca2588-beb8-47c3-9a17-0c3315e18458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:03.872317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca2588-beb8-47c3-9a17-0c3315e18458 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:03.872617 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca2588-beb8-47c3-9a17-0c3315e18458 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:03.872890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca2588-beb8-47c3-9a17-0c3315e18458 None admin] PATH_INFO: `/v3/projects/2d6e17a99e4c4d0e9a353450e8a8b5b9` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:03.874507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca2588-beb8-47c3-9a17-0c3315e18458 None admin] RBAC: Authorizing `identity:get_project(project_id=2d6e17a99e4c4d0e9a353450e8a8b5b9)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:03.875921 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca2588-beb8-47c3-9a17-0c3315e18458 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:03.877547 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 557/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:35:03 2022] GET /identity/v3/projects/2d6e17a99e4c4d0e9a353450e8a8b5b9 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:03.883677 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae57f2e-3641-4a6f-b3fb-a50a71337724 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:03.907431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:03.979012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae57f2e-3641-4a6f-b3fb-a50a71337724 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:04.010754 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5d3ba-4693-4b11-8686-1de6c46b8141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:04.011389 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5d3ba-4693-4b11-8686-1de6c46b8141 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:04.011671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5d3ba-4693-4b11-8686-1de6c46b8141 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:04.011943 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5d3ba-4693-4b11-8686-1de6c46b8141 None admin] PATH_INFO: `/v3/projects/2d6e17a99e4c4d0e9a353450e8a8b5b9/users/286c07f59a9049ceaa9eac413268be8e/roles/30f1e6f9ddb649d2804d9128b17348f6` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:04.014580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5d3ba-4693-4b11-8686-1de6c46b8141 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d6e17a99e4c4d0e9a353450e8a8b5b9, user_id=286c07f59a9049ceaa9eac413268be8e, role_id=30f1e6f9ddb649d2804d9128b17348f6)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:04.015980 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5d3ba-4693-4b11-8686-1de6c46b8141 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:04.028672 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 566/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:35:03 2022] PUT /identity/v3/projects/2d6e17a99e4c4d0e9a353450e8a8b5b9/users/286c07f59a9049ceaa9eac413268be8e/roles/30f1e6f9ddb649d2804d9128b17348f6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:35:06.098279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c07dec-0f3f-465d-8f28-f37185ad64d2 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:06.098786 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c07dec-0f3f-465d-8f28-f37185ad64d2 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:06.098894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c07dec-0f3f-465d-8f28-f37185ad64d2 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:06.100146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 558/1124] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:35:06.105284 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f308b21-48b7-4e5d-9815-6c7c85412edf None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:06.105680 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f308b21-48b7-4e5d-9815-6c7c85412edf None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:06.105827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f308b21-48b7-4e5d-9815-6c7c85412edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:06.125910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-0f308b21-48b7-4e5d-9815-6c7c85412edf None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:35:06.127087 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0f308b21-48b7-4e5d-9815-6c7c85412edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:35:06.193102 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 567/1125] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:35:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:35:06.458965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c07dec-0f3f-465d-8f28-f37185ad64d2 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:06.556917 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c07dec-0f3f-465d-8f28-f37185ad64d2 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:06.589354 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cf54b-bb37-425a-a44b-162c83bc03ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:06.589961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cf54b-bb37-425a-a44b-162c83bc03ce None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:06.590235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cf54b-bb37-425a-a44b-162c83bc03ce None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:06.590502 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cf54b-bb37-425a-a44b-162c83bc03ce None admin] PATH_INFO: `/v3/roles/30f1e6f9ddb649d2804d9128b17348f6` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:06.591846 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cf54b-bb37-425a-a44b-162c83bc03ce None admin] RBAC: Authorizing `identity:get_role(role_id=30f1e6f9ddb649d2804d9128b17348f6)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:06.593311 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cf54b-bb37-425a-a44b-162c83bc03ce None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:06.594615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 559/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:35:06 2022] GET /identity/v3/roles/30f1e6f9ddb649d2804d9128b17348f6 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:06.600562 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f308b21-48b7-4e5d-9815-6c7c85412edf None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:06.614542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:06.696185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f308b21-48b7-4e5d-9815-6c7c85412edf None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:06.730412 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b6617-1d39-4cf4-8f83-19170378d585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:06.731038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b6617-1d39-4cf4-8f83-19170378d585 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:06.731314 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b6617-1d39-4cf4-8f83-19170378d585 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:06.731584 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b6617-1d39-4cf4-8f83-19170378d585 None admin] PATH_INFO: `/v3/users/286c07f59a9049ceaa9eac413268be8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:06.732741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b6617-1d39-4cf4-8f83-19170378d585 None admin] RBAC: Authorizing `identity:get_user(user_id=286c07f59a9049ceaa9eac413268be8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:06.734166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b6617-1d39-4cf4-8f83-19170378d585 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:06.735787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 568/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:35:06 2022] GET /identity/v3/users/286c07f59a9049ceaa9eac413268be8e => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:06.741533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cf54b-bb37-425a-a44b-162c83bc03ce None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:06.769509 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:06.838524 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cf54b-bb37-425a-a44b-162c83bc03ce None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:06.870540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a975bb2-339a-4da1-a587-02b9724a5e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:06.871120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a975bb2-339a-4da1-a587-02b9724a5e89 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:06.871396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a975bb2-339a-4da1-a587-02b9724a5e89 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:06.871665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a975bb2-339a-4da1-a587-02b9724a5e89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:06.935467 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a975bb2-339a-4da1-a587-02b9724a5e89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:06.937449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a975bb2-339a-4da1-a587-02b9724a5e89 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:06.963142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:07.031772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 560/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:35:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 10:35:07.037577 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b6617-1d39-4cf4-8f83-19170378d585 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:07.115074 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:07.133995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b6617-1d39-4cf4-8f83-19170378d585 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:07.165804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db73fa8-7d86-4db6-b57c-6c96472c8ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:07.166416 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73fa8-7d86-4db6-b57c-6c96472c8ce0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:07.166690 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73fa8-7d86-4db6-b57c-6c96472c8ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:07.166960 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73fa8-7d86-4db6-b57c-6c96472c8ce0 None admin] PATH_INFO: `/v3/projects/2d6e17a99e4c4d0e9a353450e8a8b5b9` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:07.168045 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db73fa8-7d86-4db6-b57c-6c96472c8ce0 None admin] RBAC: Authorizing `identity:get_project(project_id=2d6e17a99e4c4d0e9a353450e8a8b5b9)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:07.169611 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db73fa8-7d86-4db6-b57c-6c96472c8ce0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:07.171755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 569/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:35:07 2022] GET /identity/v3/projects/2d6e17a99e4c4d0e9a353450e8a8b5b9 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:07.177742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a975bb2-339a-4da1-a587-02b9724a5e89 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:07.273362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a975bb2-339a-4da1-a587-02b9724a5e89 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:07.298882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:07.306745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ba048-f4d6-44b0-8935-6f3e881d3b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:07.307345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba048-f4d6-44b0-8935-6f3e881d3b5f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:07.307625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba048-f4d6-44b0-8935-6f3e881d3b5f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:07.307897 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba048-f4d6-44b0-8935-6f3e881d3b5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:07.308645 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ba048-f4d6-44b0-8935-6f3e881d3b5f None admin] RBAC: Adding query filter params (role.id=30f1e6f9ddb649d2804d9128b17348f6, scope.project.id=2d6e17a99e4c4d0e9a353450e8a8b5b9, user.id=286c07f59a9049ceaa9eac413268be8e) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:35:07.308954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ba048-f4d6-44b0-8935-6f3e881d3b5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:07.310363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ba048-f4d6-44b0-8935-6f3e881d3b5f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:07.316589 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 561/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:35:07 2022] GET /identity/v3/role_assignments?user.id=286c07f59a9049ceaa9eac413268be8e&scope.project.id=2d6e17a99e4c4d0e9a353450e8a8b5b9&role.id=30f1e6f9ddb649d2804d9128b17348f6 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:09.484136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2579f-1d45-459b-bb3a-a14f9b41bc0f None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:09.484685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2579f-1d45-459b-bb3a-a14f9b41bc0f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:09.484810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2579f-1d45-459b-bb3a-a14f9b41bc0f None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:09.486041 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 570/1131] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:35:09.491411 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5b340-31fa-4251-bf81-30c13d278ed0 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:09.491791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5b340-31fa-4251-bf81-30c13d278ed0 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:09.491954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5b340-31fa-4251-bf81-30c13d278ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:09.509676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-5cc5b340-31fa-4251-bf81-30c13d278ed0 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:35:09.510854 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-5cc5b340-31fa-4251-bf81-30c13d278ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:35:09.574695 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 562/1132] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:35:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:35:09.845425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2579f-1d45-459b-bb3a-a14f9b41bc0f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:09.942974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2579f-1d45-459b-bb3a-a14f9b41bc0f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:09.975393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33faf102-e45d-4f43-af19-a8e2e2ad592f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:09.976000 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33faf102-e45d-4f43-af19-a8e2e2ad592f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:09.976277 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33faf102-e45d-4f43-af19-a8e2e2ad592f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:09.976574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33faf102-e45d-4f43-af19-a8e2e2ad592f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:09.977644 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33faf102-e45d-4f43-af19-a8e2e2ad592f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:09.979048 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33faf102-e45d-4f43-af19-a8e2e2ad592f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:09.980740 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 571/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:35:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:09.986881 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5b340-31fa-4251-bf81-30c13d278ed0 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:10.081779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5b340-31fa-4251-bf81-30c13d278ed0 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:10.103374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:10.115390 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee1b7f-43c5-4e08-9e48-5429ddae560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:10.115978 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee1b7f-43c5-4e08-9e48-5429ddae560c None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:10.116254 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee1b7f-43c5-4e08-9e48-5429ddae560c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:10.116525 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee1b7f-43c5-4e08-9e48-5429ddae560c None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:10.117193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee1b7f-43c5-4e08-9e48-5429ddae560c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:10.118603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee1b7f-43c5-4e08-9e48-5429ddae560c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:10.145347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 563/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 10:35:09 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:35:12.322831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dec418-8cd9-43dd-af95-00f464ddd19b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:12.323395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dec418-8cd9-43dd-af95-00f464ddd19b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:12.323395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dec418-8cd9-43dd-af95-00f464ddd19b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:12.324867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 572/1135] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:35:12.330083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6891590-fc6b-4ffb-a903-ac310ba8a369 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:12.330446 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6891590-fc6b-4ffb-a903-ac310ba8a369 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:12.330645 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6891590-fc6b-4ffb-a903-ac310ba8a369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:12.348749 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-a6891590-fc6b-4ffb-a903-ac310ba8a369 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:35:12.349934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a6891590-fc6b-4ffb-a903-ac310ba8a369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:35:12.414039 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 564/1136] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:35:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:35:12.683960 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dec418-8cd9-43dd-af95-00f464ddd19b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:12.702448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:12.782273 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dec418-8cd9-43dd-af95-00f464ddd19b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:12.814104 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee7b55-fdbc-4719-aadc-36b3925f69a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:12.814714 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee7b55-fdbc-4719-aadc-36b3925f69a7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:12.814988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee7b55-fdbc-4719-aadc-36b3925f69a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:12.815254 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee7b55-fdbc-4719-aadc-36b3925f69a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:12.816339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee7b55-fdbc-4719-aadc-36b3925f69a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:12.817766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee7b55-fdbc-4719-aadc-36b3925f69a7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:12.819301 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 573/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:35:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:12.825017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6891590-fc6b-4ffb-a903-ac310ba8a369 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:12.921568 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6891590-fc6b-4ffb-a903-ac310ba8a369 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:12.923828 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:12.955662 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe43c1-ca48-4efe-8d02-3f73d78100fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:12.956181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe43c1-ca48-4efe-8d02-3f73d78100fe None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:12.956455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe43c1-ca48-4efe-8d02-3f73d78100fe None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:12.956756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe43c1-ca48-4efe-8d02-3f73d78100fe None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:12.957392 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe43c1-ca48-4efe-8d02-3f73d78100fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:12.958795 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe43c1-ca48-4efe-8d02-3f73d78100fe None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:12.980194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 565/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 10:35:12 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:35:15.152531 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca602e-c027-455b-a70f-8fbe93d7d372 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:15.153074 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca602e-c027-455b-a70f-8fbe93d7d372 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:15.153074 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca602e-c027-455b-a70f-8fbe93d7d372 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:15.154923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 574/1139] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:35:15.160194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed1c19-e59a-49c1-8d8c-c0e668e4fd21 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:15.160586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed1c19-e59a-49c1-8d8c-c0e668e4fd21 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:15.160765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed1c19-e59a-49c1-8d8c-c0e668e4fd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:15.179965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-47ed1c19-e59a-49c1-8d8c-c0e668e4fd21 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:35:15.181190 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-47ed1c19-e59a-49c1-8d8c-c0e668e4fd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:35:15.246948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 566/1140] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:35:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:35:15.516474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca602e-c027-455b-a70f-8fbe93d7d372 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:15.597221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:15.613502 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca602e-c027-455b-a70f-8fbe93d7d372 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:15.645726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1037957-e64c-40da-87ad-b520e1fed331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:15.646336 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1037957-e64c-40da-87ad-b520e1fed331 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:15.646612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1037957-e64c-40da-87ad-b520e1fed331 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:15.646880 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1037957-e64c-40da-87ad-b520e1fed331 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:15.656946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1037957-e64c-40da-87ad-b520e1fed331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:35:15.661657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-b1037957-e64c-40da-87ad-b520e1fed331 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:35:15.661657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:35:15.661657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:35:15.661657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:35:15.661657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:35:15.661657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:35:15.661657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:35:15.661657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:35:15.661657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:35:15.661657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:35:15.661657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:35:15.661657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:35:15.661657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:35:15.661657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:35:15.661657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:35:15.661657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:35:15.662808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:35:15.662808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:35:15.662808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:35:15.662808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:35:15.662808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:35:15.662808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:35:15.662808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:35:15.662808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:35:15.662808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:35:15.662808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:35:15.662808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:35:15.662808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:35:15.662808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:35:15.662808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:35:15.662808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:35:15.662808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:35:15.663806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:35:15.663806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:35:15.663806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:35:15.663806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:35:15.663806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:35:15.663806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:35:15.663806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:35:15.663806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:35:15.663806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:35:15.663806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:35:15.663806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:35:15.663806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:35:15.663806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 575/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:35:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:35:15.668629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed1c19-e59a-49c1-8d8c-c0e668e4fd21 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:15.755207 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:15.766113 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed1c19-e59a-49c1-8d8c-c0e668e4fd21 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:15.798345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc050037-687a-407e-a61e-e8be403c3254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:15.798882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc050037-687a-407e-a61e-e8be403c3254 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:15.799161 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc050037-687a-407e-a61e-e8be403c3254 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:15.799461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc050037-687a-407e-a61e-e8be403c3254 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:15.800122 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc050037-687a-407e-a61e-e8be403c3254 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:35:15.800423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc050037-687a-407e-a61e-e8be403c3254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:15.801811 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc050037-687a-407e-a61e-e8be403c3254 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:15.809531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 567/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:35:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:15.816001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1037957-e64c-40da-87ad-b520e1fed331 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:15.912708 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1037957-e64c-40da-87ad-b520e1fed331 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:15.944691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ba149-0745-4497-8604-24f91ec1edf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:15.945300 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ba149-0745-4497-8604-24f91ec1edf4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:15.945577 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ba149-0745-4497-8604-24f91ec1edf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:15.945849 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ba149-0745-4497-8604-24f91ec1edf4 None admin] PATH_INFO: `/v3/users/9bc957e7e21e48e4a17eea8f5cc5f7ce` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:15.958243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ba149-0745-4497-8604-24f91ec1edf4 None admin] RBAC: Authorizing `identity:get_user(user_id=9bc957e7e21e48e4a17eea8f5cc5f7ce)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:15.959652 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ba149-0745-4497-8604-24f91ec1edf4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:15.961261 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 576/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:35:15 2022] GET /identity/v3/users/9bc957e7e21e48e4a17eea8f5cc5f7ce => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:15.967629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc050037-687a-407e-a61e-e8be403c3254 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:16.063797 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc050037-687a-407e-a61e-e8be403c3254 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:16.097372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b0508-35f0-48ab-96af-7a2b059af29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:16.097970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b0508-35f0-48ab-96af-7a2b059af29d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:16.098249 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b0508-35f0-48ab-96af-7a2b059af29d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:16.098522 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b0508-35f0-48ab-96af-7a2b059af29d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:16.118797 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:16.164430 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b0508-35f0-48ab-96af-7a2b059af29d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:16.165892 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b0508-35f0-48ab-96af-7a2b059af29d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:16.265656 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 568/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:35:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 10:35:16.271609 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ba149-0745-4497-8604-24f91ec1edf4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:16.274596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:16.366593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ba149-0745-4497-8604-24f91ec1edf4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:16.401050 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8d662-3079-4bf0-916f-a93d5ced4e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:16.401661 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8d662-3079-4bf0-916f-a93d5ced4e3a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:16.401935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8d662-3079-4bf0-916f-a93d5ced4e3a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:16.402199 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8d662-3079-4bf0-916f-a93d5ced4e3a None admin] PATH_INFO: `/v3/projects/266db0b7e96249888f454cc6e500a406` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:16.403293 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8d662-3079-4bf0-916f-a93d5ced4e3a None admin] RBAC: Authorizing `identity:get_project(project_id=266db0b7e96249888f454cc6e500a406)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:16.405305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8d662-3079-4bf0-916f-a93d5ced4e3a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:16.406934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 577/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:35:16 2022] GET /identity/v3/projects/266db0b7e96249888f454cc6e500a406 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:16.413062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b0508-35f0-48ab-96af-7a2b059af29d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:16.463123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:16.507866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b0508-35f0-48ab-96af-7a2b059af29d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:16.540307 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c72f9-c8e1-4460-9426-1e771740b076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:16.540928 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c72f9-c8e1-4460-9426-1e771740b076 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:16.541204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c72f9-c8e1-4460-9426-1e771740b076 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:16.541471 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c72f9-c8e1-4460-9426-1e771740b076 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:16.542191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c72f9-c8e1-4460-9426-1e771740b076 None admin] RBAC: Adding query filter params (role.id=529cb3511f3a498b9b7169ed5b0f6b8e, scope.project.id=266db0b7e96249888f454cc6e500a406, user.id=9bc957e7e21e48e4a17eea8f5cc5f7ce) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:35:16.542496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c72f9-c8e1-4460-9426-1e771740b076 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:16.543895 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c72f9-c8e1-4460-9426-1e771740b076 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:16.549138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 569/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:35:16 2022] GET /identity/v3/role_assignments?user.id=9bc957e7e21e48e4a17eea8f5cc5f7ce&scope.project.id=266db0b7e96249888f454cc6e500a406&role.id=529cb3511f3a498b9b7169ed5b0f6b8e => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:18.640989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc3235-8f0d-42e4-b7f5-fbbd2632a119 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:18.641515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc3235-8f0d-42e4-b7f5-fbbd2632a119 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:18.641515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc3235-8f0d-42e4-b7f5-fbbd2632a119 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:18.642847 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 578/1147] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:35:18.648041 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85697333-3221-42f1-a64b-ba4088938394 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:18.648434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85697333-3221-42f1-a64b-ba4088938394 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:18.648624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85697333-3221-42f1-a64b-ba4088938394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:18.667586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-85697333-3221-42f1-a64b-ba4088938394 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:35:18.668795 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-85697333-3221-42f1-a64b-ba4088938394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:35:18.733986 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 570/1148] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:35:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:35:18.997443 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc3235-8f0d-42e4-b7f5-fbbd2632a119 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:19.066323 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:19.100619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc3235-8f0d-42e4-b7f5-fbbd2632a119 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:19.133039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cfc78-89fd-4ac3-b462-1937cef88e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:19.133653 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cfc78-89fd-4ac3-b462-1937cef88e18 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:19.133934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cfc78-89fd-4ac3-b462-1937cef88e18 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:19.134206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cfc78-89fd-4ac3-b462-1937cef88e18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:19.144371 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822cfc78-89fd-4ac3-b462-1937cef88e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:35:19.149193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-822cfc78-89fd-4ac3-b462-1937cef88e18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:35:19.149193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:35:19.149193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:35:19.149193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:35:19.149193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:35:19.149193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:35:19.149193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:35:19.149193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:35:19.149193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:35:19.149193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:35:19.149193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:35:19.149193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:35:19.149193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:35:19.149193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:35:19.149193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:35:19.149193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:35:19.150265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:35:19.150265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:35:19.150265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:35:19.150265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:35:19.150265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:35:19.150265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:35:19.150265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:35:19.150265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:35:19.150265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:35:19.150265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:35:19.150265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:35:19.150265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:35:19.150265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:35:19.150265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:35:19.150265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:35:19.150265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:35:19.151469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:35:19.151469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:35:19.151469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:35:19.151469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:35:19.151469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:35:19.151469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:35:19.151469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:35:19.151469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:35:19.151469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:35:19.151469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:35:19.151469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:35:19.151469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:35:19.151469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 579/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:35:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:35:19.156873 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85697333-3221-42f1-a64b-ba4088938394 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:19.200509 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:19.253478 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85697333-3221-42f1-a64b-ba4088938394 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:19.286858 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fe2ca-8d39-48d5-9766-d95818cc05a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:19.287452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fe2ca-8d39-48d5-9766-d95818cc05a8 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:19.287731 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fe2ca-8d39-48d5-9766-d95818cc05a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:19.288005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fe2ca-8d39-48d5-9766-d95818cc05a8 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:19.288695 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fe2ca-8d39-48d5-9766-d95818cc05a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:35:19.289000 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fe2ca-8d39-48d5-9766-d95818cc05a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:19.290360 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fe2ca-8d39-48d5-9766-d95818cc05a8 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:19.298167 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 571/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:35:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:19.303734 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cfc78-89fd-4ac3-b462-1937cef88e18 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:19.399026 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cfc78-89fd-4ac3-b462-1937cef88e18 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:19.426688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:19.433066 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa95fb-a7b0-4d48-b611-adcab2a47564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:19.433690 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa95fb-a7b0-4d48-b611-adcab2a47564 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:19.433970 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa95fb-a7b0-4d48-b611-adcab2a47564 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:19.434243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa95fb-a7b0-4d48-b611-adcab2a47564 None admin] PATH_INFO: `/v3/users/9bc957e7e21e48e4a17eea8f5cc5f7ce` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:19.435899 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa95fb-a7b0-4d48-b611-adcab2a47564 None admin] RBAC: Authorizing `identity:get_user(user_id=9bc957e7e21e48e4a17eea8f5cc5f7ce)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:19.437348 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa95fb-a7b0-4d48-b611-adcab2a47564 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:19.438924 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 580/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:35:19 2022] GET /identity/v3/users/9bc957e7e21e48e4a17eea8f5cc5f7ce => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:19.444760 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fe2ca-8d39-48d5-9766-d95818cc05a8 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:19.539624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fe2ca-8d39-48d5-9766-d95818cc05a8 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:19.547947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:19.572030 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1125b-0e68-4930-9b7c-52c37050b51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:19.572692 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1125b-0e68-4930-9b7c-52c37050b51a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:19.572968 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1125b-0e68-4930-9b7c-52c37050b51a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:19.573232 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1125b-0e68-4930-9b7c-52c37050b51a None admin] PATH_INFO: `/v3/projects/266db0b7e96249888f454cc6e500a406` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:19.574317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1125b-0e68-4930-9b7c-52c37050b51a None admin] RBAC: Authorizing `identity:get_project(project_id=266db0b7e96249888f454cc6e500a406)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:19.575745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1125b-0e68-4930-9b7c-52c37050b51a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:19.577968 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 572/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:35:19 2022] GET /identity/v3/projects/266db0b7e96249888f454cc6e500a406 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:19.583686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa95fb-a7b0-4d48-b611-adcab2a47564 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:19.677541 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa95fb-a7b0-4d48-b611-adcab2a47564 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:19.710221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a758628-4047-4f58-94c1-8a2ac44d736d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:19.710866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a758628-4047-4f58-94c1-8a2ac44d736d None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:19.711141 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a758628-4047-4f58-94c1-8a2ac44d736d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:19.711413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a758628-4047-4f58-94c1-8a2ac44d736d None admin] PATH_INFO: `/v3/projects/266db0b7e96249888f454cc6e500a406/users/9bc957e7e21e48e4a17eea8f5cc5f7ce/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:19.713533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a758628-4047-4f58-94c1-8a2ac44d736d None admin] RBAC: Authorizing `identity:create_grant(project_id=266db0b7e96249888f454cc6e500a406, user_id=9bc957e7e21e48e4a17eea8f5cc5f7ce, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:19.714700 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a758628-4047-4f58-94c1-8a2ac44d736d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:19.727194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 581/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:35:19 2022] PUT /identity/v3/projects/266db0b7e96249888f454cc6e500a406/users/9bc957e7e21e48e4a17eea8f5cc5f7ce/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:35:21.819945 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d5ad3-9571-423a-8584-8758cfb2d6a1 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:21.820484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d5ad3-9571-423a-8584-8758cfb2d6a1 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:21.820484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d5ad3-9571-423a-8584-8758cfb2d6a1 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:21.821858 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 573/1154] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:35:21.827083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90356d7-9903-40a7-bae6-b66904f66c21 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:21.827576 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90356d7-9903-40a7-bae6-b66904f66c21 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:21.827670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90356d7-9903-40a7-bae6-b66904f66c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:21.846523 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b90356d7-9903-40a7-bae6-b66904f66c21 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:35:21.847701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b90356d7-9903-40a7-bae6-b66904f66c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:35:21.897593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:21.911742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 582/1155] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:35:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:35:22.182457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d5ad3-9571-423a-8584-8758cfb2d6a1 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:22.283752 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d5ad3-9571-423a-8584-8758cfb2d6a1 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:22.316745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af3281-f8b4-42f5-bd35-a3bb54da1709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:22.317358 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af3281-f8b4-42f5-bd35-a3bb54da1709 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:22.317633 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af3281-f8b4-42f5-bd35-a3bb54da1709 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:22.317903 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af3281-f8b4-42f5-bd35-a3bb54da1709 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:22.327639 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af3281-f8b4-42f5-bd35-a3bb54da1709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:35:22.332407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-b9af3281-f8b4-42f5-bd35-a3bb54da1709 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:35:22.332407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:35:22.332407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:35:22.332407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:35:22.332407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:35:22.332407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:35:22.332407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:35:22.332407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:35:22.332407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:35:22.332407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:35:22.332407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:35:22.332407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:35:22.332407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:35:22.332407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:35:22.332407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:35:22.332407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:35:22.333564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:35:22.333564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:35:22.333564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:35:22.333564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:35:22.333564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:35:22.333564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:35:22.333564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:35:22.333564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:35:22.333564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:35:22.333564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:35:22.333564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:35:22.333564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:35:22.333564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:35:22.333564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:35:22.333564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:35:22.333564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:35:22.334647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:35:22.334647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:35:22.334647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:35:22.334647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:35:22.334647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:35:22.334647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:35:22.334647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:35:22.334647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:35:22.334647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:35:22.334647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:35:22.334647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:35:22.334647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:35:22.334647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 574/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:35:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:35:22.339560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90356d7-9903-40a7-bae6-b66904f66c21 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:22.432861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90356d7-9903-40a7-bae6-b66904f66c21 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:22.463913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43769ba2-d0bb-4374-968f-cae4584857dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:22.464504 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43769ba2-d0bb-4374-968f-cae4584857dd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:22.464806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43769ba2-d0bb-4374-968f-cae4584857dd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:22.465075 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43769ba2-d0bb-4374-968f-cae4584857dd None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:22.465725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43769ba2-d0bb-4374-968f-cae4584857dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:35:22.466024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43769ba2-d0bb-4374-968f-cae4584857dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:22.467953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43769ba2-d0bb-4374-968f-cae4584857dd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:22.476052 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 583/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:35:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:22.481948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af3281-f8b4-42f5-bd35-a3bb54da1709 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:22.516336 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:22.578442 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af3281-f8b4-42f5-bd35-a3bb54da1709 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:22.611803 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f63ac-1b6b-40a4-97bc-22081c258240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:22.612415 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f63ac-1b6b-40a4-97bc-22081c258240 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:22.612725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f63ac-1b6b-40a4-97bc-22081c258240 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:22.613001 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f63ac-1b6b-40a4-97bc-22081c258240 None admin] PATH_INFO: `/v3/users/9bc957e7e21e48e4a17eea8f5cc5f7ce` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:22.614106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f63ac-1b6b-40a4-97bc-22081c258240 None admin] RBAC: Authorizing `identity:get_user(user_id=9bc957e7e21e48e4a17eea8f5cc5f7ce)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:22.615527 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f63ac-1b6b-40a4-97bc-22081c258240 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:22.617117 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 575/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:35:22 2022] GET /identity/v3/users/9bc957e7e21e48e4a17eea8f5cc5f7ce => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:22.623236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43769ba2-d0bb-4374-968f-cae4584857dd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:22.670554 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:22.719242 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43769ba2-d0bb-4374-968f-cae4584857dd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:22.751554 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a099334-ce65-41fe-ae9d-26516a283852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:22.752145 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a099334-ce65-41fe-ae9d-26516a283852 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:22.752420 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a099334-ce65-41fe-ae9d-26516a283852 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:22.752714 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a099334-ce65-41fe-ae9d-26516a283852 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:22.815561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a099334-ce65-41fe-ae9d-26516a283852 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:22.817000 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a099334-ce65-41fe-ae9d-26516a283852 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:22.862779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:22.910958 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 584/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:35:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 10:35:22.917039 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f63ac-1b6b-40a4-97bc-22081c258240 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:23.012564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f63ac-1b6b-40a4-97bc-22081c258240 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:23.015291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:23.046070 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca60b45-ca93-4011-89b7-415ef47781a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:23.046689 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca60b45-ca93-4011-89b7-415ef47781a6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:23.046967 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca60b45-ca93-4011-89b7-415ef47781a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:23.047240 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca60b45-ca93-4011-89b7-415ef47781a6 None admin] PATH_INFO: `/v3/projects/266db0b7e96249888f454cc6e500a406` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:23.048345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca60b45-ca93-4011-89b7-415ef47781a6 None admin] RBAC: Authorizing `identity:get_project(project_id=266db0b7e96249888f454cc6e500a406)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:23.049794 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca60b45-ca93-4011-89b7-415ef47781a6 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:23.051398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 576/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:35:22 2022] GET /identity/v3/projects/266db0b7e96249888f454cc6e500a406 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:23.057347 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a099334-ce65-41fe-ae9d-26516a283852 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:23.152171 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a099334-ce65-41fe-ae9d-26516a283852 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:23.185742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8acdc-86ab-4057-b516-6ef4a8c7dcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:23.186333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8acdc-86ab-4057-b516-6ef4a8c7dcee None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:23.186612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8acdc-86ab-4057-b516-6ef4a8c7dcee None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:23.186882 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8acdc-86ab-4057-b516-6ef4a8c7dcee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:23.187601 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8acdc-86ab-4057-b516-6ef4a8c7dcee None admin] RBAC: Adding query filter params (role.id=529cb3511f3a498b9b7169ed5b0f6b8e, scope.project.id=266db0b7e96249888f454cc6e500a406, user.id=9bc957e7e21e48e4a17eea8f5cc5f7ce) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:35:23.187910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8acdc-86ab-4057-b516-6ef4a8c7dcee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:23.189373 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8acdc-86ab-4057-b516-6ef4a8c7dcee None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:23.194916 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 585/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:35:23 2022] GET /identity/v3/role_assignments?user.id=9bc957e7e21e48e4a17eea8f5cc5f7ce&scope.project.id=266db0b7e96249888f454cc6e500a406&role.id=529cb3511f3a498b9b7169ed5b0f6b8e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:25.312510 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69927b1-a55a-4c4f-a2c2-6b0a8ad02ad9 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:25.313082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69927b1-a55a-4c4f-a2c2-6b0a8ad02ad9 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:25.313082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69927b1-a55a-4c4f-a2c2-6b0a8ad02ad9 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:25.314391 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 577/1162] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:35:25.319766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619efa0a-f050-4584-93dc-1dd9f46e6073 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:25.320185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619efa0a-f050-4584-93dc-1dd9f46e6073 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:25.320307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619efa0a-f050-4584-93dc-1dd9f46e6073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:25.337936 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-619efa0a-f050-4584-93dc-1dd9f46e6073 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:35:25.339112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-619efa0a-f050-4584-93dc-1dd9f46e6073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:35:25.348199 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:25.404610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 586/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:35:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:35:25.672710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69927b1-a55a-4c4f-a2c2-6b0a8ad02ad9 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:25.774785 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69927b1-a55a-4c4f-a2c2-6b0a8ad02ad9 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:25.806982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb9a61-d542-4d04-a150-41ee0c4901d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:25.807575 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb9a61-d542-4d04-a150-41ee0c4901d0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:25.807853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb9a61-d542-4d04-a150-41ee0c4901d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:25.808124 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb9a61-d542-4d04-a150-41ee0c4901d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:25.847295 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:25.873798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb9a61-d542-4d04-a150-41ee0c4901d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:25.875229 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb9a61-d542-4d04-a150-41ee0c4901d0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:25.969584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 578/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:35:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 10:35:25.975836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619efa0a-f050-4584-93dc-1dd9f46e6073 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:26.069750 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619efa0a-f050-4584-93dc-1dd9f46e6073 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:26.101452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1744c4-267a-4121-8d06-e6df441361c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:26.102066 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1744c4-267a-4121-8d06-e6df441361c8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:26.102344 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1744c4-267a-4121-8d06-e6df441361c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:26.102615 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1744c4-267a-4121-8d06-e6df441361c8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:26.109467 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1744c4-267a-4121-8d06-e6df441361c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:26.110886 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1744c4-267a-4121-8d06-e6df441361c8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:26.121866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ca1744c4-267a-4121-8d06-e6df441361c8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 11 10:35:26.121866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:35:26.121866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 10:35:26.121866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 10:35:26.121866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:35:26.121866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:35:26.121866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:35:26.121866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:35:26.121866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 11 10:35:26.121866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:35:26.121866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:35:26.121866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:35:26.121866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:35:26.121866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:35:26.121866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:35:26.121866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:35:26.121866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:35:26.123112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:35:26.123112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:35:26.123112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:35:26.123112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:35:26.123112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:35:26.123112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:35:26.123112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:35:26.123112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:35:26.123112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:35:26.123112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:35:26.123112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:35:26.123112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:35:26.123112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:35:26.123112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:35:26.123112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:35:26.123112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:35:26.123977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:35:26.123977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:35:26.123977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:35:26.123977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:35:26.123977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:35:26.123977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:35:26.123977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:35:26.123977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:35:26.123977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:35:26.123977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:35:26.123977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 10:35:26.123977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:35:26.123977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 11 10:35:26.123977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:35:26.123977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 587/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Sep 11 10:35:25 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:35:26.128995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb9a61-d542-4d04-a150-41ee0c4901d0 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:26.195760 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:26.224194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb9a61-d542-4d04-a150-41ee0c4901d0 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:26.256433 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459b5bb-4d70-49c0-b626-7b85f9b1eabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:26.257049 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459b5bb-4d70-49c0-b626-7b85f9b1eabd None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:26.257326 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459b5bb-4d70-49c0-b626-7b85f9b1eabd None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:26.257603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459b5bb-4d70-49c0-b626-7b85f9b1eabd None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:26.258234 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459b5bb-4d70-49c0-b626-7b85f9b1eabd None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:35:26.258539 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459b5bb-4d70-49c0-b626-7b85f9b1eabd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:26.259881 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459b5bb-4d70-49c0-b626-7b85f9b1eabd None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:26.267434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 579/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Sep 11 10:35:26 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:28.415212 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8aa04-921f-40db-946a-6dadf45e9d40 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:28.415771 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8aa04-921f-40db-946a-6dadf45e9d40 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:28.415771 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8aa04-921f-40db-946a-6dadf45e9d40 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:28.417134 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 588/1167] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:35:28.422434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72741b80-140e-48cf-8b6d-1c7caa3f2386 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:28.422852 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72741b80-140e-48cf-8b6d-1c7caa3f2386 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:28.422980 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72741b80-140e-48cf-8b6d-1c7caa3f2386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:28.441129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-72741b80-140e-48cf-8b6d-1c7caa3f2386 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:35:28.442291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-72741b80-140e-48cf-8b6d-1c7caa3f2386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:35:28.506138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 580/1168] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:35:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:35:28.779252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8aa04-921f-40db-946a-6dadf45e9d40 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:28.783122 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:28.876897 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8aa04-921f-40db-946a-6dadf45e9d40 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:28.908327 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264977d5-bb38-4d31-a5b0-6391ac420dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:28.908937 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264977d5-bb38-4d31-a5b0-6391ac420dd5 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:28.909216 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264977d5-bb38-4d31-a5b0-6391ac420dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:28.909488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264977d5-bb38-4d31-a5b0-6391ac420dd5 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:28.910142 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264977d5-bb38-4d31-a5b0-6391ac420dd5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:28.911486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264977d5-bb38-4d31-a5b0-6391ac420dd5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:28.926580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 589/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Sun Sep 11 10:35:28 2022] POST /identity/v3/domains => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:35:31.068812 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf1c97-0f8c-4b2b-b360-13bf09477227 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:31.069338 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf1c97-0f8c-4b2b-b360-13bf09477227 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:31.069441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf1c97-0f8c-4b2b-b360-13bf09477227 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:31.070710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 581/1170] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:35:31.076567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bdbe3-308d-4045-b3eb-e3700d735bce None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:31.076989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bdbe3-308d-4045-b3eb-e3700d735bce None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:31.077089 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bdbe3-308d-4045-b3eb-e3700d735bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:31.095287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-be9bdbe3-308d-4045-b3eb-e3700d735bce None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:35:31.096741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-be9bdbe3-308d-4045-b3eb-e3700d735bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:35:31.151747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:31.161430 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 590/1171] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:35:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:35:31.426860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf1c97-0f8c-4b2b-b360-13bf09477227 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:31.490849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:31.525870 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf1c97-0f8c-4b2b-b360-13bf09477227 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:31.558720 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545469a-fa13-400a-a571-14d3ade3b606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:31.559468 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545469a-fa13-400a-a571-14d3ade3b606 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:31.560270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545469a-fa13-400a-a571-14d3ade3b606 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:31.560539 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545469a-fa13-400a-a571-14d3ade3b606 None admin] PATH_INFO: `/v3/domains/0fb2f34be7784b96ac7effe34eab0f49` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:31.570507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545469a-fa13-400a-a571-14d3ade3b606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0fb2f34be7784b96ac7effe34eab0f49)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:31.571928 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545469a-fa13-400a-a571-14d3ade3b606 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:31.573520 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 582/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Sun Sep 11 10:35:31 2022] GET /identity/v3/domains/0fb2f34be7784b96ac7effe34eab0f49 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:31.579984 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bdbe3-308d-4045-b3eb-e3700d735bce None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:31.692518 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bdbe3-308d-4045-b3eb-e3700d735bce None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:31.725944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bc393-2e33-42df-8fad-ae6e6959ac4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:31.726548 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bc393-2e33-42df-8fad-ae6e6959ac4c None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:31.726827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bc393-2e33-42df-8fad-ae6e6959ac4c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:31.727099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bc393-2e33-42df-8fad-ae6e6959ac4c None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:31.727767 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bc393-2e33-42df-8fad-ae6e6959ac4c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:31.729224 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bc393-2e33-42df-8fad-ae6e6959ac4c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:31.754971 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 591/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 10:35:31 2022] POST /identity/v3/projects => generated 361 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:35:33.942417 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c16ae-dfc5-407c-894c-d33101a3e422 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:33.942939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c16ae-dfc5-407c-894c-d33101a3e422 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:33.942939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c16ae-dfc5-407c-894c-d33101a3e422 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:33.944285 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 583/1174] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:35:33.949564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab72ef-4827-4e9f-bad6-56aa5d5165d0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:33.949937 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab72ef-4827-4e9f-bad6-56aa5d5165d0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:33.950188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab72ef-4827-4e9f-bad6-56aa5d5165d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:33.968417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d3ab72ef-4827-4e9f-bad6-56aa5d5165d0 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:35:33.969576 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d3ab72ef-4827-4e9f-bad6-56aa5d5165d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:35:34.009177 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:34.033623 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 592/1175] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:35:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:35:34.297880 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c16ae-dfc5-407c-894c-d33101a3e422 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:34.397682 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c16ae-dfc5-407c-894c-d33101a3e422 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:34.423220 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:34.431977 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe657dc-eea6-4a34-82fa-4c2e92855d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:34.432618 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe657dc-eea6-4a34-82fa-4c2e92855d1d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:34.432895 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe657dc-eea6-4a34-82fa-4c2e92855d1d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:34.433162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe657dc-eea6-4a34-82fa-4c2e92855d1d None admin] PATH_INFO: `/v3/domains/0fb2f34be7784b96ac7effe34eab0f49` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:34.434256 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe657dc-eea6-4a34-82fa-4c2e92855d1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=0fb2f34be7784b96ac7effe34eab0f49)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:34.435666 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe657dc-eea6-4a34-82fa-4c2e92855d1d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:34.437235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 584/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Sun Sep 11 10:35:34 2022] GET /identity/v3/domains/0fb2f34be7784b96ac7effe34eab0f49 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:34.442870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab72ef-4827-4e9f-bad6-56aa5d5165d0 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:34.537415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab72ef-4827-4e9f-bad6-56aa5d5165d0 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:34.569340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30a7cf-46d3-44df-ae9a-698e867bd86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:34.569920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30a7cf-46d3-44df-ae9a-698e867bd86f None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:34.570192 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30a7cf-46d3-44df-ae9a-698e867bd86f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:34.570455 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30a7cf-46d3-44df-ae9a-698e867bd86f None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:34.571092 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30a7cf-46d3-44df-ae9a-698e867bd86f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:34.572486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30a7cf-46d3-44df-ae9a-698e867bd86f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:34.592041 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 593/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 10:35:34 2022] POST /identity/v3/users => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:35:36.752960 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c317be-ea8b-46cb-ab26-369022d60b72 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:36.753428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c317be-ea8b-46cb-ab26-369022d60b72 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:36.753537 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c317be-ea8b-46cb-ab26-369022d60b72 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:36.754840 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 585/1178] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:35:36.760087 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371bbb3-acc4-47fd-8337-fc98f3c056ea None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:36.760509 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371bbb3-acc4-47fd-8337-fc98f3c056ea None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:36.760683 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371bbb3-acc4-47fd-8337-fc98f3c056ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:36.779063 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f371bbb3-acc4-47fd-8337-fc98f3c056ea None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:35:36.780255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f371bbb3-acc4-47fd-8337-fc98f3c056ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:35:36.805095 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:36.845132 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 594/1179] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:35:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:35:37.113314 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c317be-ea8b-46cb-ab26-369022d60b72 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:37.211470 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c317be-ea8b-46cb-ab26-369022d60b72 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:37.244271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ede082-9dd6-4392-8550-bb59cf113609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:37.244912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ede082-9dd6-4392-8550-bb59cf113609 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:37.245192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ede082-9dd6-4392-8550-bb59cf113609 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:37.245464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ede082-9dd6-4392-8550-bb59cf113609 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:37.255780 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ede082-9dd6-4392-8550-bb59cf113609 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:35:37.260608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-67ede082-9dd6-4392-8550-bb59cf113609 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:35:37.260608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:35:37.260608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:35:37.260608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:35:37.260608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:35:37.260608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:35:37.260608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:35:37.260608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:35:37.260608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:35:37.260608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:35:37.260608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:35:37.260608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:35:37.260608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:35:37.260608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:35:37.260608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:35:37.260608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:35:37.261705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:35:37.261705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:35:37.261705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:35:37.261705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:35:37.261705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:35:37.261705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:35:37.261705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:35:37.261705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:35:37.261705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:35:37.261705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:35:37.261705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:35:37.261705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:35:37.261705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:35:37.261705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:35:37.261705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:35:37.261705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:35:37.262606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:35:37.262606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:35:37.262606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:35:37.262606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:35:37.262606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:35:37.262606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:35:37.262606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:35:37.262606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:35:37.262606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:35:37.262606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:35:37.262606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:35:37.262606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:35:37.262606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 586/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:35:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:35:37.267615 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371bbb3-acc4-47fd-8337-fc98f3c056ea None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:37.361174 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371bbb3-acc4-47fd-8337-fc98f3c056ea None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:37.393314 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8665d-3015-4263-ba5e-b69c10f95434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:37.393846 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8665d-3015-4263-ba5e-b69c10f95434 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:37.394124 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8665d-3015-4263-ba5e-b69c10f95434 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:37.394395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8665d-3015-4263-ba5e-b69c10f95434 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:37.395047 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8665d-3015-4263-ba5e-b69c10f95434 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:35:37.395347 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8665d-3015-4263-ba5e-b69c10f95434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:37.396723 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8665d-3015-4263-ba5e-b69c10f95434 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:37.404896 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 595/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:35:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:37.410755 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ede082-9dd6-4392-8550-bb59cf113609 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:37.464727 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:37.509393 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ede082-9dd6-4392-8550-bb59cf113609 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:37.542362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea585d9c-7d6c-4c31-ae24-f8dcd4e181ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:37.542972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea585d9c-7d6c-4c31-ae24-f8dcd4e181ed None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:37.543253 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea585d9c-7d6c-4c31-ae24-f8dcd4e181ed None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:37.543530 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea585d9c-7d6c-4c31-ae24-f8dcd4e181ed None admin] PATH_INFO: `/v3/users/a5ba1896796747e780940fc8741f138a` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:37.556043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea585d9c-7d6c-4c31-ae24-f8dcd4e181ed None admin] RBAC: Authorizing `identity:get_user(user_id=a5ba1896796747e780940fc8741f138a)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:37.557499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea585d9c-7d6c-4c31-ae24-f8dcd4e181ed None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:37.559074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 587/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:35:37 2022] GET /identity/v3/users/a5ba1896796747e780940fc8741f138a => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:37.565273 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8665d-3015-4263-ba5e-b69c10f95434 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:37.590117 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:37.660349 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8665d-3015-4263-ba5e-b69c10f95434 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:37.691582 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ddb91-eb2a-41dc-96f9-02083a3a5f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:37.692165 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ddb91-eb2a-41dc-96f9-02083a3a5f92 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:37.692439 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ddb91-eb2a-41dc-96f9-02083a3a5f92 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:37.692732 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ddb91-eb2a-41dc-96f9-02083a3a5f92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:37.757939 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ddb91-eb2a-41dc-96f9-02083a3a5f92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:37.759377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ddb91-eb2a-41dc-96f9-02083a3a5f92 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:37.786487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:37.861878 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 596/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:35:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 10:35:37.867926 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea585d9c-7d6c-4c31-ae24-f8dcd4e181ed None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:37.965302 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea585d9c-7d6c-4c31-ae24-f8dcd4e181ed None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:37.978966 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:37.999926 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba14099-be84-4071-8b39-af5ba3a17a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:38.000563 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14099-be84-4071-8b39-af5ba3a17a75 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:38.000854 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14099-be84-4071-8b39-af5ba3a17a75 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:38.001124 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14099-be84-4071-8b39-af5ba3a17a75 None admin] PATH_INFO: `/v3/projects/2b753a8741434521a30a65718d2613db` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:38.002223 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba14099-be84-4071-8b39-af5ba3a17a75 None admin] RBAC: Authorizing `identity:get_project(project_id=2b753a8741434521a30a65718d2613db)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:38.003624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba14099-be84-4071-8b39-af5ba3a17a75 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:38.005281 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 588/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:35:37 2022] GET /identity/v3/projects/2b753a8741434521a30a65718d2613db => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:38.011370 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ddb91-eb2a-41dc-96f9-02083a3a5f92 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:38.107645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ddb91-eb2a-41dc-96f9-02083a3a5f92 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:38.131097 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:38.142121 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2f898-e5b4-492d-bc2e-963b13ef8fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:38.142715 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f898-e5b4-492d-bc2e-963b13ef8fe9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:38.142993 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f898-e5b4-492d-bc2e-963b13ef8fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:38.143263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f898-e5b4-492d-bc2e-963b13ef8fe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:38.143975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2f898-e5b4-492d-bc2e-963b13ef8fe9 None admin] RBAC: Adding query filter params (role.id=529cb3511f3a498b9b7169ed5b0f6b8e, scope.project.id=2b753a8741434521a30a65718d2613db, user.id=a5ba1896796747e780940fc8741f138a) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:35:38.144280 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2f898-e5b4-492d-bc2e-963b13ef8fe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:38.145800 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2f898-e5b4-492d-bc2e-963b13ef8fe9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:38.150928 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 597/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:35:38 2022] GET /identity/v3/role_assignments?user.id=a5ba1896796747e780940fc8741f138a&scope.project.id=2b753a8741434521a30a65718d2613db&role.id=529cb3511f3a498b9b7169ed5b0f6b8e => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:40.222062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a160e-8ca9-4aee-976a-f0fccac9776a None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:40.222583 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a160e-8ca9-4aee-976a-f0fccac9776a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:40.222583 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a160e-8ca9-4aee-976a-f0fccac9776a None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:40.223954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 589/1186] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:35:40.229094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44129a-4f09-4222-aa67-4c750ffc355c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:40.229504 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44129a-4f09-4222-aa67-4c750ffc355c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:40.229638 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44129a-4f09-4222-aa67-4c750ffc355c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:40.248328 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-5c44129a-4f09-4222-aa67-4c750ffc355c None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:35:40.249547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5c44129a-4f09-4222-aa67-4c750ffc355c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:35:40.311972 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 598/1187] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:35:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:35:40.582031 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a160e-8ca9-4aee-976a-f0fccac9776a None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:40.681789 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a160e-8ca9-4aee-976a-f0fccac9776a None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:40.714723 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842b914-7bca-44fe-9cb8-0e6e37b33305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:40.715877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842b914-7bca-44fe-9cb8-0e6e37b33305 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:40.716161 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842b914-7bca-44fe-9cb8-0e6e37b33305 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:40.716431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842b914-7bca-44fe-9cb8-0e6e37b33305 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:40.726645 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842b914-7bca-44fe-9cb8-0e6e37b33305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:35:40.731991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-4842b914-7bca-44fe-9cb8-0e6e37b33305 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:35:40.731991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:35:40.731991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:35:40.731991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:35:40.731991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:35:40.731991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:35:40.731991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:35:40.731991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:35:40.731991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:35:40.731991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:35:40.731991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:35:40.731991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:35:40.731991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:35:40.731991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:35:40.731991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:35:40.731991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:35:40.733120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:35:40.733120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:35:40.733120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:35:40.733120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:35:40.733120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:35:40.733120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:35:40.733120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:35:40.733120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:35:40.733120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:35:40.733120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:35:40.733120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:35:40.733120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:35:40.733120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:35:40.733120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:35:40.733120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:35:40.733120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:35:40.733965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:35:40.733965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:35:40.733965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:35:40.733965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:35:40.733965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:35:40.733965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:35:40.733965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:35:40.733965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:35:40.733965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:35:40.733965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:35:40.733965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:35:40.733965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:35:40.733965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 590/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:35:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:35:40.739272 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44129a-4f09-4222-aa67-4c750ffc355c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:40.833557 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44129a-4f09-4222-aa67-4c750ffc355c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:40.849832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:40.866291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856fda4-e616-4af9-8b41-242024edccff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:40.866888 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856fda4-e616-4af9-8b41-242024edccff None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:40.867162 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856fda4-e616-4af9-8b41-242024edccff None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:40.867428 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856fda4-e616-4af9-8b41-242024edccff None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:40.868074 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856fda4-e616-4af9-8b41-242024edccff None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:35:40.868370 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856fda4-e616-4af9-8b41-242024edccff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:40.869745 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856fda4-e616-4af9-8b41-242024edccff None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:40.877919 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 599/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:35:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:40.883761 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842b914-7bca-44fe-9cb8-0e6e37b33305 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:40.925013 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:40.980259 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842b914-7bca-44fe-9cb8-0e6e37b33305 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:41.013109 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6e56a-ce3c-4222-984e-bf7598a0f00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:41.013715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6e56a-ce3c-4222-984e-bf7598a0f00f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:41.013988 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6e56a-ce3c-4222-984e-bf7598a0f00f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:41.014256 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6e56a-ce3c-4222-984e-bf7598a0f00f None admin] PATH_INFO: `/v3/users/a5ba1896796747e780940fc8741f138a` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:41.015344 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6e56a-ce3c-4222-984e-bf7598a0f00f None admin] RBAC: Authorizing `identity:get_user(user_id=a5ba1896796747e780940fc8741f138a)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:41.016782 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6e56a-ce3c-4222-984e-bf7598a0f00f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:41.018322 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 591/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:35:40 2022] GET /identity/v3/users/a5ba1896796747e780940fc8741f138a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:41.024151 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856fda4-e616-4af9-8b41-242024edccff None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:41.120040 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856fda4-e616-4af9-8b41-242024edccff None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:41.151295 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8987a-9367-4b15-bc14-d5c2668d6cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:41.151909 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8987a-9367-4b15-bc14-d5c2668d6cef None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:41.152188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8987a-9367-4b15-bc14-d5c2668d6cef None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:41.152460 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8987a-9367-4b15-bc14-d5c2668d6cef None admin] PATH_INFO: `/v3/projects/2b753a8741434521a30a65718d2613db` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:41.154091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8987a-9367-4b15-bc14-d5c2668d6cef None admin] RBAC: Authorizing `identity:get_project(project_id=2b753a8741434521a30a65718d2613db)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:41.155498 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8987a-9367-4b15-bc14-d5c2668d6cef None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:41.157122 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 600/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:35:41 2022] GET /identity/v3/projects/2b753a8741434521a30a65718d2613db => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:41.162835 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6e56a-ce3c-4222-984e-bf7598a0f00f None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:41.259647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6e56a-ce3c-4222-984e-bf7598a0f00f None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:41.268610 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:41.293287 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848dfdf8-5dbf-4603-9725-5f6e4adf18c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:41.293932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dfdf8-5dbf-4603-9725-5f6e4adf18c9 None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:41.294229 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dfdf8-5dbf-4603-9725-5f6e4adf18c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:41.295049 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dfdf8-5dbf-4603-9725-5f6e4adf18c9 None admin] PATH_INFO: `/v3/projects/2b753a8741434521a30a65718d2613db/users/a5ba1896796747e780940fc8741f138a/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:41.296963 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848dfdf8-5dbf-4603-9725-5f6e4adf18c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b753a8741434521a30a65718d2613db, user_id=a5ba1896796747e780940fc8741f138a, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:41.298380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848dfdf8-5dbf-4603-9725-5f6e4adf18c9 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:41.310885 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 592/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:35:41 2022] PUT /identity/v3/projects/2b753a8741434521a30a65718d2613db/users/a5ba1896796747e780940fc8741f138a/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:35:43.470081 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae8311-6a1a-467a-bce0-242d27594153 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:43.470886 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae8311-6a1a-467a-bce0-242d27594153 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:43.470886 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae8311-6a1a-467a-bce0-242d27594153 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:43.472186 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 601/1193] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:35:43.477357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c16c6a-920a-4dd7-a49c-da10b22fb04a None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:43.477745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c16c6a-920a-4dd7-a49c-da10b22fb04a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:43.477911 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c16c6a-920a-4dd7-a49c-da10b22fb04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:43.495743 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-65c16c6a-920a-4dd7-a49c-da10b22fb04a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:35:43.496957 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-65c16c6a-920a-4dd7-a49c-da10b22fb04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:35:43.560922 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 593/1194] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:35:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:35:43.831884 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae8311-6a1a-467a-bce0-242d27594153 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:43.880334 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:43.929274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae8311-6a1a-467a-bce0-242d27594153 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:43.962317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d10461-fb92-4ec9-9478-c0c97f2a357c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:43.962929 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d10461-fb92-4ec9-9478-c0c97f2a357c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:43.963205 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d10461-fb92-4ec9-9478-c0c97f2a357c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:43.963745 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d10461-fb92-4ec9-9478-c0c97f2a357c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:43.974196 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d10461-fb92-4ec9-9478-c0c97f2a357c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:35:43.978930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-e7d10461-fb92-4ec9-9478-c0c97f2a357c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:35:43.978930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:35:43.978930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:35:43.978930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:35:43.978930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:35:43.978930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:35:43.978930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:35:43.978930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:35:43.978930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:35:43.978930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:35:43.978930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:35:43.978930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:35:43.978930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:35:43.978930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:35:43.978930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:35:43.978930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:35:43.979998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:35:43.979998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:35:43.979998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:35:43.979998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:35:43.979998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:35:43.979998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:35:43.979998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:35:43.979998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:35:43.979998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:35:43.979998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:35:43.979998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:35:43.979998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:35:43.979998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:35:43.979998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:35:43.979998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:35:43.979998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:35:43.981065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:35:43.981065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:35:43.981065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:35:43.981065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:35:43.981065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:35:43.981065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:35:43.981065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:35:43.981065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:35:43.981065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:35:43.981065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:35:43.981065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:35:43.981065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:35:43.981065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 602/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:35:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:35:43.986546 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c16c6a-920a-4dd7-a49c-da10b22fb04a None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:44.081464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:44.085585 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c16c6a-920a-4dd7-a49c-da10b22fb04a None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:44.119571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133f266-2ed2-474c-bf8f-c020234fdc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:44.120163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133f266-2ed2-474c-bf8f-c020234fdc5c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:44.120442 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133f266-2ed2-474c-bf8f-c020234fdc5c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:44.120745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133f266-2ed2-474c-bf8f-c020234fdc5c None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:44.121403 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133f266-2ed2-474c-bf8f-c020234fdc5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:35:44.121705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133f266-2ed2-474c-bf8f-c020234fdc5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:44.123671 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133f266-2ed2-474c-bf8f-c020234fdc5c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:44.131395 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 594/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:35:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:44.137384 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d10461-fb92-4ec9-9478-c0c97f2a357c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:44.232508 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d10461-fb92-4ec9-9478-c0c97f2a357c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:44.240785 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:44.265267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe7d3f-df78-4c73-be0a-6421aff95d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:44.265875 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe7d3f-df78-4c73-be0a-6421aff95d8a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:44.266150 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe7d3f-df78-4c73-be0a-6421aff95d8a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:44.266419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe7d3f-df78-4c73-be0a-6421aff95d8a None admin] PATH_INFO: `/v3/users/a5ba1896796747e780940fc8741f138a` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:44.267511 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe7d3f-df78-4c73-be0a-6421aff95d8a None admin] RBAC: Authorizing `identity:get_user(user_id=a5ba1896796747e780940fc8741f138a)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:44.268945 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe7d3f-df78-4c73-be0a-6421aff95d8a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:44.270482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 603/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 10:35:44 2022] GET /identity/v3/users/a5ba1896796747e780940fc8741f138a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:44.276161 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133f266-2ed2-474c-bf8f-c020234fdc5c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:44.372016 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133f266-2ed2-474c-bf8f-c020234fdc5c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:44.404779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204809e-6042-4cb5-9d4a-566327c6981d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:44.405363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204809e-6042-4cb5-9d4a-566327c6981d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:44.405637 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204809e-6042-4cb5-9d4a-566327c6981d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:44.405905 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204809e-6042-4cb5-9d4a-566327c6981d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:44.432923 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:44.472634 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204809e-6042-4cb5-9d4a-566327c6981d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:44.474049 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204809e-6042-4cb5-9d4a-566327c6981d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:44.568118 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 595/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:35:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 10:35:44.573945 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe7d3f-df78-4c73-be0a-6421aff95d8a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:44.668382 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe7d3f-df78-4c73-be0a-6421aff95d8a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:44.698944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624662fb-d3de-44ab-8466-158e2e29edae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:44.699551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624662fb-d3de-44ab-8466-158e2e29edae None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:44.699827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624662fb-d3de-44ab-8466-158e2e29edae None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:44.700095 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624662fb-d3de-44ab-8466-158e2e29edae None admin] PATH_INFO: `/v3/projects/2b753a8741434521a30a65718d2613db` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:44.701701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624662fb-d3de-44ab-8466-158e2e29edae None admin] RBAC: Authorizing `identity:get_project(project_id=2b753a8741434521a30a65718d2613db)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:44.703099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624662fb-d3de-44ab-8466-158e2e29edae None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:44.704869 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 604/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 10:35:44 2022] GET /identity/v3/projects/2b753a8741434521a30a65718d2613db => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:44.710776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204809e-6042-4cb5-9d4a-566327c6981d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:35:44.767449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:44.806456 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204809e-6042-4cb5-9d4a-566327c6981d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:35:44.839172 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab1520-288f-4aac-b082-bac923026f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:35:44.839761 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab1520-288f-4aac-b082-bac923026f39 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:35:44.840036 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab1520-288f-4aac-b082-bac923026f39 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:35:44.840306 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab1520-288f-4aac-b082-bac923026f39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:35:44.841126 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab1520-288f-4aac-b082-bac923026f39 None admin] RBAC: Adding query filter params (role.id=529cb3511f3a498b9b7169ed5b0f6b8e, scope.project.id=2b753a8741434521a30a65718d2613db, user.id=a5ba1896796747e780940fc8741f138a) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:35:44.841436 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab1520-288f-4aac-b082-bac923026f39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:35:44.842844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab1520-288f-4aac-b082-bac923026f39 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:35:44.848604 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 596/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:35:44 2022] GET /identity/v3/role_assignments?user.id=a5ba1896796747e780940fc8741f138a&scope.project.id=2b753a8741434521a30a65718d2613db&role.id=529cb3511f3a498b9b7169ed5b0f6b8e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:35:54.695024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=78 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:35:54.846098 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=38 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:40.285443 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd004b-b351-4bc6-9f5e-e51fa882e3af None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:40.286108 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd004b-b351-4bc6-9f5e-e51fa882e3af None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:40.286108 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd004b-b351-4bc6-9f5e-e51fa882e3af None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:40.287508 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 605/1201] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:36:40.294073 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ea9e1-1c86-45b7-9e92-4e8f39763d16 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:40.294577 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ea9e1-1c86-45b7-9e92-4e8f39763d16 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:40.294669 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ea9e1-1c86-45b7-9e92-4e8f39763d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:40.314262 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-fd7ea9e1-1c86-45b7-9e92-4e8f39763d16 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:36:40.315500 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fd7ea9e1-1c86-45b7-9e92-4e8f39763d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:36:40.401671 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 597/1202] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:36:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:36:40.680896 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd004b-b351-4bc6-9f5e-e51fa882e3af None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:40.807874 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd004b-b351-4bc6-9f5e-e51fa882e3af None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:40.851893 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39379a1f-f2c1-4b1d-955f-9c17e53d5528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:40.852532 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39379a1f-f2c1-4b1d-955f-9c17e53d5528 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:40.852841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39379a1f-f2c1-4b1d-955f-9c17e53d5528 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:40.853117 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39379a1f-f2c1-4b1d-955f-9c17e53d5528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:40.873328 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39379a1f-f2c1-4b1d-955f-9c17e53d5528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:40.874784 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39379a1f-f2c1-4b1d-955f-9c17e53d5528 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:40.889913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-39379a1f-f2c1-4b1d-955f-9c17e53d5528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:36:40.889913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:36:40.889913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:36:40.889913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:36:40.889913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:36:40.889913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:36:40.889913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:36:40.889913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:36:40.889913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:36:40.889913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:36:40.889913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:36:40.889913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:36:40.889913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:36:40.889913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:36:40.889913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:36:40.889913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:36:40.896396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:36:40.896396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:36:40.896396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:36:40.896396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:36:40.896396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:36:40.896396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:36:40.896396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:36:40.896396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:36:40.896396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:36:40.896396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:36:40.896396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:36:40.896396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:36:40.896396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:36:40.896396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:36:40.896396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:36:40.896396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:36:40.896396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:36:40.897628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:36:40.897628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:36:40.897628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:36:40.897628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 606/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:36:40.897887 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ea9e1-1c86-45b7-9e92-4e8f39763d16 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:41.019534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ea9e1-1c86-45b7-9e92-4e8f39763d16 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:41.061929 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:41.069141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e029336-8ba3-4003-aade-010c0d983ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:41.069762 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e029336-8ba3-4003-aade-010c0d983ad6 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:41.070047 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e029336-8ba3-4003-aade-010c0d983ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:41.070325 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e029336-8ba3-4003-aade-010c0d983ad6 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:41.070978 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e029336-8ba3-4003-aade-010c0d983ad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:36:41.071292 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e029336-8ba3-4003-aade-010c0d983ad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:41.072717 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e029336-8ba3-4003-aade-010c0d983ad6 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:41.084938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 598/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:36:41.094564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39379a1f-f2c1-4b1d-955f-9c17e53d5528 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:41.162724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:41.221950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39379a1f-f2c1-4b1d-955f-9c17e53d5528 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:41.265946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fb0b4-b296-4a0e-b900-514aa4951f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:41.266562 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fb0b4-b296-4a0e-b900-514aa4951f0c None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:41.266843 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fb0b4-b296-4a0e-b900-514aa4951f0c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:41.267123 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fb0b4-b296-4a0e-b900-514aa4951f0c None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:41.267775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fb0b4-b296-4a0e-b900-514aa4951f0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:41.275950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fb0b4-b296-4a0e-b900-514aa4951f0c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:41.305804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 607/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 10:36:41 2022] POST /identity/v3/users => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:36:43.813073 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f959be-6e13-4c2e-b5a4-10624895c691 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:43.813642 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f959be-6e13-4c2e-b5a4-10624895c691 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:43.813642 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f959be-6e13-4c2e-b5a4-10624895c691 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:43.815463 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 599/1206] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:36:43.821575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41b690-86d8-41f3-b963-11e0e20d1cc3 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:43.823923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41b690-86d8-41f3-b963-11e0e20d1cc3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:43.823923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41b690-86d8-41f3-b963-11e0e20d1cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:43.846868 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-1d41b690-86d8-41f3-b963-11e0e20d1cc3 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:36:43.848664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1d41b690-86d8-41f3-b963-11e0e20d1cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:36:43.926474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 608/1207] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:36:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:36:44.206524 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f959be-6e13-4c2e-b5a4-10624895c691 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:44.335430 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f959be-6e13-4c2e-b5a4-10624895c691 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:44.375631 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadba3d5-2683-44a3-be46-297a5f058ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:44.376272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadba3d5-2683-44a3-be46-297a5f058ace None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:44.376567 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadba3d5-2683-44a3-be46-297a5f058ace None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:44.376846 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadba3d5-2683-44a3-be46-297a5f058ace None admin] PATH_INFO: `/v3/roles/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:44.389362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadba3d5-2683-44a3-be46-297a5f058ace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:36:44.394831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-cadba3d5-2683-44a3-be46-297a5f058ace None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:36:44.394831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:36:44.394831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:36:44.394831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:36:44.394831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:36:44.394831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:36:44.394831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:36:44.394831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:36:44.394831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:36:44.394831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:36:44.394831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:36:44.394831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:36:44.394831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:36:44.394831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:36:44.394831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:36:44.394831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:36:44.396017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:36:44.396017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:36:44.396017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:36:44.396017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:36:44.396017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:36:44.396017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:36:44.396017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:36:44.396017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:36:44.396017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:36:44.396017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:36:44.396017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:36:44.396017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:36:44.396017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:36:44.396017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:36:44.396017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:36:44.396017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:36:44.396999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:36:44.396999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:36:44.396999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:36:44.396999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:36:44.396999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:36:44.396999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:36:44.396999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:36:44.396999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:36:44.396999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:36:44.396999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:36:44.396999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:36:44.396999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:36:44.396999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 600/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:36:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:36:44.402353 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41b690-86d8-41f3-b963-11e0e20d1cc3 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:44.451022 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:44.522125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41b690-86d8-41f3-b963-11e0e20d1cc3 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:44.567486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3154d4-71f8-4d40-adf4-571d6f4db858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:44.568296 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3154d4-71f8-4d40-adf4-571d6f4db858 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:44.568626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3154d4-71f8-4d40-adf4-571d6f4db858 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:44.568914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3154d4-71f8-4d40-adf4-571d6f4db858 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:44.569868 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3154d4-71f8-4d40-adf4-571d6f4db858 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:36:44.570160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3154d4-71f8-4d40-adf4-571d6f4db858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:44.571836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3154d4-71f8-4d40-adf4-571d6f4db858 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:44.581486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 609/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:36:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:36:44.587951 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadba3d5-2683-44a3-be46-297a5f058ace None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:44.650067 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:44.717159 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadba3d5-2683-44a3-be46-297a5f058ace None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:44.757557 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1b8c8-4d70-4df4-ba71-4bb921f7f0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:44.758325 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1b8c8-4d70-4df4-ba71-4bb921f7f0ce None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:44.758666 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1b8c8-4d70-4df4-ba71-4bb921f7f0ce None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:44.759028 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1b8c8-4d70-4df4-ba71-4bb921f7f0ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:44.771795 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1b8c8-4d70-4df4-ba71-4bb921f7f0ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:44.773546 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1b8c8-4d70-4df4-ba71-4bb921f7f0ce None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:44.789222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-38b1b8c8-4d70-4df4-ba71-4bb921f7f0ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:36:44.789222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:36:44.789222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:36:44.789222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:36:44.789222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:36:44.789222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:36:44.789222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:36:44.789222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:36:44.789222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:36:44.789222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:36:44.789222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:36:44.789222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:36:44.789222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:36:44.789222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:36:44.789222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:36:44.789222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:36:44.790396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:36:44.790396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:36:44.790396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:36:44.790396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:36:44.790396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:36:44.790396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:36:44.790396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:36:44.790396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:36:44.790396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:36:44.790396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:36:44.790396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:36:44.790396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:36:44.790396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:36:44.790396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:36:44.790396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:36:44.790396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:36:44.790396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:36:44.791448 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:36:44.791448 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:36:44.791448 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:36:44.791448 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 601/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:36:44.796704 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3154d4-71f8-4d40-adf4-571d6f4db858 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:44.907537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:44.910762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3154d4-71f8-4d40-adf4-571d6f4db858 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:44.947987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dac313-2ec3-4d30-bec8-1ca8907720f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:44.948667 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dac313-2ec3-4d30-bec8-1ca8907720f6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:44.948968 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dac313-2ec3-4d30-bec8-1ca8907720f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:44.949235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dac313-2ec3-4d30-bec8-1ca8907720f6 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:44.949878 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dac313-2ec3-4d30-bec8-1ca8907720f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:36:44.950187 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dac313-2ec3-4d30-bec8-1ca8907720f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:44.951693 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dac313-2ec3-4d30-bec8-1ca8907720f6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:44.964968 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 610/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:36:44.970898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1b8c8-4d70-4df4-ba71-4bb921f7f0ce None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:45.086015 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1b8c8-4d70-4df4-ba71-4bb921f7f0ce None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:45.087731 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:45.129710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55c8c4-41f5-4662-bf08-bd951ba64d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:45.130433 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55c8c4-41f5-4662-bf08-bd951ba64d3b None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:45.130771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55c8c4-41f5-4662-bf08-bd951ba64d3b None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:45.131099 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55c8c4-41f5-4662-bf08-bd951ba64d3b None admin] PATH_INFO: `/v3/users/placement` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:45.141225 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55c8c4-41f5-4662-bf08-bd951ba64d3b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:45.142850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55c8c4-41f5-4662-bf08-bd951ba64d3b None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:45.154461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-ae55c8c4-41f5-4662-bf08-bd951ba64d3b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 10:36:45.154461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:36:45.154461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:36:45.154461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:36:45.154461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:36:45.154461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:36:45.154461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:36:45.154461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:36:45.154461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:36:45.154461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:36:45.154461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:36:45.154461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:36:45.154461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:36:45.154461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:36:45.154461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:36:45.154461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:36:45.155630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:36:45.155630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:36:45.155630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:36:45.155630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:36:45.155630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:36:45.155630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:36:45.155630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:36:45.155630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:36:45.155630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:36:45.155630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:36:45.155630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:36:45.155630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:36:45.155630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:36:45.155630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:36:45.155630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:36:45.155630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:36:45.155630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:36:45.155630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:36:45.157035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:36:45.157035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:36:45.157035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:36:45.157035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:36:45.157035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:36:45.157035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:36:45.157035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:36:45.157035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:36:45.157035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 10:36:45.157035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:36:45.160782 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 602/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:36:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:36:45.162782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dac313-2ec3-4d30-bec8-1ca8907720f6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:45.269862 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dac313-2ec3-4d30-bec8-1ca8907720f6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:45.306447 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321eee0e-63ef-4dde-9305-4c489cd25cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:45.307150 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eee0e-63ef-4dde-9305-4c489cd25cf5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:45.307519 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eee0e-63ef-4dde-9305-4c489cd25cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:45.307727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eee0e-63ef-4dde-9305-4c489cd25cf5 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:45.308459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321eee0e-63ef-4dde-9305-4c489cd25cf5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:36:45.308838 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321eee0e-63ef-4dde-9305-4c489cd25cf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:45.310255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321eee0e-63ef-4dde-9305-4c489cd25cf5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:45.333067 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 611/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Sep 11 10:36:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:36:45.334392 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55c8c4-41f5-4662-bf08-bd951ba64d3b None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:45.454136 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55c8c4-41f5-4662-bf08-bd951ba64d3b None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:45.488727 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf7e0e-b7c7-4485-a308-96e5a4b13abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:45.489330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf7e0e-b7c7-4485-a308-96e5a4b13abe None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:45.489611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf7e0e-b7c7-4485-a308-96e5a4b13abe None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:45.489878 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf7e0e-b7c7-4485-a308-96e5a4b13abe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:45.521390 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:45.563169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf7e0e-b7c7-4485-a308-96e5a4b13abe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:45.564661 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf7e0e-b7c7-4485-a308-96e5a4b13abe None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:45.678542 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 603/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:36:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 10:36:45.685023 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321eee0e-63ef-4dde-9305-4c489cd25cf5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:45.704129 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:45.793666 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321eee0e-63ef-4dde-9305-4c489cd25cf5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:45.833209 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f3e9d-5d65-4a8b-bef9-b4e813b28fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:45.833842 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f3e9d-5d65-4a8b-bef9-b4e813b28fa7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:45.834118 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f3e9d-5d65-4a8b-bef9-b4e813b28fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:45.834387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f3e9d-5d65-4a8b-bef9-b4e813b28fa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:45.845738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f3e9d-5d65-4a8b-bef9-b4e813b28fa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:45.847168 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f3e9d-5d65-4a8b-bef9-b4e813b28fa7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:45.863127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-364f3e9d-5d65-4a8b-bef9-b4e813b28fa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:36:45.863127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:36:45.863127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:36:45.863127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:36:45.863127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:36:45.863127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:36:45.863127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:36:45.863127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:36:45.863127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:36:45.863127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:36:45.863127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:36:45.863127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:36:45.863127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:36:45.863127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:36:45.863127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:36:45.863127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:36:45.864228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:36:45.864228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:36:45.864228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:36:45.864228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:36:45.864228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:36:45.864228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:36:45.864228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:36:45.864228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:36:45.864228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:36:45.864228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:36:45.864228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:36:45.864228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:36:45.864228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:36:45.864228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:36:45.864228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:36:45.864228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:36:45.864228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:36:45.865202 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:36:45.865202 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:36:45.865202 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:36:45.865202 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 612/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:36:45.870491 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf7e0e-b7c7-4485-a308-96e5a4b13abe None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:45.943364 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:45.992983 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf7e0e-b7c7-4485-a308-96e5a4b13abe None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:46.032907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e4166-3bd8-4a20-aa6e-a55efed10720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:46.033526 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e4166-3bd8-4a20-aa6e-a55efed10720 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:46.033809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e4166-3bd8-4a20-aa6e-a55efed10720 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:46.034144 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e4166-3bd8-4a20-aa6e-a55efed10720 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:46.034877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e4166-3bd8-4a20-aa6e-a55efed10720 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:36:46.035217 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e4166-3bd8-4a20-aa6e-a55efed10720 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:46.036797 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e4166-3bd8-4a20-aa6e-a55efed10720 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:46.051394 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 604/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:36:46.057209 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f3e9d-5d65-4a8b-bef9-b4e813b28fa7 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:46.139080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:46.179715 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f3e9d-5d65-4a8b-bef9-b4e813b28fa7 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:46.233668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e950d6-9d4e-43c8-8c5a-f4ce5660e6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:46.234471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e950d6-9d4e-43c8-8c5a-f4ce5660e6f2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:46.234859 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e950d6-9d4e-43c8-8c5a-f4ce5660e6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:46.235269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e950d6-9d4e-43c8-8c5a-f4ce5660e6f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:46.244063 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e950d6-9d4e-43c8-8c5a-f4ce5660e6f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:46.245497 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e950d6-9d4e-43c8-8c5a-f4ce5660e6f2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:46.261485 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-10e950d6-9d4e-43c8-8c5a-f4ce5660e6f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:36:46.261485 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:36:46.261485 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:36:46.261485 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:36:46.261485 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:36:46.261485 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:36:46.261485 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:36:46.261485 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:36:46.261485 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:36:46.261485 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:36:46.261485 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:36:46.261485 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:36:46.261485 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:36:46.261485 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:36:46.261485 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:36:46.262737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:36:46.262737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:36:46.262737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:36:46.262737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:36:46.262737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:36:46.262737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:36:46.262737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:36:46.262737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:36:46.262737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:36:46.262737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:36:46.262737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:36:46.262737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:36:46.262737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:36:46.262737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:36:46.262737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:36:46.262737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:36:46.262737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:36:46.268574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:36:46.268574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:36:46.268574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:36:46.268574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:36:46.268574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:36:46.268574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:36:46.268574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:36:46.268574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:36:46.268574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 613/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:36:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:36:46.269217 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e4166-3bd8-4a20-aa6e-a55efed10720 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:46.391334 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e4166-3bd8-4a20-aa6e-a55efed10720 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:46.415740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:46.428049 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c466f-929d-4bf5-879d-e2e41df401c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:46.428714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c466f-929d-4bf5-879d-e2e41df401c0 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:46.429043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c466f-929d-4bf5-879d-e2e41df401c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:46.429271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c466f-929d-4bf5-879d-e2e41df401c0 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:46.429961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c466f-929d-4bf5-879d-e2e41df401c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:36:46.430267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c466f-929d-4bf5-879d-e2e41df401c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:46.431773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c466f-929d-4bf5-879d-e2e41df401c0 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:46.446025 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 605/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:36:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:36:46.452749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e950d6-9d4e-43c8-8c5a-f4ce5660e6f2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:46.567816 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e950d6-9d4e-43c8-8c5a-f4ce5660e6f2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:46.600771 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:46.608965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46930e91-6413-4f8f-9f4e-d1afb3fd541f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:46.609870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46930e91-6413-4f8f-9f4e-d1afb3fd541f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:46.610249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46930e91-6413-4f8f-9f4e-d1afb3fd541f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:46.610562 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46930e91-6413-4f8f-9f4e-d1afb3fd541f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:46.611614 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46930e91-6413-4f8f-9f4e-d1afb3fd541f None admin] RBAC: Adding query filter params (role.id=295de8f316124ccdac36a50e50531148, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=7f0211a05cca4e72b30d64eef4ba527c) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:36:46.611988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46930e91-6413-4f8f-9f4e-d1afb3fd541f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:46.613591 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46930e91-6413-4f8f-9f4e-d1afb3fd541f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:46.626678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 614/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:36:46 2022] GET /identity/v3/role_assignments?user.id=7f0211a05cca4e72b30d64eef4ba527c&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=295de8f316124ccdac36a50e50531148 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:36:48.910380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e72cb0-4ccf-42fa-b730-e6cf3d907792 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:48.910903 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e72cb0-4ccf-42fa-b730-e6cf3d907792 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:48.911029 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e72cb0-4ccf-42fa-b730-e6cf3d907792 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:48.912482 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 606/1220] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:36:48.918775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e677fc4-38dc-461e-9fac-b8595e524d1a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:48.919223 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e677fc4-38dc-461e-9fac-b8595e524d1a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:48.919316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e677fc4-38dc-461e-9fac-b8595e524d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:48.938902 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-6e677fc4-38dc-461e-9fac-b8595e524d1a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:36:48.940067 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6e677fc4-38dc-461e-9fac-b8595e524d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:36:49.016100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 615/1221] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:36:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:36:49.298652 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e72cb0-4ccf-42fa-b730-e6cf3d907792 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:49.404365 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e72cb0-4ccf-42fa-b730-e6cf3d907792 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:49.441676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae1778-7db5-46a4-9a50-a5f033956711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:49.442845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae1778-7db5-46a4-9a50-a5f033956711 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:49.443189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae1778-7db5-46a4-9a50-a5f033956711 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:49.443470 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae1778-7db5-46a4-9a50-a5f033956711 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:49.458557 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae1778-7db5-46a4-9a50-a5f033956711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:36:49.467496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-ecae1778-7db5-46a4-9a50-a5f033956711 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:36:49.467496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:36:49.467496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:36:49.467496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:36:49.467496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:36:49.467496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:36:49.467496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:36:49.467496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:36:49.467496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:36:49.467496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:36:49.467496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:36:49.467496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:36:49.467496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:36:49.467496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:36:49.467496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:36:49.467496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:36:49.468658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:36:49.468658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:36:49.468658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:36:49.468658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:36:49.468658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:36:49.468658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:36:49.468658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:36:49.468658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:36:49.468658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:36:49.468658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:36:49.468658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:36:49.468658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:36:49.468658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:36:49.468658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:36:49.468658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:36:49.468658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:36:49.473187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:36:49.473187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:36:49.473187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:36:49.473187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:36:49.473187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:36:49.473187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:36:49.473187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:36:49.473187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:36:49.473187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:36:49.473187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:36:49.473187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:36:49.473187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:36:49.473187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 607/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:36:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:36:49.475761 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e677fc4-38dc-461e-9fac-b8595e524d1a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:49.581041 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e677fc4-38dc-461e-9fac-b8595e524d1a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:49.606503 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:49.617812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202c35d-c054-475f-a009-7a6d9b67abcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:49.618423 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202c35d-c054-475f-a009-7a6d9b67abcb None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:49.618699 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202c35d-c054-475f-a009-7a6d9b67abcb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:49.618972 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202c35d-c054-475f-a009-7a6d9b67abcb None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:49.619767 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202c35d-c054-475f-a009-7a6d9b67abcb None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:36:49.619992 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202c35d-c054-475f-a009-7a6d9b67abcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:49.621403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202c35d-c054-475f-a009-7a6d9b67abcb None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:49.630274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 616/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:36:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:36:49.636934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae1778-7db5-46a4-9a50-a5f033956711 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:49.686786 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:49.754538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae1778-7db5-46a4-9a50-a5f033956711 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:49.801353 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98010c-ad32-43c8-92e2-859f6c37aee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:49.802005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98010c-ad32-43c8-92e2-859f6c37aee5 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:49.802283 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98010c-ad32-43c8-92e2-859f6c37aee5 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:49.802556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98010c-ad32-43c8-92e2-859f6c37aee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:49.814640 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98010c-ad32-43c8-92e2-859f6c37aee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:49.816407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98010c-ad32-43c8-92e2-859f6c37aee5 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:49.833842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-5b98010c-ad32-43c8-92e2-859f6c37aee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:36:49.833842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:36:49.833842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:36:49.833842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:36:49.833842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:36:49.833842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:36:49.833842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:36:49.833842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:36:49.833842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:36:49.833842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:36:49.833842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:36:49.833842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:36:49.833842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:36:49.833842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:36:49.833842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:36:49.833842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:36:49.835168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:36:49.835168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:36:49.835168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:36:49.835168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:36:49.835168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:36:49.835168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:36:49.835168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:36:49.835168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:36:49.835168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:36:49.835168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:36:49.835168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:36:49.835168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:36:49.835168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:36:49.835168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:36:49.835168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:36:49.835168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:36:49.835168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:36:49.836073 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:36:49.836073 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:36:49.836073 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:36:49.836073 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 608/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:36:49.841015 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202c35d-c054-475f-a009-7a6d9b67abcb None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:49.949578 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202c35d-c054-475f-a009-7a6d9b67abcb None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:49.984931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e92af0-d68d-421e-958e-c08ef7dec770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:49.985527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e92af0-d68d-421e-958e-c08ef7dec770 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:49.986224 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e92af0-d68d-421e-958e-c08ef7dec770 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:49.986500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e92af0-d68d-421e-958e-c08ef7dec770 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:49.987249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e92af0-d68d-421e-958e-c08ef7dec770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:36:49.987626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e92af0-d68d-421e-958e-c08ef7dec770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:49.989081 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e92af0-d68d-421e-958e-c08ef7dec770 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:50.002040 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 617/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:36:50.007931 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98010c-ad32-43c8-92e2-859f6c37aee5 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:50.108530 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:50.115768 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98010c-ad32-43c8-92e2-859f6c37aee5 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:50.158441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76028940-c945-405c-9248-507d138f5cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:50.159345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76028940-c945-405c-9248-507d138f5cd3 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:50.159776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76028940-c945-405c-9248-507d138f5cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:50.160221 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76028940-c945-405c-9248-507d138f5cd3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:50.170430 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76028940-c945-405c-9248-507d138f5cd3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:50.172239 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76028940-c945-405c-9248-507d138f5cd3 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:50.187860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-76028940-c945-405c-9248-507d138f5cd3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 10:36:50.187860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:36:50.187860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:36:50.187860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:36:50.187860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:36:50.187860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:36:50.187860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:36:50.187860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:36:50.187860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:36:50.187860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:36:50.187860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:36:50.187860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:36:50.187860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:36:50.187860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:36:50.187860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:36:50.187860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:36:50.189062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:36:50.189062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:36:50.189062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:36:50.189062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:36:50.189062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:36:50.189062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:36:50.189062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:36:50.189062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:36:50.189062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:36:50.189062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:36:50.189062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:36:50.189062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:36:50.189062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:36:50.189062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:36:50.189062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:36:50.189062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:36:50.189062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:36:50.189062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:36:50.190156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:36:50.190156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:36:50.190156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:36:50.190156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:36:50.190156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:36:50.190156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:36:50.190156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:36:50.190156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:36:50.190156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 10:36:50.190156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:36:50.190156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 609/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:36:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:36:50.195215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e92af0-d68d-421e-958e-c08ef7dec770 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:50.248750 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:50.309280 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e92af0-d68d-421e-958e-c08ef7dec770 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:50.349308 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829c35d-83ea-4cb4-86f7-cac002edc677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:50.349922 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829c35d-83ea-4cb4-86f7-cac002edc677 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:50.350203 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829c35d-83ea-4cb4-86f7-cac002edc677 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:50.350479 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829c35d-83ea-4cb4-86f7-cac002edc677 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:50.351252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829c35d-83ea-4cb4-86f7-cac002edc677 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:36:50.351612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829c35d-83ea-4cb4-86f7-cac002edc677 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:50.353296 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829c35d-83ea-4cb4-86f7-cac002edc677 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:50.372275 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 618/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Sep 11 10:36:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:36:50.381083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76028940-c945-405c-9248-507d138f5cd3 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:50.492676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76028940-c945-405c-9248-507d138f5cd3 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:50.528826 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501c654-b040-4ddf-b012-676bcf345b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:50.529523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501c654-b040-4ddf-b012-676bcf345b29 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:50.529838 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501c654-b040-4ddf-b012-676bcf345b29 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:50.530139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501c654-b040-4ddf-b012-676bcf345b29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:50.542615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501c654-b040-4ddf-b012-676bcf345b29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:50.544329 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501c654-b040-4ddf-b012-676bcf345b29 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:50.559910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-8501c654-b040-4ddf-b012-676bcf345b29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:36:50.559910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:36:50.559910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:36:50.559910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:36:50.559910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:36:50.559910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:36:50.559910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:36:50.559910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:36:50.559910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:36:50.559910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:36:50.559910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:36:50.559910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:36:50.559910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:36:50.559910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:36:50.559910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:36:50.559910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:36:50.561134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:36:50.561134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:36:50.561134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:36:50.561134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:36:50.561134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:36:50.561134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:36:50.561134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:36:50.561134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:36:50.561134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:36:50.561134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:36:50.561134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:36:50.561134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:36:50.561134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:36:50.561134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:36:50.561134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:36:50.561134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:36:50.561134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:36:50.562022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:36:50.562022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:36:50.562022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:36:50.562022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 610/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:36:50.566980 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829c35d-83ea-4cb4-86f7-cac002edc677 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:50.673380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829c35d-83ea-4cb4-86f7-cac002edc677 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:50.675530 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:50.714104 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa432b9-e6dd-4019-83a6-74d9935ab85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:50.714778 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa432b9-e6dd-4019-83a6-74d9935ab85a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:50.715090 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa432b9-e6dd-4019-83a6-74d9935ab85a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:50.715388 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa432b9-e6dd-4019-83a6-74d9935ab85a None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:50.716145 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa432b9-e6dd-4019-83a6-74d9935ab85a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:36:50.716385 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa432b9-e6dd-4019-83a6-74d9935ab85a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:50.717990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa432b9-e6dd-4019-83a6-74d9935ab85a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:50.731613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 619/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:36:50.737504 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501c654-b040-4ddf-b012-676bcf345b29 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:50.746938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:50.846573 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501c654-b040-4ddf-b012-676bcf345b29 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:50.888328 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1d310-a24d-45c0-bbe7-563a62e6afec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:50.888994 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1d310-a24d-45c0-bbe7-563a62e6afec None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:50.889272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1d310-a24d-45c0-bbe7-563a62e6afec None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:50.889541 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1d310-a24d-45c0-bbe7-563a62e6afec None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:50.897501 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1d310-a24d-45c0-bbe7-563a62e6afec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:50.899350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1d310-a24d-45c0-bbe7-563a62e6afec None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:50.911331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-d1d1d310-a24d-45c0-bbe7-563a62e6afec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:36:50.911331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:36:50.911331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:36:50.911331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:36:50.911331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:36:50.911331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:36:50.911331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:36:50.911331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:36:50.911331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:36:50.911331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:36:50.911331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:36:50.911331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:36:50.911331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:36:50.911331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:36:50.911331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:36:50.912401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:36:50.912401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:36:50.912401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:36:50.912401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:36:50.912401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:36:50.912401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:36:50.912401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:36:50.912401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:36:50.912401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:36:50.912401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:36:50.912401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:36:50.912401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:36:50.912401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:36:50.912401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:36:50.912401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:36:50.912401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:36:50.912401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:36:50.913641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:36:50.913641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:36:50.913641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:36:50.913641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:36:50.913641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:36:50.913641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:36:50.913641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:36:50.913641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:36:50.913641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 611/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:36:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:36:50.919371 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa432b9-e6dd-4019-83a6-74d9935ab85a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:51.025914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa432b9-e6dd-4019-83a6-74d9935ab85a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:51.060553 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1467971-a9b6-46b2-aed9-7d749688396c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:51.061174 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1467971-a9b6-46b2-aed9-7d749688396c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:51.061452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1467971-a9b6-46b2-aed9-7d749688396c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:51.061722 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1467971-a9b6-46b2-aed9-7d749688396c None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:51.062406 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1467971-a9b6-46b2-aed9-7d749688396c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:36:51.062706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1467971-a9b6-46b2-aed9-7d749688396c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:51.064115 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1467971-a9b6-46b2-aed9-7d749688396c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:51.075769 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 620/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:36:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:36:51.082251 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1d310-a24d-45c0-bbe7-563a62e6afec None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:51.149580 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:51.188208 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1d310-a24d-45c0-bbe7-563a62e6afec None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:51.227391 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90672b8-ae93-4fb7-83c5-a860989a0f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:51.228170 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90672b8-ae93-4fb7-83c5-a860989a0f88 None admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:51.228478 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90672b8-ae93-4fb7-83c5-a860989a0f88 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:51.228907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90672b8-ae93-4fb7-83c5-a860989a0f88 None admin] PATH_INFO: `/v3/projects/cd477d464e9f48149879362d04db9b9e/users/7f0211a05cca4e72b30d64eef4ba527c/roles/295de8f316124ccdac36a50e50531148` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:51.244263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90672b8-ae93-4fb7-83c5-a860989a0f88 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd477d464e9f48149879362d04db9b9e, user_id=7f0211a05cca4e72b30d64eef4ba527c, role_id=295de8f316124ccdac36a50e50531148)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:51.245783 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90672b8-ae93-4fb7-83c5-a860989a0f88 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:51.260338 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 612/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:36:51 2022] PUT /identity/v3/projects/cd477d464e9f48149879362d04db9b9e/users/7f0211a05cca4e72b30d64eef4ba527c/roles/295de8f316124ccdac36a50e50531148 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:36:53.713496 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b54daa-efed-4b4a-8d34-9ea8af2b5e10 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:53.714040 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b54daa-efed-4b4a-8d34-9ea8af2b5e10 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:53.714040 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b54daa-efed-4b4a-8d34-9ea8af2b5e10 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:53.715447 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 621/1233] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:36:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:36:53.721137 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10558832-cb4b-4fc9-a8f2-4c88231c2521 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:53.721599 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10558832-cb4b-4fc9-a8f2-4c88231c2521 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:53.721742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10558832-cb4b-4fc9-a8f2-4c88231c2521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:53.741008 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-10558832-cb4b-4fc9-a8f2-4c88231c2521 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:36:53.742241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-10558832-cb4b-4fc9-a8f2-4c88231c2521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:36:53.815042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 613/1234] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:36:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:36:54.092079 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b54daa-efed-4b4a-8d34-9ea8af2b5e10 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:54.116911 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:54.209026 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b54daa-efed-4b4a-8d34-9ea8af2b5e10 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:54.258021 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70036965-8ac4-4d21-95b5-de14730b6b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:54.258690 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70036965-8ac4-4d21-95b5-de14730b6b07 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:54.259003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70036965-8ac4-4d21-95b5-de14730b6b07 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:54.259320 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70036965-8ac4-4d21-95b5-de14730b6b07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:54.270973 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70036965-8ac4-4d21-95b5-de14730b6b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:36:54.276626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-70036965-8ac4-4d21-95b5-de14730b6b07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:36:54.276626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:36:54.276626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:36:54.276626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:36:54.276626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:36:54.276626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:36:54.276626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:36:54.276626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:36:54.276626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:36:54.276626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:36:54.276626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:36:54.276626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:36:54.276626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:36:54.276626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:36:54.276626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:36:54.276626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:36:54.277848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:36:54.277848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:36:54.277848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:36:54.277848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:36:54.277848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:36:54.277848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:36:54.277848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:36:54.277848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:36:54.277848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:36:54.277848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:36:54.277848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:36:54.277848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:36:54.277848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:36:54.277848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:36:54.277848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:36:54.277848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:36:54.279062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:36:54.279062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:36:54.279062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:36:54.279062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:36:54.279062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:36:54.279062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:36:54.279062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:36:54.279062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:36:54.279062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:36:54.279062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:36:54.279062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 10:36:54.279062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:36:54.279062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 622/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 10:36:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:36:54.284743 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10558832-cb4b-4fc9-a8f2-4c88231c2521 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:54.340157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:54.402435 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10558832-cb4b-4fc9-a8f2-4c88231c2521 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:54.446446 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e281f0-2d19-4fb3-8a29-3c8b1b488a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:54.447783 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e281f0-2d19-4fb3-8a29-3c8b1b488a42 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:54.448169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e281f0-2d19-4fb3-8a29-3c8b1b488a42 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:54.448583 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e281f0-2d19-4fb3-8a29-3c8b1b488a42 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:54.449347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e281f0-2d19-4fb3-8a29-3c8b1b488a42 None admin] RBAC: Adding query filter params (name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:36:54.449656 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e281f0-2d19-4fb3-8a29-3c8b1b488a42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:54.451312 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e281f0-2d19-4fb3-8a29-3c8b1b488a42 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:54.461550 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 614/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 10:36:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:36:54.468449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70036965-8ac4-4d21-95b5-de14730b6b07 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:54.571530 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:54.593423 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70036965-8ac4-4d21-95b5-de14730b6b07 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:54.639614 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb132e6-0405-4f88-bccb-618c007ee38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:54.640244 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb132e6-0405-4f88-bccb-618c007ee38b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:54.640530 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb132e6-0405-4f88-bccb-618c007ee38b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:54.640879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb132e6-0405-4f88-bccb-618c007ee38b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:54.653245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb132e6-0405-4f88-bccb-618c007ee38b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:54.654879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb132e6-0405-4f88-bccb-618c007ee38b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:54.672691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-3eb132e6-0405-4f88-bccb-618c007ee38b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:36:54.672691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:36:54.672691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:36:54.672691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:36:54.672691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:36:54.672691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:36:54.672691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:36:54.672691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:36:54.672691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:36:54.672691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:36:54.672691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:36:54.672691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:36:54.672691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:36:54.672691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:36:54.672691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:36:54.672691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:36:54.673953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:36:54.673953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:36:54.673953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:36:54.673953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:36:54.673953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:36:54.673953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:36:54.673953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:36:54.673953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:36:54.673953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:36:54.673953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:36:54.673953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:36:54.673953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:36:54.673953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:36:54.673953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:36:54.673953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:36:54.673953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:36:54.673953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:36:54.675288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:36:54.675288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:36:54.675288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:36:54.675288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 623/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:36:54.680221 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e281f0-2d19-4fb3-8a29-3c8b1b488a42 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:54.798576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e281f0-2d19-4fb3-8a29-3c8b1b488a42 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:54.809525 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:54.836992 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629c1f7-0722-46ef-b9f0-95e3afc9f9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:54.837718 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629c1f7-0722-46ef-b9f0-95e3afc9f9ca None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:54.838596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629c1f7-0722-46ef-b9f0-95e3afc9f9ca None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:54.838907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629c1f7-0722-46ef-b9f0-95e3afc9f9ca None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:54.839641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629c1f7-0722-46ef-b9f0-95e3afc9f9ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:36:54.840091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629c1f7-0722-46ef-b9f0-95e3afc9f9ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:54.841769 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629c1f7-0722-46ef-b9f0-95e3afc9f9ca None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:54.856758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 615/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:36:54.863782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb132e6-0405-4f88-bccb-618c007ee38b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:54.969592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb132e6-0405-4f88-bccb-618c007ee38b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:55.009073 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0c4cb-e312-42b2-96a5-16f5c2ea9854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:55.009754 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0c4cb-e312-42b2-96a5-16f5c2ea9854 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:55.010019 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0c4cb-e312-42b2-96a5-16f5c2ea9854 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:55.010291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0c4cb-e312-42b2-96a5-16f5c2ea9854 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:55.013020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:55.019717 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0c4cb-e312-42b2-96a5-16f5c2ea9854 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:55.021407 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0c4cb-e312-42b2-96a5-16f5c2ea9854 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:55.033452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-c7a0c4cb-e312-42b2-96a5-16f5c2ea9854 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 10:36:55.033452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:36:55.033452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:36:55.033452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:36:55.033452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:36:55.033452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:36:55.033452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:36:55.033452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:36:55.033452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:36:55.033452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:36:55.033452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:36:55.033452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:36:55.033452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:36:55.033452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:36:55.033452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:36:55.033452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:36:55.034628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:36:55.034628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:36:55.034628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:36:55.034628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:36:55.034628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:36:55.034628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:36:55.034628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:36:55.034628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:36:55.034628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:36:55.034628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:36:55.034628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:36:55.034628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:36:55.034628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:36:55.034628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:36:55.034628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:36:55.034628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:36:55.034628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:36:55.034628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:36:55.035844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:36:55.035844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:36:55.035844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:36:55.035844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:36:55.035844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:36:55.035844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:36:55.035844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:36:55.035844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:36:55.035844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 10:36:55.035844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:36:55.035844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 624/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:36:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:36:55.040609 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629c1f7-0722-46ef-b9f0-95e3afc9f9ca None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:55.148405 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629c1f7-0722-46ef-b9f0-95e3afc9f9ca None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:55.186599 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3640577-2e07-485b-953a-65d6dc362122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:55.187598 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3640577-2e07-485b-953a-65d6dc362122 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:55.187598 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3640577-2e07-485b-953a-65d6dc362122 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:55.187812 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3640577-2e07-485b-953a-65d6dc362122 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:55.188452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3640577-2e07-485b-953a-65d6dc362122 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:36:55.188791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3640577-2e07-485b-953a-65d6dc362122 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:55.190219 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3640577-2e07-485b-953a-65d6dc362122 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:55.211235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 616/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Sep 11 10:36:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:36:55.219659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0c4cb-e312-42b2-96a5-16f5c2ea9854 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:55.330776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0c4cb-e312-42b2-96a5-16f5c2ea9854 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:55.370296 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b59fd-1e11-426a-a48c-1477ecfdb11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:55.370899 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b59fd-1e11-426a-a48c-1477ecfdb11f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:55.371176 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b59fd-1e11-426a-a48c-1477ecfdb11f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:55.371443 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b59fd-1e11-426a-a48c-1477ecfdb11f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:55.435897 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:55.441971 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b59fd-1e11-426a-a48c-1477ecfdb11f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:55.443735 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b59fd-1e11-426a-a48c-1477ecfdb11f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:55.562919 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 625/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:36:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 10:36:55.569149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3640577-2e07-485b-953a-65d6dc362122 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:55.599895 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:55.679570 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3640577-2e07-485b-953a-65d6dc362122 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:55.720452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ec07a-9f7e-42e9-8bee-93c572f0aa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:55.721186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ec07a-9f7e-42e9-8bee-93c572f0aa59 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:55.721547 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ec07a-9f7e-42e9-8bee-93c572f0aa59 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:55.721925 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ec07a-9f7e-42e9-8bee-93c572f0aa59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:55.734186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ec07a-9f7e-42e9-8bee-93c572f0aa59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:55.735882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ec07a-9f7e-42e9-8bee-93c572f0aa59 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:55.752176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-af2ec07a-9f7e-42e9-8bee-93c572f0aa59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:36:55.752176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:36:55.752176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:36:55.752176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:36:55.752176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:36:55.752176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:36:55.752176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:36:55.752176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:36:55.752176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:36:55.752176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:36:55.752176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:36:55.752176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:36:55.752176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:36:55.752176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:36:55.752176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:36:55.752176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:36:55.753425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:36:55.753425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:36:55.753425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:36:55.753425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:36:55.753425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:36:55.753425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:36:55.753425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:36:55.753425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:36:55.753425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:36:55.753425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:36:55.753425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:36:55.753425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:36:55.753425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:36:55.753425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:36:55.753425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:36:55.753425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:36:55.753425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:36:55.754468 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:36:55.754468 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:36:55.754468 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:36:55.754468 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 617/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:36:55.760513 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b59fd-1e11-426a-a48c-1477ecfdb11f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:55.859072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:55.865379 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b59fd-1e11-426a-a48c-1477ecfdb11f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:55.912130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ab26a-d407-4e2e-b902-bc957f8c5883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:55.912130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ab26a-d407-4e2e-b902-bc957f8c5883 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:55.912130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ab26a-d407-4e2e-b902-bc957f8c5883 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:55.912130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ab26a-d407-4e2e-b902-bc957f8c5883 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:55.912647 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ab26a-d407-4e2e-b902-bc957f8c5883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:36:55.912647 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ab26a-d407-4e2e-b902-bc957f8c5883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:55.912647 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ab26a-d407-4e2e-b902-bc957f8c5883 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:55.928698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 626/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:36:55.934149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ec07a-9f7e-42e9-8bee-93c572f0aa59 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:56.018641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:56.053132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ec07a-9f7e-42e9-8bee-93c572f0aa59 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:56.095542 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e65a8d-a9f5-4201-b47d-6e2f0950941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:56.096218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e65a8d-a9f5-4201-b47d-6e2f0950941e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:56.096537 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e65a8d-a9f5-4201-b47d-6e2f0950941e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:56.096874 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e65a8d-a9f5-4201-b47d-6e2f0950941e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:56.104271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e65a8d-a9f5-4201-b47d-6e2f0950941e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:56.105819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e65a8d-a9f5-4201-b47d-6e2f0950941e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:56.117531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-a7e65a8d-a9f5-4201-b47d-6e2f0950941e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:36:56.117531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:36:56.117531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:36:56.117531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:36:56.117531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:36:56.117531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:36:56.117531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:36:56.117531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:36:56.117531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:36:56.117531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:36:56.117531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:36:56.117531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:36:56.117531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:36:56.117531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:36:56.117531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:36:56.118503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:36:56.118503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:36:56.118503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:36:56.118503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:36:56.118503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:36:56.118503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:36:56.118503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:36:56.118503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:36:56.118503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:36:56.118503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:36:56.118503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:36:56.118503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:36:56.118503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:36:56.118503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:36:56.118503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:36:56.118503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:36:56.118503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:36:56.119989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:36:56.119989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:36:56.119989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:36:56.119989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:36:56.119989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:36:56.119989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:36:56.119989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:36:56.119989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:36:56.119989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 618/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:36:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:36:56.125602 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ab26a-d407-4e2e-b902-bc957f8c5883 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:56.237985 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ab26a-d407-4e2e-b902-bc957f8c5883 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:56.277667 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a111ac-2036-4fbc-92d7-e12f92968a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:56.278295 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a111ac-2036-4fbc-92d7-e12f92968a58 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:56.278636 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a111ac-2036-4fbc-92d7-e12f92968a58 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:56.278967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a111ac-2036-4fbc-92d7-e12f92968a58 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:56.279788 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a111ac-2036-4fbc-92d7-e12f92968a58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:36:56.280141 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a111ac-2036-4fbc-92d7-e12f92968a58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:56.281790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a111ac-2036-4fbc-92d7-e12f92968a58 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:56.299736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 627/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:36:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:36:56.305985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e65a8d-a9f5-4201-b47d-6e2f0950941e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:56.422615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e65a8d-a9f5-4201-b47d-6e2f0950941e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:56.461555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482a8ab-4c44-4130-b1e9-628c0de8f4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:56.462598 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482a8ab-4c44-4130-b1e9-628c0de8f4f9 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:56.463493 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482a8ab-4c44-4130-b1e9-628c0de8f4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:56.463766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482a8ab-4c44-4130-b1e9-628c0de8f4f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:56.464679 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482a8ab-4c44-4130-b1e9-628c0de8f4f9 None admin] RBAC: Adding query filter params (role.id=295de8f316124ccdac36a50e50531148, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=7f0211a05cca4e72b30d64eef4ba527c) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:36:56.464998 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482a8ab-4c44-4130-b1e9-628c0de8f4f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:56.466700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482a8ab-4c44-4130-b1e9-628c0de8f4f9 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:56.472806 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 619/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:36:56 2022] GET /identity/v3/role_assignments?user.id=7f0211a05cca4e72b30d64eef4ba527c&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=295de8f316124ccdac36a50e50531148 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:36:58.963336 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a5817-70d6-4197-a5ce-769eda543f14 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:58.963854 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a5817-70d6-4197-a5ce-769eda543f14 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:58.963854 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a5817-70d6-4197-a5ce-769eda543f14 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:58.965297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 628/1247] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:36:58.971084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01294d31-78bf-4480-adf1-2d0542989812 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:58.971564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01294d31-78bf-4480-adf1-2d0542989812 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:58.971658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01294d31-78bf-4480-adf1-2d0542989812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:58.979581 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:58.994138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-01294d31-78bf-4480-adf1-2d0542989812 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:36:58.995494 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-01294d31-78bf-4480-adf1-2d0542989812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:36:59.070215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 620/1248] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:36:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:36:59.375963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a5817-70d6-4197-a5ce-769eda543f14 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:59.395864 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:59.489147 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a5817-70d6-4197-a5ce-769eda543f14 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:59.527106 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541e898-96e4-4dab-8852-89b467242c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:59.527753 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541e898-96e4-4dab-8852-89b467242c57 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:59.528032 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541e898-96e4-4dab-8852-89b467242c57 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:59.528299 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541e898-96e4-4dab-8852-89b467242c57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:59.539801 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541e898-96e4-4dab-8852-89b467242c57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:36:59.545484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-c541e898-96e4-4dab-8852-89b467242c57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:36:59.545484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:36:59.545484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:36:59.545484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:36:59.545484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:36:59.545484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:36:59.545484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:36:59.545484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:36:59.545484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:36:59.545484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:36:59.545484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:36:59.545484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:36:59.545484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:36:59.545484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:36:59.545484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:36:59.545484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:36:59.546698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:36:59.546698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:36:59.546698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:36:59.546698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:36:59.546698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:36:59.546698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:36:59.546698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:36:59.546698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:36:59.546698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:36:59.546698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:36:59.546698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:36:59.546698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:36:59.546698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:36:59.546698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:36:59.546698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:36:59.546698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:36:59.547685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:36:59.547685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:36:59.547685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:36:59.547685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:36:59.547685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:36:59.547685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:36:59.547685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:36:59.547685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:36:59.547685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:36:59.547685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:36:59.547685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:36:59.547685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:36:59.547685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 629/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:36:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:36:59.552951 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01294d31-78bf-4480-adf1-2d0542989812 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:59.664378 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01294d31-78bf-4480-adf1-2d0542989812 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:59.695738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:59.701216 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728ea49-3e71-4765-897d-2b80627c8a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:59.701914 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728ea49-3e71-4765-897d-2b80627c8a7c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:59.702263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728ea49-3e71-4765-897d-2b80627c8a7c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:59.702605 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728ea49-3e71-4765-897d-2b80627c8a7c None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:59.703358 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728ea49-3e71-4765-897d-2b80627c8a7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:36:59.703730 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728ea49-3e71-4765-897d-2b80627c8a7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:59.705219 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728ea49-3e71-4765-897d-2b80627c8a7c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:59.715779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 621/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:36:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:36:59.721958 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541e898-96e4-4dab-8852-89b467242c57 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:36:59.804613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:36:59.828650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541e898-96e4-4dab-8852-89b467242c57 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:36:59.862000 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa4e11-2b39-4f10-bd76-dae795415bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:36:59.862627 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa4e11-2b39-4f10-bd76-dae795415bd8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:36:59.862901 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa4e11-2b39-4f10-bd76-dae795415bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:36:59.863169 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa4e11-2b39-4f10-bd76-dae795415bd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:36:59.874531 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa4e11-2b39-4f10-bd76-dae795415bd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:36:59.876031 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa4e11-2b39-4f10-bd76-dae795415bd8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:36:59.890938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-14aa4e11-2b39-4f10-bd76-dae795415bd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:36:59.890938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:36:59.890938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:36:59.890938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:36:59.890938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:36:59.890938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:36:59.890938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:36:59.890938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:36:59.890938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:36:59.890938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:36:59.890938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:36:59.890938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:36:59.890938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:36:59.890938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:36:59.890938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:36:59.890938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:36:59.891944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:36:59.891944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:36:59.891944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:36:59.891944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:36:59.891944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:36:59.891944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:36:59.891944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:36:59.891944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:36:59.891944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:36:59.891944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:36:59.891944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:36:59.891944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:36:59.891944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:36:59.891944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:36:59.891944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:36:59.891944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:36:59.891944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:36:59.892910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:36:59.892910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:36:59.892910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:36:59.892910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 630/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 10:36:59.898331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728ea49-3e71-4765-897d-2b80627c8a7c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:00.007300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728ea49-3e71-4765-897d-2b80627c8a7c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:00.043366 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca0179-33f3-4fe1-a476-db36128932f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:00.043974 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca0179-33f3-4fe1-a476-db36128932f4 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:00.044255 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca0179-33f3-4fe1-a476-db36128932f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:00.044524 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca0179-33f3-4fe1-a476-db36128932f4 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:00.045276 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca0179-33f3-4fe1-a476-db36128932f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:00.045578 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca0179-33f3-4fe1-a476-db36128932f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:00.046936 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca0179-33f3-4fe1-a476-db36128932f4 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:00.060026 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 622/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:37:00.065804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa4e11-2b39-4f10-bd76-dae795415bd8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:00.162437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa4e11-2b39-4f10-bd76-dae795415bd8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:00.187866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:00.195979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11744e39-8798-423b-87bc-47db51a9aa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:00.196626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11744e39-8798-423b-87bc-47db51a9aa87 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:00.196934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11744e39-8798-423b-87bc-47db51a9aa87 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:00.197208 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11744e39-8798-423b-87bc-47db51a9aa87 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:00.205492 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11744e39-8798-423b-87bc-47db51a9aa87 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:00.207320 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11744e39-8798-423b-87bc-47db51a9aa87 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:00.221415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-11744e39-8798-423b-87bc-47db51a9aa87 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 10:37:00.221415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:37:00.221415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:37:00.221415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:37:00.221415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:37:00.221415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:37:00.221415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:37:00.221415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:37:00.221415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:37:00.221415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:37:00.221415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:37:00.221415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:37:00.221415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:37:00.221415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:37:00.221415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:37:00.221415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:37:00.222664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:37:00.222664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:37:00.222664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:37:00.222664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:37:00.222664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:37:00.222664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:37:00.222664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:37:00.222664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:37:00.222664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:37:00.222664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:37:00.222664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:37:00.222664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:37:00.222664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:37:00.222664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:37:00.222664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:37:00.222664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:37:00.222664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:37:00.222664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:37:00.224024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:37:00.224024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:37:00.224024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:37:00.224024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:37:00.224024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:37:00.224024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:37:00.224024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:37:00.224024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:37:00.224024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 10:37:00.224024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:37:00.224024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 631/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:37:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:37:00.229408 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca0179-33f3-4fe1-a476-db36128932f4 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:00.297082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:00.339954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca0179-33f3-4fe1-a476-db36128932f4 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:00.373373 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad3715-6ae6-4d66-b5f8-600b12461ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:00.373976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad3715-6ae6-4d66-b5f8-600b12461ca8 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:00.374253 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad3715-6ae6-4d66-b5f8-600b12461ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:00.374525 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad3715-6ae6-4d66-b5f8-600b12461ca8 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:00.375247 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad3715-6ae6-4d66-b5f8-600b12461ca8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:00.375549 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad3715-6ae6-4d66-b5f8-600b12461ca8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:00.377015 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad3715-6ae6-4d66-b5f8-600b12461ca8 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:00.393501 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 623/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Sep 11 10:37:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:37:00.399284 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11744e39-8798-423b-87bc-47db51a9aa87 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:00.493489 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11744e39-8798-423b-87bc-47db51a9aa87 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:00.524898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec64d91-47a9-454d-a16c-58e0fb1aa3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:00.525998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec64d91-47a9-454d-a16c-58e0fb1aa3f2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:00.526272 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec64d91-47a9-454d-a16c-58e0fb1aa3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:00.526538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec64d91-47a9-454d-a16c-58e0fb1aa3f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:00.579320 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:00.591829 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec64d91-47a9-454d-a16c-58e0fb1aa3f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:00.593296 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec64d91-47a9-454d-a16c-58e0fb1aa3f2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:00.686886 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 632/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:37:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 10:37:00.692705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad3715-6ae6-4d66-b5f8-600b12461ca8 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:00.790566 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad3715-6ae6-4d66-b5f8-600b12461ca8 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:00.803615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:00.824945 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f832b-0860-4ca2-8d5a-0ae968618c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:00.825564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f832b-0860-4ca2-8d5a-0ae968618c62 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:00.825838 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f832b-0860-4ca2-8d5a-0ae968618c62 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:00.826105 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f832b-0860-4ca2-8d5a-0ae968618c62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:00.835718 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f832b-0860-4ca2-8d5a-0ae968618c62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:00.837124 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f832b-0860-4ca2-8d5a-0ae968618c62 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:00.851890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-599f832b-0860-4ca2-8d5a-0ae968618c62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:37:00.851890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:37:00.851890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:37:00.851890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:37:00.851890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:37:00.851890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:37:00.851890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:37:00.851890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:37:00.851890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:37:00.851890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:37:00.851890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:37:00.851890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:37:00.851890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:37:00.851890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:37:00.851890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:37:00.851890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:37:00.853027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:37:00.853027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:37:00.853027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:37:00.853027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:37:00.853027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:37:00.853027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:37:00.853027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:37:00.853027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:37:00.853027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:37:00.853027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:37:00.853027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:37:00.853027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:37:00.853027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:37:00.853027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:37:00.853027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:37:00.853027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:37:00.853027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:37:00.854141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:37:00.854141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:37:00.854141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:37:00.854141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 624/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:37:00.858845 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec64d91-47a9-454d-a16c-58e0fb1aa3f2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:00.940639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:00.952684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec64d91-47a9-454d-a16c-58e0fb1aa3f2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:00.984998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915ff18-8b81-4b03-8fbd-c66014da3d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:00.985590 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915ff18-8b81-4b03-8fbd-c66014da3d85 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:00.985864 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915ff18-8b81-4b03-8fbd-c66014da3d85 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:00.986131 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915ff18-8b81-4b03-8fbd-c66014da3d85 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:00.986763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915ff18-8b81-4b03-8fbd-c66014da3d85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:00.987063 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915ff18-8b81-4b03-8fbd-c66014da3d85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:00.988401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915ff18-8b81-4b03-8fbd-c66014da3d85 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:00.999792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 633/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:37:01.005428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f832b-0860-4ca2-8d5a-0ae968618c62 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:01.102740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f832b-0860-4ca2-8d5a-0ae968618c62 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:01.134829 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f7303-8739-47f8-951e-3f0e8c6a7e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:01.135434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f7303-8739-47f8-951e-3f0e8c6a7e6c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:01.135709 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f7303-8739-47f8-951e-3f0e8c6a7e6c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:01.135979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f7303-8739-47f8-951e-3f0e8c6a7e6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:01.142305 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f7303-8739-47f8-951e-3f0e8c6a7e6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:01.143727 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f7303-8739-47f8-951e-3f0e8c6a7e6c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:01.155150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-869f7303-8739-47f8-951e-3f0e8c6a7e6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:37:01.155150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:37:01.155150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:37:01.155150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:37:01.155150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:37:01.155150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:37:01.155150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:37:01.155150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:37:01.155150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:37:01.155150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:37:01.155150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:37:01.155150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:37:01.155150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:37:01.155150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:37:01.155150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:37:01.156166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:37:01.156166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:37:01.156166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:37:01.156166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:37:01.156166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:37:01.156166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:37:01.156166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:37:01.156166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:37:01.156166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:37:01.156166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:37:01.156166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:37:01.156166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:37:01.156166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:37:01.156166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:37:01.156166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:37:01.156166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:37:01.156166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:37:01.157299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:37:01.157299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:37:01.157299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:37:01.157299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:37:01.157299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:37:01.157299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:37:01.157299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:37:01.157299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:37:01.157299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 625/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:37:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:37:01.161994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915ff18-8b81-4b03-8fbd-c66014da3d85 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:01.265306 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915ff18-8b81-4b03-8fbd-c66014da3d85 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:01.297594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201efe56-2bc4-4bc7-a137-90949a086cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:01.298187 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201efe56-2bc4-4bc7-a137-90949a086cbd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:01.298465 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201efe56-2bc4-4bc7-a137-90949a086cbd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:01.298735 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201efe56-2bc4-4bc7-a137-90949a086cbd None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:01.299414 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201efe56-2bc4-4bc7-a137-90949a086cbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:01.299716 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201efe56-2bc4-4bc7-a137-90949a086cbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:01.301160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201efe56-2bc4-4bc7-a137-90949a086cbd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:01.312523 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 634/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:37:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:37:01.318667 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f7303-8739-47f8-951e-3f0e8c6a7e6c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:01.343781 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:01.416309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f7303-8739-47f8-951e-3f0e8c6a7e6c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:01.448289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7dd06-ca8e-415a-bd6b-1ea6bc539230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:01.448901 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7dd06-ca8e-415a-bd6b-1ea6bc539230 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:01.449180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7dd06-ca8e-415a-bd6b-1ea6bc539230 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:01.449451 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7dd06-ca8e-415a-bd6b-1ea6bc539230 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:01.450170 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7dd06-ca8e-415a-bd6b-1ea6bc539230 None admin] RBAC: Adding query filter params (role.id=529cb3511f3a498b9b7169ed5b0f6b8e, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=7f0211a05cca4e72b30d64eef4ba527c) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:01.450478 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7dd06-ca8e-415a-bd6b-1ea6bc539230 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:01.451888 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7dd06-ca8e-415a-bd6b-1ea6bc539230 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:01.457133 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 626/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:37:01 2022] GET /identity/v3/role_assignments?user.id=7f0211a05cca4e72b30d64eef4ba527c&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=529cb3511f3a498b9b7169ed5b0f6b8e => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:37:03.565195 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42bfc8-a791-4933-a897-e83b3a78152d None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:03.565722 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42bfc8-a791-4933-a897-e83b3a78152d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:03.565722 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42bfc8-a791-4933-a897-e83b3a78152d None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:03.567060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 635/1261] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:37:03.572720 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17e63d-96f8-411c-9f86-ef37125a1030 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:03.573139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17e63d-96f8-411c-9f86-ef37125a1030 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:03.573276 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17e63d-96f8-411c-9f86-ef37125a1030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:03.592439 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-9e17e63d-96f8-411c-9f86-ef37125a1030 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:37:03.593677 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9e17e63d-96f8-411c-9f86-ef37125a1030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:37:03.658876 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 627/1262] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:37:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:37:03.949161 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42bfc8-a791-4933-a897-e83b3a78152d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:03.959866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:04.053055 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42bfc8-a791-4933-a897-e83b3a78152d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:04.086566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06fb2a-1c56-46eb-adb3-1b521dc78ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:04.087253 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06fb2a-1c56-46eb-adb3-1b521dc78ee4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:04.087561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06fb2a-1c56-46eb-adb3-1b521dc78ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:04.087839 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06fb2a-1c56-46eb-adb3-1b521dc78ee4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:04.098431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06fb2a-1c56-46eb-adb3-1b521dc78ee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:37:04.103654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-cc06fb2a-1c56-46eb-adb3-1b521dc78ee4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:37:04.103654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:37:04.103654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:37:04.103654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:37:04.103654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:37:04.103654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:37:04.103654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:37:04.103654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:37:04.103654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:37:04.103654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:37:04.103654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:37:04.103654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:37:04.103654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:37:04.103654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:37:04.103654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:37:04.103654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:37:04.104670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:37:04.104670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:37:04.104670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:37:04.104670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:37:04.104670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:37:04.104670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:37:04.104670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:37:04.104670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:37:04.104670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:37:04.104670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:37:04.104670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:37:04.104670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:37:04.104670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:37:04.104670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:37:04.104670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:37:04.104670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:37:04.105515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:37:04.105515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:37:04.105515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:37:04.105515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:37:04.105515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:37:04.105515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:37:04.105515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:37:04.105515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:37:04.105515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:37:04.105515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:37:04.105515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:37:04.105515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:37:04.105515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 636/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:37:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:37:04.110840 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17e63d-96f8-411c-9f86-ef37125a1030 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:04.128904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:04.208489 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17e63d-96f8-411c-9f86-ef37125a1030 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:04.250698 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79873f2e-cae3-420c-afba-5a00d2f8e415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:04.251471 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79873f2e-cae3-420c-afba-5a00d2f8e415 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:04.251791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79873f2e-cae3-420c-afba-5a00d2f8e415 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:04.252126 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79873f2e-cae3-420c-afba-5a00d2f8e415 None admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:04.252917 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79873f2e-cae3-420c-afba-5a00d2f8e415 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:04.253245 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79873f2e-cae3-420c-afba-5a00d2f8e415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:04.254780 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79873f2e-cae3-420c-afba-5a00d2f8e415 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:04.264383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 628/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:37:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:37:04.271145 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06fb2a-1c56-46eb-adb3-1b521dc78ee4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:04.339939 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:04.378788 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06fb2a-1c56-46eb-adb3-1b521dc78ee4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:04.412875 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66493d1c-5867-4b10-a6ea-c064b746dda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:04.413499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66493d1c-5867-4b10-a6ea-c064b746dda2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:04.413778 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66493d1c-5867-4b10-a6ea-c064b746dda2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:04.414051 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66493d1c-5867-4b10-a6ea-c064b746dda2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:04.423709 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66493d1c-5867-4b10-a6ea-c064b746dda2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:04.425181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66493d1c-5867-4b10-a6ea-c064b746dda2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:04.439823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-66493d1c-5867-4b10-a6ea-c064b746dda2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:37:04.439823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:37:04.439823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:37:04.439823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:37:04.439823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:37:04.439823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:37:04.439823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:37:04.439823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:37:04.439823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:37:04.439823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:37:04.439823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:37:04.439823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:37:04.439823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:37:04.439823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:37:04.439823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:37:04.439823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:37:04.440946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:37:04.440946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:37:04.440946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:37:04.440946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:37:04.440946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:37:04.440946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:37:04.440946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:37:04.440946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:37:04.440946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:37:04.440946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:37:04.440946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:37:04.440946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:37:04.440946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:37:04.440946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:37:04.440946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:37:04.440946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:37:04.440946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:37:04.441938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:37:04.441938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:37:04.441938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:37:04.441938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 637/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:37:04.447395 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79873f2e-cae3-420c-afba-5a00d2f8e415 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:04.529065 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:04.548342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79873f2e-cae3-420c-afba-5a00d2f8e415 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:04.581700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7cbe9-eaad-4a12-92ac-c712079bfe41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:04.582293 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7cbe9-eaad-4a12-92ac-c712079bfe41 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:04.582575 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7cbe9-eaad-4a12-92ac-c712079bfe41 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:04.582848 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7cbe9-eaad-4a12-92ac-c712079bfe41 None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:04.583486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7cbe9-eaad-4a12-92ac-c712079bfe41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:04.583789 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7cbe9-eaad-4a12-92ac-c712079bfe41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:04.585171 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7cbe9-eaad-4a12-92ac-c712079bfe41 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:04.597455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 629/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:37:04.603522 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66493d1c-5867-4b10-a6ea-c064b746dda2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:04.704787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66493d1c-5867-4b10-a6ea-c064b746dda2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:04.725305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:04.739785 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603b261-533e-4a7f-bff3-3eee36a7316f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:04.740532 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603b261-533e-4a7f-bff3-3eee36a7316f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:04.740859 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603b261-533e-4a7f-bff3-3eee36a7316f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:04.741152 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603b261-533e-4a7f-bff3-3eee36a7316f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:04.749297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603b261-533e-4a7f-bff3-3eee36a7316f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:04.750753 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603b261-533e-4a7f-bff3-3eee36a7316f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:04.762814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-a603b261-533e-4a7f-bff3-3eee36a7316f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 10:37:04.762814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:37:04.762814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:37:04.762814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:37:04.762814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:37:04.762814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:37:04.762814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:37:04.762814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:37:04.762814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:37:04.762814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:37:04.762814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:37:04.762814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:37:04.762814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:37:04.762814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:37:04.762814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:37:04.762814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:37:04.763813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:37:04.763813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:37:04.763813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:37:04.763813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:37:04.763813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:37:04.763813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:37:04.763813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:37:04.763813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:37:04.763813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:37:04.763813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:37:04.763813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:37:04.763813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:37:04.763813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:37:04.763813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:37:04.763813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:37:04.763813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:37:04.763813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:37:04.763813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:37:04.764818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:37:04.764818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:37:04.764818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:37:04.764818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:37:04.764818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:37:04.764818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:37:04.764818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:37:04.764818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:37:04.764818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 10:37:04.764818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:37:04.764818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 638/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:37:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:37:04.769800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7cbe9-eaad-4a12-92ac-c712079bfe41 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:04.868350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7cbe9-eaad-4a12-92ac-c712079bfe41 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:04.902708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e3280-2f8e-4c96-ae4e-0d63b7aeb930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:04.903299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e3280-2f8e-4c96-ae4e-0d63b7aeb930 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:04.903578 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e3280-2f8e-4c96-ae4e-0d63b7aeb930 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:04.903852 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e3280-2f8e-4c96-ae4e-0d63b7aeb930 None admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:04.904603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e3280-2f8e-4c96-ae4e-0d63b7aeb930 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:04.904910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e3280-2f8e-4c96-ae4e-0d63b7aeb930 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:04.906334 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e3280-2f8e-4c96-ae4e-0d63b7aeb930 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:04.915027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:04.923549 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 630/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Sep 11 10:37:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:37:04.929478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603b261-533e-4a7f-bff3-3eee36a7316f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:05.024713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603b261-533e-4a7f-bff3-3eee36a7316f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:05.055688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600ff3f-56bb-4bab-92fe-080ed1f4c3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:05.057011 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600ff3f-56bb-4bab-92fe-080ed1f4c3b7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:05.057505 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600ff3f-56bb-4bab-92fe-080ed1f4c3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:05.057970 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600ff3f-56bb-4bab-92fe-080ed1f4c3b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:05.067931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600ff3f-56bb-4bab-92fe-080ed1f4c3b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:05.069369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600ff3f-56bb-4bab-92fe-080ed1f4c3b7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:05.082802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-d600ff3f-56bb-4bab-92fe-080ed1f4c3b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:37:05.082802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:37:05.082802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:37:05.082802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:37:05.082802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:37:05.082802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:37:05.082802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:37:05.082802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:37:05.082802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:37:05.082802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:37:05.082802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:37:05.082802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:37:05.082802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:37:05.082802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:37:05.082802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:37:05.082802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:37:05.083907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:37:05.083907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:37:05.083907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:37:05.083907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:37:05.083907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:37:05.083907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:37:05.083907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:37:05.083907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:37:05.083907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:37:05.083907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:37:05.083907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:37:05.083907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:37:05.083907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:37:05.083907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:37:05.083907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:37:05.083907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:37:05.083907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:37:05.085042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:37:05.085042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:37:05.085042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:37:05.088703 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 639/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:37:05.090267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e3280-2f8e-4c96-ae4e-0d63b7aeb930 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:05.186751 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e3280-2f8e-4c96-ae4e-0d63b7aeb930 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:05.227750 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be74116-72d9-41a6-bbc4-5f3166daf0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:05.228393 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be74116-72d9-41a6-bbc4-5f3166daf0df None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:05.228710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be74116-72d9-41a6-bbc4-5f3166daf0df None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:05.228937 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be74116-72d9-41a6-bbc4-5f3166daf0df None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:05.229603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be74116-72d9-41a6-bbc4-5f3166daf0df None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:05.229903 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be74116-72d9-41a6-bbc4-5f3166daf0df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:05.231257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be74116-72d9-41a6-bbc4-5f3166daf0df None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:05.242896 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 631/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:37:05.248518 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600ff3f-56bb-4bab-92fe-080ed1f4c3b7 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:05.280513 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:05.346699 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600ff3f-56bb-4bab-92fe-080ed1f4c3b7 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:05.377935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6acc4-98db-48c8-a6ae-bb6b679b6b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:05.378634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6acc4-98db-48c8-a6ae-bb6b679b6b1a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:05.378916 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6acc4-98db-48c8-a6ae-bb6b679b6b1a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:05.379183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6acc4-98db-48c8-a6ae-bb6b679b6b1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:05.385980 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6acc4-98db-48c8-a6ae-bb6b679b6b1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:05.387393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6acc4-98db-48c8-a6ae-bb6b679b6b1a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:05.398099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-93a6acc4-98db-48c8-a6ae-bb6b679b6b1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:37:05.398099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:37:05.398099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:37:05.398099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:37:05.398099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:37:05.398099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:37:05.398099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:37:05.398099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:37:05.398099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:37:05.398099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:37:05.398099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:37:05.398099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:37:05.398099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:37:05.398099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:37:05.398099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:37:05.399083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:37:05.399083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:37:05.399083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:37:05.399083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:37:05.399083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:37:05.399083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:37:05.399083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:37:05.399083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:37:05.399083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:37:05.399083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:37:05.399083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:37:05.399083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:37:05.399083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:37:05.399083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:37:05.399083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:37:05.399083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:37:05.399083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:37:05.400593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:37:05.400593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:37:05.400593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:37:05.400593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:37:05.400593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:37:05.400593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:37:05.400593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:37:05.400593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:37:05.400593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 640/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:37:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:37:05.405449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be74116-72d9-41a6-bbc4-5f3166daf0df None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:05.463252 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:05.509710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be74116-72d9-41a6-bbc4-5f3166daf0df None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:05.548094 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa5758-3901-46b2-9f0b-d233b4490b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:05.548726 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa5758-3901-46b2-9f0b-d233b4490b1f None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:05.549008 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa5758-3901-46b2-9f0b-d233b4490b1f None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:05.549279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa5758-3901-46b2-9f0b-d233b4490b1f None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:05.549978 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa5758-3901-46b2-9f0b-d233b4490b1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:05.550287 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa5758-3901-46b2-9f0b-d233b4490b1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:05.551712 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa5758-3901-46b2-9f0b-d233b4490b1f None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:05.563633 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 632/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:37:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:37:05.569655 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6acc4-98db-48c8-a6ae-bb6b679b6b1a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:05.657784 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:05.666545 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6acc4-98db-48c8-a6ae-bb6b679b6b1a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:05.698394 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebb4bf-966d-4446-aa4f-fade738b2a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:05.699029 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebb4bf-966d-4446-aa4f-fade738b2a18 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:05.699307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebb4bf-966d-4446-aa4f-fade738b2a18 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:05.699579 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebb4bf-966d-4446-aa4f-fade738b2a18 None admin] PATH_INFO: `/v3/projects/cd477d464e9f48149879362d04db9b9e/users/7f0211a05cca4e72b30d64eef4ba527c/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:05.701471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebb4bf-966d-4446-aa4f-fade738b2a18 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd477d464e9f48149879362d04db9b9e, user_id=7f0211a05cca4e72b30d64eef4ba527c, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:05.702893 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebb4bf-966d-4446-aa4f-fade738b2a18 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:05.716461 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 641/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 10:37:05 2022] PUT /identity/v3/projects/cd477d464e9f48149879362d04db9b9e/users/7f0211a05cca4e72b30d64eef4ba527c/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:37:07.947912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95304561-7443-4755-8bd7-4433ae5f6d64 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:07.948460 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95304561-7443-4755-8bd7-4433ae5f6d64 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:07.948460 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95304561-7443-4755-8bd7-4433ae5f6d64 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:07.949842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 633/1274] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:37:07.955049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadf8ec-fdcf-4c74-a783-dcf1713db12d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:07.955438 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadf8ec-fdcf-4c74-a783-dcf1713db12d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:07.955597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadf8ec-fdcf-4c74-a783-dcf1713db12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:07.974260 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-5dadf8ec-fdcf-4c74-a783-dcf1713db12d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:37:07.975375 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5dadf8ec-fdcf-4c74-a783-dcf1713db12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:37:08.038851 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 642/1275] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:37:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:37:08.306295 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95304561-7443-4755-8bd7-4433ae5f6d64 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:08.405383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95304561-7443-4755-8bd7-4433ae5f6d64 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:08.422038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:08.438486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef53c8e-9a23-4182-b4e3-84513c3db240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:08.439103 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef53c8e-9a23-4182-b4e3-84513c3db240 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:08.439377 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef53c8e-9a23-4182-b4e3-84513c3db240 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:08.439642 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef53c8e-9a23-4182-b4e3-84513c3db240 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:08.449843 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef53c8e-9a23-4182-b4e3-84513c3db240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 10:37:08.454702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-3ef53c8e-9a23-4182-b4e3-84513c3db240 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:37:08.454702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:37:08.454702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:37:08.454702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:37:08.454702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:37:08.454702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:37:08.454702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:37:08.454702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:37:08.454702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:37:08.454702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:37:08.454702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:37:08.454702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:37:08.454702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 10:37:08.454702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 10:37:08.454702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 10:37:08.454702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 10:37:08.455773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 10:37:08.455773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 10:37:08.455773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 10:37:08.455773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 10:37:08.455773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:37:08.455773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:37:08.455773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:37:08.455773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:37:08.455773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:37:08.455773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:37:08.455773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:37:08.455773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:37:08.455773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:37:08.455773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:37:08.455773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:37:08.455773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:37:08.456844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:37:08.456844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:37:08.456844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:37:08.456844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:37:08.456844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 10:37:08.456844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 10:37:08.456844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 10:37:08.456844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 10:37:08.456844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 10:37:08.456844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 10:37:08.456844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 10:37:08.456844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:37:08.456844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 634/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 10:37:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:37:08.461768 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadf8ec-fdcf-4c74-a783-dcf1713db12d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:08.539606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:08.558139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadf8ec-fdcf-4c74-a783-dcf1713db12d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:08.590231 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30809134-130f-4a4b-9e18-d3bc787de031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:08.590821 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30809134-130f-4a4b-9e18-d3bc787de031 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:08.591097 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30809134-130f-4a4b-9e18-d3bc787de031 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:08.591365 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30809134-130f-4a4b-9e18-d3bc787de031 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:08.592014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30809134-130f-4a4b-9e18-d3bc787de031 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:08.592313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30809134-130f-4a4b-9e18-d3bc787de031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:08.593699 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30809134-130f-4a4b-9e18-d3bc787de031 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:08.601625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 643/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 10:37:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:37:08.607925 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef53c8e-9a23-4182-b4e3-84513c3db240 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:08.703526 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef53c8e-9a23-4182-b4e3-84513c3db240 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:08.737550 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20eced-cde5-4ae7-8dd4-6049f160169e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:08.738168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20eced-cde5-4ae7-8dd4-6049f160169e None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:08.738445 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20eced-cde5-4ae7-8dd4-6049f160169e None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:08.738715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20eced-cde5-4ae7-8dd4-6049f160169e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:08.748309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20eced-cde5-4ae7-8dd4-6049f160169e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:08.749770 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20eced-cde5-4ae7-8dd4-6049f160169e None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:08.763629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-cc20eced-cde5-4ae7-8dd4-6049f160169e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:37:08.763629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:37:08.763629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:37:08.763629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:37:08.763629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:37:08.763629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:37:08.763629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:37:08.763629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:37:08.763629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:37:08.763629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:37:08.763629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:37:08.763629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:37:08.763629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:37:08.763629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:37:08.763629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:37:08.763629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:37:08.764766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:37:08.764766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:37:08.764766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:37:08.764766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:37:08.764766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:37:08.764766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:37:08.764766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:37:08.764766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:37:08.764766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:37:08.764766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:37:08.764766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:37:08.764766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:37:08.764766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:37:08.764766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:37:08.764766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:37:08.764766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:37:08.764766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:37:08.765948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:37:08.765948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:37:08.765948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:37:08.765948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 635/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:37:08.770419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30809134-130f-4a4b-9e18-d3bc787de031 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:08.865430 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30809134-130f-4a4b-9e18-d3bc787de031 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:08.896969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703cc5c-e48d-4c35-865c-e63f5fe8cc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:08.897556 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703cc5c-e48d-4c35-865c-e63f5fe8cc4b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:08.897828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703cc5c-e48d-4c35-865c-e63f5fe8cc4b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:08.898096 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703cc5c-e48d-4c35-865c-e63f5fe8cc4b None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:08.898720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703cc5c-e48d-4c35-865c-e63f5fe8cc4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:08.899015 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703cc5c-e48d-4c35-865c-e63f5fe8cc4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:08.900447 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703cc5c-e48d-4c35-865c-e63f5fe8cc4b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:08.911487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 644/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:37:08.917591 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20eced-cde5-4ae7-8dd4-6049f160169e None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:08.947434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:09.016005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20eced-cde5-4ae7-8dd4-6049f160169e None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:09.048265 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a5f4b-4969-4fee-9b2d-7520e745ce99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:09.048902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a5f4b-4969-4fee-9b2d-7520e745ce99 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:09.049179 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a5f4b-4969-4fee-9b2d-7520e745ce99 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:09.049449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a5f4b-4969-4fee-9b2d-7520e745ce99 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:09.057305 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a5f4b-4969-4fee-9b2d-7520e745ce99 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:09.058992 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a5f4b-4969-4fee-9b2d-7520e745ce99 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:09.070084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-128a5f4b-4969-4fee-9b2d-7520e745ce99 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 10:37:09.070084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:37:09.070084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:37:09.070084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:37:09.070084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:37:09.070084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:37:09.070084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:37:09.070084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:37:09.070084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:37:09.070084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:37:09.070084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:37:09.070084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:37:09.070084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 10:37:09.070084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 10:37:09.070084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 10:37:09.070084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 10:37:09.071194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:37:09.071194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:37:09.071194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 10:37:09.071194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:37:09.071194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 10:37:09.071194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 10:37:09.071194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:37:09.071194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:37:09.071194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:37:09.071194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:37:09.071194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:37:09.071194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:37:09.071194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:37:09.071194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:37:09.071194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:37:09.071194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:37:09.071194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:37:09.071194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:37:09.072173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:37:09.072173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:37:09.072173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 10:37:09.072173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 10:37:09.072173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 10:37:09.072173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 10:37:09.072173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 10:37:09.072173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 10:37:09.072173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 10:37:09.072173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:37:09.072173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 636/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:37:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:37:09.077073 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703cc5c-e48d-4c35-865c-e63f5fe8cc4b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:09.080773 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:09.174804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703cc5c-e48d-4c35-865c-e63f5fe8cc4b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:09.210746 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4916d-42e1-4b2a-b9c8-ce8c1df5881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:09.211461 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4916d-42e1-4b2a-b9c8-ce8c1df5881b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:09.211738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4916d-42e1-4b2a-b9c8-ce8c1df5881b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:09.212009 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4916d-42e1-4b2a-b9c8-ce8c1df5881b None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:09.212766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4916d-42e1-4b2a-b9c8-ce8c1df5881b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:09.213067 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4916d-42e1-4b2a-b9c8-ce8c1df5881b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:09.214469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4916d-42e1-4b2a-b9c8-ce8c1df5881b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:09.231576 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 645/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Sep 11 10:37:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:37:09.237480 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a5f4b-4969-4fee-9b2d-7520e745ce99 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:09.326099 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:09.335753 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a5f4b-4969-4fee-9b2d-7520e745ce99 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:09.367491 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2359b66-724d-419e-85f0-51f632e66b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:09.368073 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2359b66-724d-419e-85f0-51f632e66b1d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:09.368893 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2359b66-724d-419e-85f0-51f632e66b1d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:09.369167 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2359b66-724d-419e-85f0-51f632e66b1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:09.433512 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2359b66-724d-419e-85f0-51f632e66b1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:09.434878 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2359b66-724d-419e-85f0-51f632e66b1d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:09.518521 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:09.529181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 637/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 10:37:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 10:37:09.534927 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4916d-42e1-4b2a-b9c8-ce8c1df5881b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:09.596569 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:09.636089 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4916d-42e1-4b2a-b9c8-ce8c1df5881b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:09.668823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f1910-d66d-4cc3-9806-66daf24f8978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:09.669439 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f1910-d66d-4cc3-9806-66daf24f8978 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:09.669715 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f1910-d66d-4cc3-9806-66daf24f8978 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:09.669984 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f1910-d66d-4cc3-9806-66daf24f8978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:09.679478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f1910-d66d-4cc3-9806-66daf24f8978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:09.681519 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f1910-d66d-4cc3-9806-66daf24f8978 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:09.695495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-e91f1910-d66d-4cc3-9806-66daf24f8978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:37:09.695495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:37:09.695495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:37:09.695495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:37:09.695495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:37:09.695495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:37:09.695495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:37:09.695495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:37:09.695495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:37:09.695495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:37:09.695495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:37:09.695495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:37:09.695495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 10:37:09.695495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 10:37:09.695495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 10:37:09.695495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 10:37:09.696592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:37:09.696592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:37:09.696592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:37:09.696592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:37:09.696592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:37:09.696592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:37:09.696592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:37:09.696592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:37:09.696592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:37:09.696592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:37:09.696592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:37:09.696592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:37:09.696592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:37:09.696592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:37:09.696592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:37:09.696592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:37:09.696592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 10:37:09.697527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 10:37:09.697527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 10:37:09.697527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:37:09.697527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 646/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:37:09.702220 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2359b66-724d-419e-85f0-51f632e66b1d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:09.800553 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2359b66-724d-419e-85f0-51f632e66b1d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:09.832948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef736ee-fd36-4b3d-8772-4552a279c03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:09.833542 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef736ee-fd36-4b3d-8772-4552a279c03d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:09.833817 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef736ee-fd36-4b3d-8772-4552a279c03d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:09.834088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef736ee-fd36-4b3d-8772-4552a279c03d None admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:09.834717 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef736ee-fd36-4b3d-8772-4552a279c03d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:09.835014 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef736ee-fd36-4b3d-8772-4552a279c03d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:09.836353 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef736ee-fd36-4b3d-8772-4552a279c03d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:09.847312 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 638/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 10:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:37:09.853658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f1910-d66d-4cc3-9806-66daf24f8978 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:09.949317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f1910-d66d-4cc3-9806-66daf24f8978 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:09.961935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:09.981785 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ab817-b493-4282-957e-e5c342bed106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:09.982394 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ab817-b493-4282-957e-e5c342bed106 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:09.982673 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ab817-b493-4282-957e-e5c342bed106 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:09.982944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ab817-b493-4282-957e-e5c342bed106 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:09.989204 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ab817-b493-4282-957e-e5c342bed106 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:09.990620 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ab817-b493-4282-957e-e5c342bed106 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:10.001457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-1c3ab817-b493-4282-957e-e5c342bed106 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:37:10.001457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:37:10.001457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:37:10.001457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:37:10.001457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:37:10.001457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:37:10.001457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:37:10.001457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:37:10.001457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:37:10.001457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:37:10.001457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:37:10.001457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:37:10.001457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 10:37:10.001457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 10:37:10.001457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 10:37:10.002474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 10:37:10.002474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:37:10.002474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:37:10.002474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:37:10.002474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:37:10.002474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:37:10.002474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:37:10.002474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:37:10.002474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 11 10:37:10.002474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:37:10.002474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:37:10.002474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:37:10.002474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:37:10.002474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:37:10.002474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:37:10.002474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:37:10.002474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:37:10.003564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 10:37:10.003564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 10:37:10.003564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 10:37:10.003564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 10:37:10.003564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 10:37:10.003564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 10:37:10.003564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 10:37:10.003564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 11 10:37:10.003564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 647/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 10:37:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:37:10.008217 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef736ee-fd36-4b3d-8772-4552a279c03d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:10.056679 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:10.105608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef736ee-fd36-4b3d-8772-4552a279c03d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:10.138091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3cb95-afd8-4c4a-b904-2da27f1d9165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:10.138677 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3cb95-afd8-4c4a-b904-2da27f1d9165 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:10.138956 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3cb95-afd8-4c4a-b904-2da27f1d9165 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:10.139224 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3cb95-afd8-4c4a-b904-2da27f1d9165 None admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:10.139912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3cb95-afd8-4c4a-b904-2da27f1d9165 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:10.140215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3cb95-afd8-4c4a-b904-2da27f1d9165 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:10.141656 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3cb95-afd8-4c4a-b904-2da27f1d9165 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:10.153028 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 639/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 10:37:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:37:10.159194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ab817-b493-4282-957e-e5c342bed106 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:10.255031 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ab817-b493-4282-957e-e5c342bed106 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:10.286391 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537eb6e-3fad-4618-bd9c-973dccd7b819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:10.286970 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537eb6e-3fad-4618-bd9c-973dccd7b819 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:10.287250 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537eb6e-3fad-4618-bd9c-973dccd7b819 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:10.287515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537eb6e-3fad-4618-bd9c-973dccd7b819 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:10.288222 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537eb6e-3fad-4618-bd9c-973dccd7b819 None admin] RBAC: Adding query filter params (role.id=529cb3511f3a498b9b7169ed5b0f6b8e, scope.project.id=cd477d464e9f48149879362d04db9b9e, user.id=7f0211a05cca4e72b30d64eef4ba527c) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:10.288523 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537eb6e-3fad-4618-bd9c-973dccd7b819 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:10.289951 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537eb6e-3fad-4618-bd9c-973dccd7b819 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:10.295402 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 648/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 10:37:10 2022] GET /identity/v3/role_assignments?user.id=7f0211a05cca4e72b30d64eef4ba527c&scope.project.id=cd477d464e9f48149879362d04db9b9e&role.id=529cb3511f3a498b9b7169ed5b0f6b8e => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:37:12.420048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b9627-c081-4e2e-9e9e-01e4024a57ca None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:12.420601 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b9627-c081-4e2e-9e9e-01e4024a57ca None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:12.420601 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b9627-c081-4e2e-9e9e-01e4024a57ca None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:12.421962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 640/1288] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:37:12.427220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f3f1b-1754-4c72-a3c7-6123496f2a69 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:12.427632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f3f1b-1754-4c72-a3c7-6123496f2a69 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:12.427769 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f3f1b-1754-4c72-a3c7-6123496f2a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:12.446082 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-6a9f3f1b-1754-4c72-a3c7-6123496f2a69 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:37:12.447867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6a9f3f1b-1754-4c72-a3c7-6123496f2a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:37:12.476071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:12.512268 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 649/1289] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:37:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:37:12.781813 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b9627-c081-4e2e-9e9e-01e4024a57ca None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:12.878801 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b9627-c081-4e2e-9e9e-01e4024a57ca None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:12.889467 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:12.912268 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14202196-bf68-4b6a-9083-b40da78bed3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:12.912910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14202196-bf68-4b6a-9083-b40da78bed3c None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:12.913191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14202196-bf68-4b6a-9083-b40da78bed3c None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:12.913465 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14202196-bf68-4b6a-9083-b40da78bed3c None admin] PATH_INFO: `/v3/services/placement` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:12.914045 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14202196-bf68-4b6a-9083-b40da78bed3c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:12.915441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14202196-bf68-4b6a-9083-b40da78bed3c None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:12.923979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-14202196-bf68-4b6a-9083-b40da78bed3c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 10:37:12.923979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:37:12.923979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:37:12.923979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:37:12.923979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:37:12.923979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:37:12.923979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:37:12.923979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:37:12.923979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 10:37:12.923979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:37:12.923979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:37:12.923979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:37:12.923979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:37:12.923979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:37:12.923979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:37:12.923979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:37:12.923979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:37:12.925212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:37:12.925212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:37:12.925212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:37:12.925212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:37:12.925212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:37:12.925212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:37:12.925212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:37:12.925212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:37:12.925212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:37:12.925212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:37:12.925212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:37:12.925212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:37:12.925212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:37:12.925212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:37:12.925212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:37:12.925212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:37:12.926266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:37:12.926266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:37:12.926266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:37:12.926266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:37:12.926266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:37:12.926266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:37:12.926266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:37:12.926266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:37:12.926266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:37:12.926266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:37:12.926266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:37:12.926266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:37:12.926266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 10:37:12.926266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:37:12.926266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 641/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Sep 11 10:37:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:37:12.930932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f3f1b-1754-4c72-a3c7-6123496f2a69 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:13.023891 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f3f1b-1754-4c72-a3c7-6123496f2a69 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:13.056245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ce462-e887-4ec9-b504-ab2ec6ca637a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:13.056856 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ce462-e887-4ec9-b504-ab2ec6ca637a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:13.057133 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ce462-e887-4ec9-b504-ab2ec6ca637a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:13.057400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ce462-e887-4ec9-b504-ab2ec6ca637a None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:13.058014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ce462-e887-4ec9-b504-ab2ec6ca637a None admin] RBAC: Adding query filter params (name=placement) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:13.058310 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ce462-e887-4ec9-b504-ab2ec6ca637a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:13.059645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ce462-e887-4ec9-b504-ab2ec6ca637a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:13.064139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 650/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Sun Sep 11 10:37:12 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:37:13.069768 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14202196-bf68-4b6a-9083-b40da78bed3c None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:13.167732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14202196-bf68-4b6a-9083-b40da78bed3c None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:13.200883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a758bc-b41a-4ed4-a28c-6029faf77026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:13.201543 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a758bc-b41a-4ed4-a28c-6029faf77026 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:13.201819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a758bc-b41a-4ed4-a28c-6029faf77026 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:13.202094 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a758bc-b41a-4ed4-a28c-6029faf77026 None admin] PATH_INFO: `/v3/services` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:13.202724 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a758bc-b41a-4ed4-a28c-6029faf77026 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:13.203032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a758bc-b41a-4ed4-a28c-6029faf77026 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:13.204484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a758bc-b41a-4ed4-a28c-6029faf77026 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:13.209725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 642/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Sun Sep 11 10:37:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:37:15.312349 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ff9b7-f95f-4fb1-aded-2cdb0ba2661d None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:15.312926 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ff9b7-f95f-4fb1-aded-2cdb0ba2661d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:15.312926 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ff9b7-f95f-4fb1-aded-2cdb0ba2661d None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:15.314252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 651/1293] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:37:15.319435 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edafea9-d345-4c8e-bf90-f9b6f34f1e31 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:15.319880 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edafea9-d345-4c8e-bf90-f9b6f34f1e31 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:15.319975 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edafea9-d345-4c8e-bf90-f9b6f34f1e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:15.338476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-3edafea9-d345-4c8e-bf90-f9b6f34f1e31 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:37:15.339650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3edafea9-d345-4c8e-bf90-f9b6f34f1e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:37:15.368516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:15.404488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 643/1294] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:37:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:37:15.668925 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ff9b7-f95f-4fb1-aded-2cdb0ba2661d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:15.699235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:15.767674 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ff9b7-f95f-4fb1-aded-2cdb0ba2661d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:15.799404 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2b1a2-b12a-4920-80cc-4dc686cea178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:15.799993 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2b1a2-b12a-4920-80cc-4dc686cea178 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:15.800268 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2b1a2-b12a-4920-80cc-4dc686cea178 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:15.800537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2b1a2-b12a-4920-80cc-4dc686cea178 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:15.801208 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2b1a2-b12a-4920-80cc-4dc686cea178 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:15.802557 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2b1a2-b12a-4920-80cc-4dc686cea178 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:15.816778 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 652/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 10:37:15 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:37:17.921383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6648a7-d380-4ee4-834a-f0f4a630110e None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:17.921896 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6648a7-d380-4ee4-834a-f0f4a630110e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:17.921981 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6648a7-d380-4ee4-834a-f0f4a630110e None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:17.923281 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 644/1296] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:37:17.928491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a82f1-0d2e-4f59-824a-0704e8fc9e47 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:17.928947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a82f1-0d2e-4f59-824a-0704e8fc9e47 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:17.929067 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a82f1-0d2e-4f59-824a-0704e8fc9e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:17.947325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9b7a82f1-0d2e-4f59-824a-0704e8fc9e47 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:37:17.948491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9b7a82f1-0d2e-4f59-824a-0704e8fc9e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:37:18.020032 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 653/1297] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:37:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:37:18.286622 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6648a7-d380-4ee4-834a-f0f4a630110e None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:18.391139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6648a7-d380-4ee4-834a-f0f4a630110e None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:18.423388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f37df-c4eb-4b88-8229-993d35f536a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:18.424007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f37df-c4eb-4b88-8229-993d35f536a9 None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:18.424281 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f37df-c4eb-4b88-8229-993d35f536a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:18.424571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f37df-c4eb-4b88-8229-993d35f536a9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:18.425141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f37df-c4eb-4b88-8229-993d35f536a9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:18.426488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f37df-c4eb-4b88-8229-993d35f536a9 None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:18.436078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-cb8f37df-c4eb-4b88-8229-993d35f536a9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 10:37:18.436078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:37:18.436078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:37:18.436078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:37:18.436078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:37:18.436078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:37:18.436078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:37:18.436078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:37:18.436078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 10:37:18.436078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:37:18.436078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:37:18.436078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:37:18.436078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:37:18.436078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:37:18.436078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:37:18.436078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:37:18.436078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:37:18.437241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:37:18.437241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:37:18.437241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:37:18.437241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:37:18.437241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:37:18.437241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:37:18.437241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:37:18.437241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:37:18.437241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:37:18.437241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:37:18.437241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:37:18.437241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:37:18.437241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:37:18.437241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:37:18.437241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:37:18.437241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:37:18.438123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:37:18.438123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:37:18.438123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:37:18.438123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:37:18.438123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:37:18.438123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:37:18.438123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:37:18.438123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:37:18.438123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:37:18.438123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:37:18.438123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:37:18.438123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:37:18.438123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 10:37:18.438123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:37:18.438123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 645/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Sep 11 10:37:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:37:18.443511 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a82f1-0d2e-4f59-824a-0704e8fc9e47 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:18.461790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:18.539562 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a82f1-0d2e-4f59-824a-0704e8fc9e47 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:18.572074 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8c677-02f5-4d46-9536-e870bd418a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:18.572686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8c677-02f5-4d46-9536-e870bd418a6f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:18.572964 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8c677-02f5-4d46-9536-e870bd418a6f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:18.573231 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8c677-02f5-4d46-9536-e870bd418a6f None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:18.573855 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8c677-02f5-4d46-9536-e870bd418a6f None admin] RBAC: Adding query filter params (name=placement) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:18.574154 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8c677-02f5-4d46-9536-e870bd418a6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:18.575506 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8c677-02f5-4d46-9536-e870bd418a6f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:18.580368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 654/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Sun Sep 11 10:37:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:37:18.586242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f37df-c4eb-4b88-8229-993d35f536a9 None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:18.616938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:18.689014 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f37df-c4eb-4b88-8229-993d35f536a9 None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:18.721744 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92dfb79-bd7e-4d9b-8a33-449ae9a1364a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:18.722346 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dfb79-bd7e-4d9b-8a33-449ae9a1364a None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:18.722626 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dfb79-bd7e-4d9b-8a33-449ae9a1364a None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:18.722900 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dfb79-bd7e-4d9b-8a33-449ae9a1364a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:18.723598 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92dfb79-bd7e-4d9b-8a33-449ae9a1364a None admin] RBAC: Adding query filter params (interface=public, service_id=5a16684f0d02494c80b8457c0dd74f74, region_id=RegionOne) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:18.723905 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92dfb79-bd7e-4d9b-8a33-449ae9a1364a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:18.725302 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92dfb79-bd7e-4d9b-8a33-449ae9a1364a None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:18.730768 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 646/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Sep 11 10:37:18 2022] GET /identity/v3/endpoints?service_id=5a16684f0d02494c80b8457c0dd74f74&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:37:18.736419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8c677-02f5-4d46-9536-e870bd418a6f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:18.814325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:18.831932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8c677-02f5-4d46-9536-e870bd418a6f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:18.864318 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3832575-79fa-4988-86a3-5c50e6f3203f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:18.864934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3832575-79fa-4988-86a3-5c50e6f3203f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:18.865213 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3832575-79fa-4988-86a3-5c50e6f3203f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:18.865484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3832575-79fa-4988-86a3-5c50e6f3203f None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:18.866077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3832575-79fa-4988-86a3-5c50e6f3203f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:18.867426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3832575-79fa-4988-86a3-5c50e6f3203f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:18.874580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 655/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Sep 11 10:37:18 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:37:20.994849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2286b5e-5f7e-4572-8757-2361015c097f None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:20.995362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2286b5e-5f7e-4572-8757-2361015c097f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:20.995362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2286b5e-5f7e-4572-8757-2361015c097f None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:20.996653 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 647/1302] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:37:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:37:21.001917 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34186ca-5d5c-4049-90b1-fcd62810dfde None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:21.002280 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34186ca-5d5c-4049-90b1-fcd62810dfde None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:21.002463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34186ca-5d5c-4049-90b1-fcd62810dfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:21.020137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e34186ca-5d5c-4049-90b1-fcd62810dfde None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:37:21.021349 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e34186ca-5d5c-4049-90b1-fcd62810dfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:37:21.084884 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 656/1303] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:37:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 10:37:21.349205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2286b5e-5f7e-4572-8757-2361015c097f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:21.441050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:21.448638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2286b5e-5f7e-4572-8757-2361015c097f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:21.481176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94d20d-2bb6-4afe-9ade-b19718cc5d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:21.481789 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94d20d-2bb6-4afe-9ade-b19718cc5d6d None admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:21.482064 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94d20d-2bb6-4afe-9ade-b19718cc5d6d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:21.482330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94d20d-2bb6-4afe-9ade-b19718cc5d6d None admin] PATH_INFO: `/v3/services/placement` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:21.482904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94d20d-2bb6-4afe-9ade-b19718cc5d6d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:21.484246 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94d20d-2bb6-4afe-9ade-b19718cc5d6d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:21.493424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application [None req-bc94d20d-2bb6-4afe-9ade-b19718cc5d6d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 10:37:21.493424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:37:21.493424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 10:37:21.493424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 10:37:21.493424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 10:37:21.493424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 10:37:21.493424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 10:37:21.493424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:37:21.493424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 10:37:21.493424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:37:21.493424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 10:37:21.493424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:37:21.493424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 10:37:21.493424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 10:37:21.493424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 10:37:21.493424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 10:37:21.493424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 10:37:21.494551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 10:37:21.494551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 10:37:21.494551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 10:37:21.494551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 10:37:21.494551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 10:37:21.494551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 10:37:21.494551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 10:37:21.494551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 10:37:21.494551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 10:37:21.494551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 10:37:21.494551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 10:37:21.494551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 10:37:21.494551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 10:37:21.494551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 10:37:21.494551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 10:37:21.494551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 10:37:21.495800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 10:37:21.495800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application with Lock( Sep 11 10:37:21.495800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 10:37:21.495800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self._enter() Sep 11 10:37:21.495800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 10:37:21.495800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 10:37:21.495800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 10:37:21.495800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application return self.creator() Sep 11 10:37:21.495800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 10:37:21.495800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application created_value = creator( Sep 11 10:37:21.495800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 10:37:21.495800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 10:37:21.495800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 10:37:21.495800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: ERROR keystone.server.flask.application Sep 11 10:37:21.495800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 648/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Sep 11 10:37:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 10:37:21.500262 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34186ca-5d5c-4049-90b1-fcd62810dfde None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:21.573143 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:21.595599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34186ca-5d5c-4049-90b1-fcd62810dfde None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:21.628254 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f110f03-7568-425d-8fb6-b320da203857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:21.628819 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f110f03-7568-425d-8fb6-b320da203857 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:21.629100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f110f03-7568-425d-8fb6-b320da203857 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:21.629378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f110f03-7568-425d-8fb6-b320da203857 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:21.629999 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f110f03-7568-425d-8fb6-b320da203857 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:37:21.630298 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f110f03-7568-425d-8fb6-b320da203857 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:21.631648 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f110f03-7568-425d-8fb6-b320da203857 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:21.637182 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 657/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Sun Sep 11 10:37:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:37:21.642876 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94d20d-2bb6-4afe-9ade-b19718cc5d6d None admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:37:21.740909 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94d20d-2bb6-4afe-9ade-b19718cc5d6d None admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:37:21.773321 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d605bb-e47b-44ce-8dec-3e005e23a56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:37:21.773909 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d605bb-e47b-44ce-8dec-3e005e23a56d None admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:37:21.774183 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d605bb-e47b-44ce-8dec-3e005e23a56d None admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:37:21.774453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d605bb-e47b-44ce-8dec-3e005e23a56d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:37:21.775103 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d605bb-e47b-44ce-8dec-3e005e23a56d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:37:21.776442 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d605bb-e47b-44ce-8dec-3e005e23a56d None admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:37:21.795366 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 649/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:37:21 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:37:31.633811 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=30 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:37:31.791165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:25.069274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa786cc-6fb8-420e-b0f3-4cca202797a4 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:25.069737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa786cc-6fb8-420e-b0f3-4cca202797a4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:25.069737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa786cc-6fb8-420e-b0f3-4cca202797a4 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:25.076231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98ef9e-d7fd-4c51-aabe-9458fd7828ca None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:25.076677 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98ef9e-d7fd-4c51-aabe-9458fd7828ca None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:25.076816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98ef9e-d7fd-4c51-aabe-9458fd7828ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:25.080270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 658/1307] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:38:25 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:38:25.198248 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-ad98ef9e-d7fd-4c51-aabe-9458fd7828ca None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:38:25.199925 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ad98ef9e-d7fd-4c51-aabe-9458fd7828ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:25.368772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 650/1308] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:38:25.668537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22668d8a-60d4-434c-b81d-f453adf77618 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:25.669076 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22668d8a-60d4-434c-b81d-f453adf77618 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:25.669605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22668d8a-60d4-434c-b81d-f453adf77618 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:25.671621 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 659/1309] 10.222.0.20 () {54 vars in 965 bytes} [Sun Sep 11 10:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:38:25.679212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865d1a7-a592-49d0-9d61-12605780cd95 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:25.679495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865d1a7-a592-49d0-9d61-12605780cd95 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:25.679764 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865d1a7-a592-49d0-9d61-12605780cd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:25.770813 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-7865d1a7-a592-49d0-9d61-12605780cd95 None None] MFA Rules not processed for user `133c5864d9544973a30ff77866522f15`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:38:25.772564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7865d1a7-a592-49d0-9d61-12605780cd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:25.794166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:25.856803 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 651/1310] 10.222.0.20 () {58 vars in 1062 bytes} [Sun Sep 11 10:38:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:38:25.865855 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22668d8a-60d4-434c-b81d-f453adf77618 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:38:25.867862 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-22668d8a-60d4-434c-b81d-f453adf77618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:26.011814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22668d8a-60d4-434c-b81d-f453adf77618 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:38:26.106681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a7aa7-e9b4-4eaa-a261-fdd13ae44724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:38:26.107438 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a7aa7-e9b4-4eaa-a261-fdd13ae44724 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:26.107741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a7aa7-e9b4-4eaa-a261-fdd13ae44724 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:26.108011 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a7aa7-e9b4-4eaa-a261-fdd13ae44724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:26.109870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d71a7aa7-e9b4-4eaa-a261-fdd13ae44724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:26.171993 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:26.239672 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a7aa7-e9b4-4eaa-a261-fdd13ae44724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:38:26.241284 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a7aa7-e9b4-4eaa-a261-fdd13ae44724 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:38:26.261792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 660/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:38:28.821445 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575df613-1441-401b-b3de-f37f4b9101e1 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:28.821938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575df613-1441-401b-b3de-f37f4b9101e1 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:28.822141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575df613-1441-401b-b3de-f37f4b9101e1 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:28.823363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 652/1312] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:38:28.828865 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681e782-a4a1-420f-b660-085251c14bff None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:28.829269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681e782-a4a1-420f-b660-085251c14bff None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:28.829364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681e782-a4a1-420f-b660-085251c14bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:28.909185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-8681e782-a4a1-420f-b660-085251c14bff None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:38:28.910418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8681e782-a4a1-420f-b660-085251c14bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:29.003867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 661/1313] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:38:29.289246 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575df613-1441-401b-b3de-f37f4b9101e1 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:38:29.290802 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-575df613-1441-401b-b3de-f37f4b9101e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:29.393629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575df613-1441-401b-b3de-f37f4b9101e1 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:38:29.462638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:29.465021 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c87559-ca53-4971-b675-c87267b0758a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:38:29.465798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c87559-ca53-4971-b675-c87267b0758a service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:29.466296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c87559-ca53-4971-b675-c87267b0758a service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:29.466765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c87559-ca53-4971-b675-c87267b0758a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:29.468431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-99c87559-ca53-4971-b675-c87267b0758a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:29.574837 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c87559-ca53-4971-b675-c87267b0758a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:38:29.576246 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c87559-ca53-4971-b675-c87267b0758a service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:38:29.593593 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 653/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:38:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:38:32.033534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97342361-4774-4d6b-ac65-e7b1b24c94b0 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:32.034042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97342361-4774-4d6b-ac65-e7b1b24c94b0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:32.034042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97342361-4774-4d6b-ac65-e7b1b24c94b0 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:32.035388 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 662/1315] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:38:32.041079 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40974c-174d-4f4f-a8ea-6fd924ec303d None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:32.041516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40974c-174d-4f4f-a8ea-6fd924ec303d None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:32.041636 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40974c-174d-4f4f-a8ea-6fd924ec303d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:32.107116 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-cd40974c-174d-4f4f-a8ea-6fd924ec303d None None] MFA Rules not processed for user `315b7d0f6889432f934c56e1f4aded84`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:38:32.108365 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-cd40974c-174d-4f4f-a8ea-6fd924ec303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:32.158935 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:32.204751 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 654/1316] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:38:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:38:32.491892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97342361-4774-4d6b-ac65-e7b1b24c94b0 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:38:32.493457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-97342361-4774-4d6b-ac65-e7b1b24c94b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:32.503177 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:32.595053 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97342361-4774-4d6b-ac65-e7b1b24c94b0 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:38:32.668598 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a876843-2ede-49fd-b5a0-39de42a1b509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:38:32.669197 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a876843-2ede-49fd-b5a0-39de42a1b509 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:32.669474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a876843-2ede-49fd-b5a0-39de42a1b509 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:32.669741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a876843-2ede-49fd-b5a0-39de42a1b509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:32.671322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0a876843-2ede-49fd-b5a0-39de42a1b509 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:32.734156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:32.779966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a876843-2ede-49fd-b5a0-39de42a1b509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:38:32.781415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a876843-2ede-49fd-b5a0-39de42a1b509 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:38:32.799787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 663/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:38:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:38:35.464508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a821a29-9fea-4c8b-baf3-92c6ce426a87 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:35.465085 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a821a29-9fea-4c8b-baf3-92c6ce426a87 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:35.465191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a821a29-9fea-4c8b-baf3-92c6ce426a87 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:35.466582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 655/1318] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:38:35.471970 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367e166-86ab-46dc-a30d-1dfb49bc4113 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:35.472370 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367e166-86ab-46dc-a30d-1dfb49bc4113 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:35.472518 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367e166-86ab-46dc-a30d-1dfb49bc4113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:35.537702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c367e166-86ab-46dc-a30d-1dfb49bc4113 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:38:35.538889 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c367e166-86ab-46dc-a30d-1dfb49bc4113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:35.631043 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 664/1319] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:38:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:38:35.913394 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a821a29-9fea-4c8b-baf3-92c6ce426a87 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:38:35.914908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-1a821a29-9fea-4c8b-baf3-92c6ce426a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:36.014870 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a821a29-9fea-4c8b-baf3-92c6ce426a87 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:38:36.086737 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967b95b-6a16-40aa-87c3-a912d61d9c65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:38:36.087326 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967b95b-6a16-40aa-87c3-a912d61d9c65 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:36.087603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967b95b-6a16-40aa-87c3-a912d61d9c65 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:36.087871 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967b95b-6a16-40aa-87c3-a912d61d9c65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:36.089473 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a967b95b-6a16-40aa-87c3-a912d61d9c65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:36.096346 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:36.196008 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967b95b-6a16-40aa-87c3-a912d61d9c65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:38:36.197379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967b95b-6a16-40aa-87c3-a912d61d9c65 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:38:36.216038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 656/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:38:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:38:39.101260 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5fa60-9421-4858-aaf9-c91902fa10b2 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:39.101840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5fa60-9421-4858-aaf9-c91902fa10b2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:39.101840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5fa60-9421-4858-aaf9-c91902fa10b2 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:39.103224 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 665/1321] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:38:39.109295 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a71abc-42d2-44c2-8fc7-9cba87a6fa7d None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:39.109829 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a71abc-42d2-44c2-8fc7-9cba87a6fa7d None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:39.109829 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a71abc-42d2-44c2-8fc7-9cba87a6fa7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:39.181701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-a2a71abc-42d2-44c2-8fc7-9cba87a6fa7d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:38:39.182954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a2a71abc-42d2-44c2-8fc7-9cba87a6fa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:39.247791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:39.292925 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 657/1322] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:38:39.572949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5fa60-9421-4858-aaf9-c91902fa10b2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:38:39.574486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1eb5fa60-9421-4858-aaf9-c91902fa10b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:39.594951 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:39.679190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5fa60-9421-4858-aaf9-c91902fa10b2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:38:39.755994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eccbdc-6712-46dc-8bee-1df5b6c7f815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:38:39.756641 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eccbdc-6712-46dc-8bee-1df5b6c7f815 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:39.756923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eccbdc-6712-46dc-8bee-1df5b6c7f815 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:39.757192 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eccbdc-6712-46dc-8bee-1df5b6c7f815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:39.758840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f0eccbdc-6712-46dc-8bee-1df5b6c7f815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:39.831111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:39.869613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eccbdc-6712-46dc-8bee-1df5b6c7f815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:38:39.871032 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eccbdc-6712-46dc-8bee-1df5b6c7f815 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:38:39.888255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 666/1323] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:38:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:38:42.079061 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc93af-a44d-43b3-a13b-0bf579a8f1dc None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:42.079578 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc93af-a44d-43b3-a13b-0bf579a8f1dc None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:42.079694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc93af-a44d-43b3-a13b-0bf579a8f1dc None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:42.080978 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 658/1324] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:38:42.086630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e321db7-40a7-4faa-ae7b-4bc5804f0e34 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:42.087067 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e321db7-40a7-4faa-ae7b-4bc5804f0e34 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:42.087320 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e321db7-40a7-4faa-ae7b-4bc5804f0e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:42.156088 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3e321db7-40a7-4faa-ae7b-4bc5804f0e34 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:38:42.157546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3e321db7-40a7-4faa-ae7b-4bc5804f0e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:42.256418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 667/1325] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:38:42.535111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc93af-a44d-43b3-a13b-0bf579a8f1dc None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:38:42.537236 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-74bc93af-a44d-43b3-a13b-0bf579a8f1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:42.638528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc93af-a44d-43b3-a13b-0bf579a8f1dc None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:38:42.715901 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdecda2-dc19-4fa2-a8f7-9dc5bfdb5c03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:38:42.716507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdecda2-dc19-4fa2-a8f7-9dc5bfdb5c03 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:42.716838 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdecda2-dc19-4fa2-a8f7-9dc5bfdb5c03 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:42.717112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdecda2-dc19-4fa2-a8f7-9dc5bfdb5c03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:42.718700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0bdecda2-dc19-4fa2-a8f7-9dc5bfdb5c03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:42.736129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:42.831047 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdecda2-dc19-4fa2-a8f7-9dc5bfdb5c03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:38:42.832468 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdecda2-dc19-4fa2-a8f7-9dc5bfdb5c03 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:38:42.852082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 659/1326] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:38:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:38:45.059737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be5dee-f266-46d3-b3e7-967d7bdac024 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:45.060208 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be5dee-f266-46d3-b3e7-967d7bdac024 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:45.060314 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be5dee-f266-46d3-b3e7-967d7bdac024 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:45.061741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 668/1327] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:38:45.067179 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560f6e3-311a-4d16-86ba-54bb3b9483db None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:45.067617 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560f6e3-311a-4d16-86ba-54bb3b9483db None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:45.067712 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560f6e3-311a-4d16-86ba-54bb3b9483db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:45.141633 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-c560f6e3-311a-4d16-86ba-54bb3b9483db None None] MFA Rules not processed for user `315b7d0f6889432f934c56e1f4aded84`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:38:45.142862 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c560f6e3-311a-4d16-86ba-54bb3b9483db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:45.209170 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:45.241227 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 660/1328] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:38:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:38:45.524127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be5dee-f266-46d3-b3e7-967d7bdac024 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:38:45.525707 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-85be5dee-f266-46d3-b3e7-967d7bdac024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:45.557994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:45.631869 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be5dee-f266-46d3-b3e7-967d7bdac024 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:38:45.703827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1678dcc-7171-40d5-b359-a95289b4c9c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:38:45.704428 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1678dcc-7171-40d5-b359-a95289b4c9c0 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:45.704736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1678dcc-7171-40d5-b359-a95289b4c9c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:45.708330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1678dcc-7171-40d5-b359-a95289b4c9c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:45.708330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d1678dcc-7171-40d5-b359-a95289b4c9c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:45.787702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:45.819544 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1678dcc-7171-40d5-b359-a95289b4c9c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:38:45.821003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1678dcc-7171-40d5-b359-a95289b4c9c0 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:38:45.839075 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 669/1329] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:38:45 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:38:48.245599 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b161549-cffd-457e-b6dc-a92dbf2620c6 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:48.246158 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b161549-cffd-457e-b6dc-a92dbf2620c6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:48.246158 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b161549-cffd-457e-b6dc-a92dbf2620c6 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:48.247544 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 661/1330] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:38:48.252691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41afe1-f8eb-48a4-b653-f1e72a647a0f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:48.253077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41afe1-f8eb-48a4-b653-f1e72a647a0f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:48.253251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41afe1-f8eb-48a4-b653-f1e72a647a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:48.317948 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ed41afe1-f8eb-48a4-b653-f1e72a647a0f None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:38:48.319129 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ed41afe1-f8eb-48a4-b653-f1e72a647a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:48.411333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 670/1331] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:38:48.710243 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef630b6-728e-41b3-9817-cf0e66b2a799 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:48.710526 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef630b6-728e-41b3-9817-cf0e66b2a799 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:48.710797 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef630b6-728e-41b3-9817-cf0e66b2a799 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:48.712189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 662/1332] 10.222.0.20 () {54 vars in 965 bytes} [Sun Sep 11 10:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:38:48.718374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5177e8-da52-4981-8458-37c4586b5a84 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:48.718660 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5177e8-da52-4981-8458-37c4586b5a84 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:48.719238 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5177e8-da52-4981-8458-37c4586b5a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:48.764816 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:48.795378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7c5177e8-da52-4981-8458-37c4586b5a84 None None] MFA Rules not processed for user `133c5864d9544973a30ff77866522f15`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:38:48.796605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7c5177e8-da52-4981-8458-37c4586b5a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:48.870068 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 671/1333] 10.222.0.20 () {58 vars in 1062 bytes} [Sun Sep 11 10:38:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:38:48.879126 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef630b6-728e-41b3-9817-cf0e66b2a799 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:38:48.880902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-5ef630b6-728e-41b3-9817-cf0e66b2a799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:48.982831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef630b6-728e-41b3-9817-cf0e66b2a799 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:38:49.058839 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c9392-9e34-4e9f-86c6-be97933578b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:38:49.059440 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c9392-9e34-4e9f-86c6-be97933578b6 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:49.059709 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c9392-9e34-4e9f-86c6-be97933578b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:49.059974 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c9392-9e34-4e9f-86c6-be97933578b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:49.061590 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d57c9392-9e34-4e9f-86c6-be97933578b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:49.089304 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:49.169385 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c9392-9e34-4e9f-86c6-be97933578b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:38:49.170802 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c9392-9e34-4e9f-86c6-be97933578b6 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:38:49.188835 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 663/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:38:51.590014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc15a1-c922-4481-9778-6a29c3a35623 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:51.590582 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc15a1-c922-4481-9778-6a29c3a35623 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:51.590582 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc15a1-c922-4481-9778-6a29c3a35623 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:51.591961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 672/1335] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:38:51.597295 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b1ebc-4dac-4444-8954-56a3361629c8 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:51.597767 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b1ebc-4dac-4444-8954-56a3361629c8 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:51.597872 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b1ebc-4dac-4444-8954-56a3361629c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:51.662607 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-110b1ebc-4dac-4444-8954-56a3361629c8 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:38:51.663792 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-110b1ebc-4dac-4444-8954-56a3361629c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:51.741109 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:51.763640 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 664/1336] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:38:52.053095 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc15a1-c922-4481-9778-6a29c3a35623 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:38:52.054617 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b5bc15a1-c922-4481-9778-6a29c3a35623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:52.156255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc15a1-c922-4481-9778-6a29c3a35623 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:38:52.184484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:52.229117 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639cd70-5fe9-4f4e-b876-93560612aa38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:38:52.229710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639cd70-5fe9-4f4e-b876-93560612aa38 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:52.229985 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639cd70-5fe9-4f4e-b876-93560612aa38 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:52.230249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639cd70-5fe9-4f4e-b876-93560612aa38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:52.231819 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e639cd70-5fe9-4f4e-b876-93560612aa38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:52.338764 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639cd70-5fe9-4f4e-b876-93560612aa38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:38:52.340176 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639cd70-5fe9-4f4e-b876-93560612aa38 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:38:52.357903 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 673/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:38:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:38:55.128262 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb9c85-993d-488c-8f5d-b8591b8b074f None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:55.128823 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb9c85-993d-488c-8f5d-b8591b8b074f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:55.128823 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb9c85-993d-488c-8f5d-b8591b8b074f None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:55.130737 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 665/1338] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:38:55.135849 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7683dd2-bafc-445c-84bf-5cf81e0167a3 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:55.136247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7683dd2-bafc-445c-84bf-5cf81e0167a3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:55.136392 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7683dd2-bafc-445c-84bf-5cf81e0167a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:55.201159 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d7683dd2-bafc-445c-84bf-5cf81e0167a3 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:38:55.202361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d7683dd2-bafc-445c-84bf-5cf81e0167a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:55.210417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:55.309655 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 674/1339] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:38:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:38:55.595483 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb9c85-993d-488c-8f5d-b8591b8b074f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:38:55.597046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-caeb9c85-993d-488c-8f5d-b8591b8b074f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:55.697441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb9c85-993d-488c-8f5d-b8591b8b074f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:38:55.770777 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3125b0-3069-4fcb-bbc5-4aaa2bd324e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:38:55.771372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3125b0-3069-4fcb-bbc5-4aaa2bd324e0 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:38:55.771646 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3125b0-3069-4fcb-bbc5-4aaa2bd324e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:38:55.771912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3125b0-3069-4fcb-bbc5-4aaa2bd324e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:38:55.773507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6c3125b0-3069-4fcb-bbc5-4aaa2bd324e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:38:55.809169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:38:55.880354 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3125b0-3069-4fcb-bbc5-4aaa2bd324e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:38:55.881735 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3125b0-3069-4fcb-bbc5-4aaa2bd324e0 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:38:55.899529 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 666/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:38:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:39:00.109487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d92006-568c-4e7b-aecb-70fb9dfbe8ef None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:00.110067 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d92006-568c-4e7b-aecb-70fb9dfbe8ef None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:00.110067 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d92006-568c-4e7b-aecb-70fb9dfbe8ef None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:00.111371 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 675/1341] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:00.116654 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f36b8b-6259-4abb-9991-94a030309ed2 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:00.117113 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f36b8b-6259-4abb-9991-94a030309ed2 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:00.117217 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f36b8b-6259-4abb-9991-94a030309ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:00.182502 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-34f36b8b-6259-4abb-9991-94a030309ed2 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:00.183631 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-34f36b8b-6259-4abb-9991-94a030309ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:00.268329 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:00.280016 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 667/1342] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:00.560343 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d92006-568c-4e7b-aecb-70fb9dfbe8ef None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:39:00.561924 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-52d92006-568c-4e7b-aecb-70fb9dfbe8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:00.664871 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d92006-568c-4e7b-aecb-70fb9dfbe8ef None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:39:00.704081 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:00.744435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c28eb3-9893-4806-acd9-18a6d9583d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:39:00.745065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28eb3-9893-4806-acd9-18a6d9583d60 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:00.745340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28eb3-9893-4806-acd9-18a6d9583d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:00.745607 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28eb3-9893-4806-acd9-18a6d9583d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:00.747188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-27c28eb3-9893-4806-acd9-18a6d9583d60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:00.855616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c28eb3-9893-4806-acd9-18a6d9583d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:39:00.856955 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c28eb3-9893-4806-acd9-18a6d9583d60 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:39:00.875165 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 676/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:39:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:39:03.667445 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff96c78-602a-4d0b-ac06-ffa5126fc7b6 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:03.667982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff96c78-602a-4d0b-ac06-ffa5126fc7b6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:03.667982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff96c78-602a-4d0b-ac06-ffa5126fc7b6 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:03.669386 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 668/1344] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:03.674495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1b714-4e42-4839-b2d5-6813359c5456 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:03.674876 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1b714-4e42-4839-b2d5-6813359c5456 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:03.675160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1b714-4e42-4839-b2d5-6813359c5456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:03.745300 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-51c1b714-4e42-4839-b2d5-6813359c5456 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:03.746501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-51c1b714-4e42-4839-b2d5-6813359c5456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:03.765211 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:03.846285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 677/1345] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:39:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:04.133512 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff96c78-602a-4d0b-ac06-ffa5126fc7b6 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:39:04.135074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-bff96c78-602a-4d0b-ac06-ffa5126fc7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:04.249128 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff96c78-602a-4d0b-ac06-ffa5126fc7b6 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:39:04.331656 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e6182-c90f-45dc-ac75-bcf55fd13c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:39:04.332305 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e6182-c90f-45dc-ac75-bcf55fd13c15 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:04.332612 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e6182-c90f-45dc-ac75-bcf55fd13c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:04.332891 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e6182-c90f-45dc-ac75-bcf55fd13c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:04.334499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9f3e6182-c90f-45dc-ac75-bcf55fd13c15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:04.384202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:04.453131 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e6182-c90f-45dc-ac75-bcf55fd13c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:39:04.454568 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e6182-c90f-45dc-ac75-bcf55fd13c15 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:39:04.473466 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 669/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:39:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:39:08.595941 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8414b46-c039-405e-b9dc-a840c9a837f4 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:08.596465 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8414b46-c039-405e-b9dc-a840c9a837f4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:08.596874 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8414b46-c039-405e-b9dc-a840c9a837f4 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:08.598418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 678/1347] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:08.604121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd77880-893b-4091-beb0-cab9a34a27b4 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:08.604796 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd77880-893b-4091-beb0-cab9a34a27b4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:08.604796 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd77880-893b-4091-beb0-cab9a34a27b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:08.673670 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-6bd77880-893b-4091-beb0-cab9a34a27b4 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:08.674903 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6bd77880-893b-4091-beb0-cab9a34a27b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:08.771982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:08.774400 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 670/1348] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:09.063295 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8414b46-c039-405e-b9dc-a840c9a837f4 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:39:09.064857 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b8414b46-c039-405e-b9dc-a840c9a837f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:09.165304 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8414b46-c039-405e-b9dc-a840c9a837f4 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:39:09.214256 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:09.239813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe246f-a23d-466a-aee0-7171c1aed93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:39:09.240352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe246f-a23d-466a-aee0-7171c1aed93e service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:09.240647 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe246f-a23d-466a-aee0-7171c1aed93e service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:09.240914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe246f-a23d-466a-aee0-7171c1aed93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:09.242488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b8fe246f-a23d-466a-aee0-7171c1aed93e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:09.347202 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe246f-a23d-466a-aee0-7171c1aed93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:39:09.348652 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe246f-a23d-466a-aee0-7171c1aed93e service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:39:09.366513 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 679/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:39:14.228811 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e4fc6-1b41-4a52-a5b5-103b71ec4e7e None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:14.229251 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e4fc6-1b41-4a52-a5b5-103b71ec4e7e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:14.229394 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e4fc6-1b41-4a52-a5b5-103b71ec4e7e None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:14.231185 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 671/1350] 10.222.0.20 () {54 vars in 921 bytes} [Sun Sep 11 10:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:14.236788 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e08bb0-c986-49a8-af88-85d67b7d51f7 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:14.237194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e08bb0-c986-49a8-af88-85d67b7d51f7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:14.237346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e08bb0-c986-49a8-af88-85d67b7d51f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:14.349260 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f9e08bb0-c986-49a8-af88-85d67b7d51f7 None None] MFA Rules not processed for user `7f0211a05cca4e72b30d64eef4ba527c`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:14.350568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f9e08bb0-c986-49a8-af88-85d67b7d51f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:14.371659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:14.475848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 680/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Sep 11 10:39:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:18.552629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936fad3-8908-46c8-bd35-da7a792a3bce None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:18.553177 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936fad3-8908-46c8-bd35-da7a792a3bce None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:18.553177 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936fad3-8908-46c8-bd35-da7a792a3bce None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:18.554686 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 672/1352] 10.222.0.20 () {54 vars in 921 bytes} [Sun Sep 11 10:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:18.559386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664bafb-94f8-4a0e-9089-4cfa2d49ca3d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:18.559839 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664bafb-94f8-4a0e-9089-4cfa2d49ca3d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:18.560151 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664bafb-94f8-4a0e-9089-4cfa2d49ca3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:18.640116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2664bafb-94f8-4a0e-9089-4cfa2d49ca3d None None] MFA Rules not processed for user `7f0211a05cca4e72b30d64eef4ba527c`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:18.641792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2664bafb-94f8-4a0e-9089-4cfa2d49ca3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:18.720648 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:18.761221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 681/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Sep 11 10:39:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:20.114016 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94efbf0-e68c-440d-97d2-9a47cf505f0c None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:20.114574 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94efbf0-e68c-440d-97d2-9a47cf505f0c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:20.115126 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94efbf0-e68c-440d-97d2-9a47cf505f0c None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:20.116528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 673/1354] 10.222.0.20 () {54 vars in 921 bytes} [Sun Sep 11 10:39:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:20.121880 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7041e44-2828-4f9d-9404-13740d3a521c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:20.122330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7041e44-2828-4f9d-9404-13740d3a521c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:20.122444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7041e44-2828-4f9d-9404-13740d3a521c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:20.197928 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a7041e44-2828-4f9d-9404-13740d3a521c None None] MFA Rules not processed for user `7f0211a05cca4e72b30d64eef4ba527c`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:20.199136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a7041e44-2828-4f9d-9404-13740d3a521c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:20.305952 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 682/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Sep 11 10:39:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:23.939514 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946632b6-8a5c-419d-a421-bf800aea415b None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:23.940034 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946632b6-8a5c-419d-a421-bf800aea415b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:23.940034 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946632b6-8a5c-419d-a421-bf800aea415b None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:23.942265 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 674/1356] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:23.949306 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92989704-35de-48fc-810e-d794dcce09ab None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:23.949306 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92989704-35de-48fc-810e-d794dcce09ab None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:23.949306 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92989704-35de-48fc-810e-d794dcce09ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:23.997155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:24.039943 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-92989704-35de-48fc-810e-d794dcce09ab None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:24.041077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-92989704-35de-48fc-810e-d794dcce09ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:24.149097 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 683/1357] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:39:24.454203 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9d883-9583-4f2a-9e04-e036af6b24df None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:24.454805 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9d883-9583-4f2a-9e04-e036af6b24df None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:24.455418 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9d883-9583-4f2a-9e04-e036af6b24df None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:24.458035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 675/1358] 10.222.0.20 () {54 vars in 962 bytes} [Sun Sep 11 10:39:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:24.466531 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72115c8a-a648-4fa2-bdad-8ed9e5b4e816 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:24.466832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72115c8a-a648-4fa2-bdad-8ed9e5b4e816 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:24.467082 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72115c8a-a648-4fa2-bdad-8ed9e5b4e816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:24.558697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-72115c8a-a648-4fa2-bdad-8ed9e5b4e816 None None] MFA Rules not processed for user `b642a1d00de940429fc1cc6131ac22b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:24.559895 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-72115c8a-a648-4fa2-bdad-8ed9e5b4e816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:24.610847 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:24.688826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 684/1359] 10.222.0.20 () {58 vars in 1059 bytes} [Sun Sep 11 10:39:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:24.690335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9d883-9583-4f2a-9e04-e036af6b24df None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:39:24.691974 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8bf9d883-9583-4f2a-9e04-e036af6b24df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:24.851030 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9d883-9583-4f2a-9e04-e036af6b24df None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:39:24.931313 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:24.974532 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fafb71-c023-4961-83f3-517b938c59a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:39:24.975146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fafb71-c023-4961-83f3-517b938c59a4 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:24.975381 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fafb71-c023-4961-83f3-517b938c59a4 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:24.975585 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fafb71-c023-4961-83f3-517b938c59a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:24.977185 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a7fafb71-c023-4961-83f3-517b938c59a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:25.070424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fafb71-c023-4961-83f3-517b938c59a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:39:25.071998 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fafb71-c023-4961-83f3-517b938c59a4 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:39:25.090653 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 676/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:39:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:39:27.481135 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dc83b-d749-4f2d-b7bf-1876b0988ff8 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:27.481611 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dc83b-d749-4f2d-b7bf-1876b0988ff8 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:27.482052 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dc83b-d749-4f2d-b7bf-1876b0988ff8 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:27.484853 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 685/1361] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:39:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:27.489736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09959e-1901-4543-9b45-939ab8ef456c None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:27.490230 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09959e-1901-4543-9b45-939ab8ef456c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:27.490432 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09959e-1901-4543-9b45-939ab8ef456c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:27.559233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-7c09959e-1901-4543-9b45-939ab8ef456c None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:27.560441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7c09959e-1901-4543-9b45-939ab8ef456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:27.600515 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:27.699351 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 677/1362] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:27.991541 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dc83b-d749-4f2d-b7bf-1876b0988ff8 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:39:27.993104 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-133dc83b-d749-4f2d-b7bf-1876b0988ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:28.181512 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dc83b-d749-4f2d-b7bf-1876b0988ff8 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:39:28.194056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:28.322613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda8ed8-63d7-4c39-8551-eb06370f42f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:39:28.323228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda8ed8-63d7-4c39-8551-eb06370f42f7 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:28.323578 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda8ed8-63d7-4c39-8551-eb06370f42f7 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:28.323792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda8ed8-63d7-4c39-8551-eb06370f42f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:28.325422 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-abda8ed8-63d7-4c39-8551-eb06370f42f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:28.430113 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda8ed8-63d7-4c39-8551-eb06370f42f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:39:28.431898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda8ed8-63d7-4c39-8551-eb06370f42f7 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:39:28.450067 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 686/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:39:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:39:30.939862 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b00d8e-867c-4dc2-b53b-659d9306c460 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:30.940520 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b00d8e-867c-4dc2-b53b-659d9306c460 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:30.940520 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b00d8e-867c-4dc2-b53b-659d9306c460 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:30.942018 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 678/1364] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:30.947125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bbe65-3c15-4eda-ada5-a45561b749ba None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:30.947551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bbe65-3c15-4eda-ada5-a45561b749ba None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:30.947733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bbe65-3c15-4eda-ada5-a45561b749ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:30.963811 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:31.016564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f15bbe65-3c15-4eda-ada5-a45561b749ba None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:31.017814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f15bbe65-3c15-4eda-ada5-a45561b749ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:31.116563 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 687/1365] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:31.415157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60819097-0293-4c84-a1df-0e09f696f6b5 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:31.415490 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60819097-0293-4c84-a1df-0e09f696f6b5 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:31.415724 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60819097-0293-4c84-a1df-0e09f696f6b5 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:31.417277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 679/1366] 10.222.0.20 () {54 vars in 962 bytes} [Sun Sep 11 10:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:31.423384 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33c57d-0c5d-484b-9684-daed27a20e4a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:31.423698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33c57d-0c5d-484b-9684-daed27a20e4a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:31.424084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33c57d-0c5d-484b-9684-daed27a20e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:31.506282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-5c33c57d-0c5d-484b-9684-daed27a20e4a None None] MFA Rules not processed for user `b642a1d00de940429fc1cc6131ac22b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:31.507504 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5c33c57d-0c5d-484b-9684-daed27a20e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:31.543066 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:31.632497 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 688/1367] 10.222.0.20 () {58 vars in 1059 bytes} [Sun Sep 11 10:39:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:31.640159 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60819097-0293-4c84-a1df-0e09f696f6b5 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:39:31.641710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-60819097-0293-4c84-a1df-0e09f696f6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:31.808488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60819097-0293-4c84-a1df-0e09f696f6b5 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:39:31.830519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:31.931929 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fc320-4192-4442-897c-78e03f3d9e2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:39:31.932564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fc320-4192-4442-897c-78e03f3d9e2e service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:31.932847 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fc320-4192-4442-897c-78e03f3d9e2e service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:31.933122 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fc320-4192-4442-897c-78e03f3d9e2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:31.934726 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-df4fc320-4192-4442-897c-78e03f3d9e2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:32.037976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fc320-4192-4442-897c-78e03f3d9e2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:39:32.040362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fc320-4192-4442-897c-78e03f3d9e2e service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:39:32.060842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 680/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:39:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:39:32.217195 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562a9a0-9f47-4592-a00f-457f6d147c03 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:32.217797 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562a9a0-9f47-4592-a00f-457f6d147c03 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:32.217905 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562a9a0-9f47-4592-a00f-457f6d147c03 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:32.220397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 689/1369] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:39:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:32.228719 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371682c6-8534-4947-ad30-0c71d93f5ef8 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:32.229302 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371682c6-8534-4947-ad30-0c71d93f5ef8 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:32.229644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371682c6-8534-4947-ad30-0c71d93f5ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:32.266350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:32.311880 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-371682c6-8534-4947-ad30-0c71d93f5ef8 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:32.313367 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-371682c6-8534-4947-ad30-0c71d93f5ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:32.441402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 681/1370] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:32.786950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba135212-40a4-410b-ab70-7bb0a04038dc None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:32.786950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba135212-40a4-410b-ab70-7bb0a04038dc None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:32.786950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba135212-40a4-410b-ab70-7bb0a04038dc None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:32.790285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 690/1371] 10.222.0.20 () {54 vars in 964 bytes} [Sun Sep 11 10:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:32.793229 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030eb93b-0233-44b0-b165-7b57d0d6c89d None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:32.793523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030eb93b-0233-44b0-b165-7b57d0d6c89d None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:32.793799 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030eb93b-0233-44b0-b165-7b57d0d6c89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:32.877912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-030eb93b-0233-44b0-b165-7b57d0d6c89d None None] MFA Rules not processed for user `caa0d9fe3d4942be8901876e57d1e561`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:32.879126 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-030eb93b-0233-44b0-b165-7b57d0d6c89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:32.928707 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:32.960247 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 682/1372] 10.222.0.20 () {58 vars in 1061 bytes} [Sun Sep 11 10:39:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:32.967895 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba135212-40a4-410b-ab70-7bb0a04038dc None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:39:32.969644 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ba135212-40a4-410b-ab70-7bb0a04038dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:33.088504 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba135212-40a4-410b-ab70-7bb0a04038dc None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:39:33.131365 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:33.171616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb8c4b-c483-49ed-a652-278c7a3ed903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:39:33.172249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb8c4b-c483-49ed-a652-278c7a3ed903 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:33.172532 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb8c4b-c483-49ed-a652-278c7a3ed903 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:33.172854 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb8c4b-c483-49ed-a652-278c7a3ed903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:33.175053 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5acb8c4b-c483-49ed-a652-278c7a3ed903 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:33.295912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb8c4b-c483-49ed-a652-278c7a3ed903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:39:33.297375 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb8c4b-c483-49ed-a652-278c7a3ed903 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:39:33.318884 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 691/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:39:34.297485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189255-59a5-44cc-8c03-6b55d8dbbee3 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:34.298015 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189255-59a5-44cc-8c03-6b55d8dbbee3 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:34.298015 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189255-59a5-44cc-8c03-6b55d8dbbee3 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:34.299433 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 683/1374] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:34.304862 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe16438-e498-42c6-b9a7-3007a3f1528e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:34.305678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe16438-e498-42c6-b9a7-3007a3f1528e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:34.306130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe16438-e498-42c6-b9a7-3007a3f1528e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:34.374132 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-8fe16438-e498-42c6-b9a7-3007a3f1528e None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:34.375354 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8fe16438-e498-42c6-b9a7-3007a3f1528e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:34.397003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:34.474834 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 692/1375] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:34.765214 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b189255-59a5-44cc-8c03-6b55d8dbbee3 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:39:34.766914 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0b189255-59a5-44cc-8c03-6b55d8dbbee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:34.953527 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b189255-59a5-44cc-8c03-6b55d8dbbee3 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:39:35.010914 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:35.074312 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb4794-34c1-4422-887b-c5b32cb771bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:39:35.074921 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb4794-34c1-4422-887b-c5b32cb771bf service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:35.075207 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb4794-34c1-4422-887b-c5b32cb771bf service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:35.075482 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb4794-34c1-4422-887b-c5b32cb771bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:35.077161 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-49fb4794-34c1-4422-887b-c5b32cb771bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:35.169406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb4794-34c1-4422-887b-c5b32cb771bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:39:35.171022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb4794-34c1-4422-887b-c5b32cb771bf service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:39:35.189559 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 684/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:39:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:39:37.412137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd5576-6bf7-4473-b601-21ba2961b3fd None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:37.412685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd5576-6bf7-4473-b601-21ba2961b3fd None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:37.412767 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd5576-6bf7-4473-b601-21ba2961b3fd None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:37.414199 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 693/1377] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:37.419321 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb375e-21b4-48fc-9a7a-e3e1e3a086a5 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:37.419706 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb375e-21b4-48fc-9a7a-e3e1e3a086a5 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:37.419885 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb375e-21b4-48fc-9a7a-e3e1e3a086a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:37.488873 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-23bb375e-21b4-48fc-9a7a-e3e1e3a086a5 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:37.490065 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-23bb375e-21b4-48fc-9a7a-e3e1e3a086a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:37.497154 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:37.590762 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 685/1378] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:37.880651 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd5576-6bf7-4473-b601-21ba2961b3fd None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:39:37.882335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a6bd5576-6bf7-4473-b601-21ba2961b3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:38.031637 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd5576-6bf7-4473-b601-21ba2961b3fd None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:39:38.036133 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:38.149060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d1cd7-43c3-4c08-a13a-2019246858f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:39:38.149672 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d1cd7-43c3-4c08-a13a-2019246858f5 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:38.149934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d1cd7-43c3-4c08-a13a-2019246858f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:38.150201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d1cd7-43c3-4c08-a13a-2019246858f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:38.151756 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3a4d1cd7-43c3-4c08-a13a-2019246858f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:38.253666 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d1cd7-43c3-4c08-a13a-2019246858f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:39:38.255537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d1cd7-43c3-4c08-a13a-2019246858f5 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:39:38.275086 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 694/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:39:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:39:40.470573 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef5668-cb9d-4c8f-a75a-998d7c927363 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:40.471700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef5668-cb9d-4c8f-a75a-998d7c927363 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:40.471990 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef5668-cb9d-4c8f-a75a-998d7c927363 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:40.473617 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 686/1380] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:40.478917 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ab523-b809-4092-afde-e032628f77df None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:40.479383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ab523-b809-4092-afde-e032628f77df None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:40.479468 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ab523-b809-4092-afde-e032628f77df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:40.491795 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:40.550252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ab3ab523-b809-4092-afde-e032628f77df None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:40.551505 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ab3ab523-b809-4092-afde-e032628f77df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:40.659738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 695/1381] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:40.965538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef5668-cb9d-4c8f-a75a-998d7c927363 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:39:40.967941 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f0ef5668-cb9d-4c8f-a75a-998d7c927363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:41.107786 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:41.118902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef5668-cb9d-4c8f-a75a-998d7c927363 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:39:41.244804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca650d5-5d21-4e67-a452-ee4e79a918e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:39:41.245561 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca650d5-5d21-4e67-a452-ee4e79a918e0 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:41.245966 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca650d5-5d21-4e67-a452-ee4e79a918e0 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:41.246243 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca650d5-5d21-4e67-a452-ee4e79a918e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:41.248411 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2ca650d5-5d21-4e67-a452-ee4e79a918e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:41.357061 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca650d5-5d21-4e67-a452-ee4e79a918e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:39:41.359263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca650d5-5d21-4e67-a452-ee4e79a918e0 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:39:41.372732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:41.381641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 687/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:39:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:39:44.123863 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb1a1e-dcf3-46a2-b72e-9f8a76eee7b2 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:44.124389 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb1a1e-dcf3-46a2-b72e-9f8a76eee7b2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:44.124389 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb1a1e-dcf3-46a2-b72e-9f8a76eee7b2 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:44.125799 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 696/1383] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:44.131862 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb55764-918c-4527-a509-c3c33605c0e3 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:44.132247 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb55764-918c-4527-a509-c3c33605c0e3 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:44.132405 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb55764-918c-4527-a509-c3c33605c0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:44.200287 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-cbb55764-918c-4527-a509-c3c33605c0e3 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:44.201585 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-cbb55764-918c-4527-a509-c3c33605c0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:44.300731 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 688/1384] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:44.588817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb1a1e-dcf3-46a2-b72e-9f8a76eee7b2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:39:44.590345 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7cdb1a1e-dcf3-46a2-b72e-9f8a76eee7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:44.677837 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:44.741743 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb1a1e-dcf3-46a2-b72e-9f8a76eee7b2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:39:44.857111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8011c-9059-4679-b1e9-ed2b11e04dde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:39:44.857724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8011c-9059-4679-b1e9-ed2b11e04dde service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:44.857997 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8011c-9059-4679-b1e9-ed2b11e04dde service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:44.858266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8011c-9059-4679-b1e9-ed2b11e04dde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:44.859863 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-90b8011c-9059-4679-b1e9-ed2b11e04dde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:44.909567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:44.953368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8011c-9059-4679-b1e9-ed2b11e04dde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:39:44.956043 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8011c-9059-4679-b1e9-ed2b11e04dde service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:39:44.978699 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 697/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:39:47.147740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652f80d-f6cf-40c9-8627-a91c029bfde7 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:47.148317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652f80d-f6cf-40c9-8627-a91c029bfde7 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:47.148317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652f80d-f6cf-40c9-8627-a91c029bfde7 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:47.149845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 689/1386] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:47.155739 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bd55f-2c2f-430c-8b82-ecc0af0d93ed None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:47.156192 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bd55f-2c2f-430c-8b82-ecc0af0d93ed None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:47.156477 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bd55f-2c2f-430c-8b82-ecc0af0d93ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:47.226483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-731bd55f-2c2f-430c-8b82-ecc0af0d93ed None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:47.227720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-731bd55f-2c2f-430c-8b82-ecc0af0d93ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:47.327110 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 698/1387] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:47.615010 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652f80d-f6cf-40c9-8627-a91c029bfde7 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:39:47.616517 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3652f80d-f6cf-40c9-8627-a91c029bfde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:47.693801 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:47.764165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652f80d-f6cf-40c9-8627-a91c029bfde7 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:39:47.878347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77c4bf-da5c-49b8-af86-e17fdd5edf67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:39:47.878989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77c4bf-da5c-49b8-af86-e17fdd5edf67 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:47.879269 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77c4bf-da5c-49b8-af86-e17fdd5edf67 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:47.879542 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77c4bf-da5c-49b8-af86-e17fdd5edf67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:47.881151 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-1c77c4bf-da5c-49b8-af86-e17fdd5edf67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:47.919173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:47.970218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77c4bf-da5c-49b8-af86-e17fdd5edf67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:39:47.972421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77c4bf-da5c-49b8-af86-e17fdd5edf67 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:39:47.990160 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 690/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:39:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:39:48.554089 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0efb3b-b7b1-488e-b4a8-52f10f7b3673 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:48.554661 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0efb3b-b7b1-488e-b4a8-52f10f7b3673 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:48.554661 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0efb3b-b7b1-488e-b4a8-52f10f7b3673 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:48.556088 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 699/1389] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:48.561659 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975dcac-bbbc-4402-a615-e706f9392f94 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:48.562080 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975dcac-bbbc-4402-a615-e706f9392f94 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:48.562279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975dcac-bbbc-4402-a615-e706f9392f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:48.629505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-0975dcac-bbbc-4402-a615-e706f9392f94 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:48.630718 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0975dcac-bbbc-4402-a615-e706f9392f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:48.734292 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 691/1390] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:49.029650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c0911-49c4-4efa-ac4f-70d292cfe5da None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:49.029937 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c0911-49c4-4efa-ac4f-70d292cfe5da None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:49.030209 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c0911-49c4-4efa-ac4f-70d292cfe5da None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:49.031542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 700/1391] 10.222.0.20 () {54 vars in 966 bytes} [Sun Sep 11 10:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:49.036759 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bab85d-90e9-40b0-963b-e38c88f7e994 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:49.037049 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bab85d-90e9-40b0-963b-e38c88f7e994 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:49.037324 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bab85d-90e9-40b0-963b-e38c88f7e994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:49.057140 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:49.121061 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-62bab85d-90e9-40b0-963b-e38c88f7e994 None None] MFA Rules not processed for user `28614526d50d4201b93b20df45465d32`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:49.122194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-62bab85d-90e9-40b0-963b-e38c88f7e994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:49.196673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 692/1392] 10.222.0.20 () {58 vars in 1063 bytes} [Sun Sep 11 10:39:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:49.205689 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c0911-49c4-4efa-ac4f-70d292cfe5da None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:39:49.207207 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f60c0911-49c4-4efa-ac4f-70d292cfe5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:49.240008 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:49.312633 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c0911-49c4-4efa-ac4f-70d292cfe5da None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:39:49.383977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b56b02-ca26-40a6-9fe7-18ab8fd0591f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28614526d50d4201b93b20df45465d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:39:49.384500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b56b02-ca26-40a6-9fe7-18ab8fd0591f service glance] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:49.384802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b56b02-ca26-40a6-9fe7-18ab8fd0591f service glance] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:49.385071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b56b02-ca26-40a6-9fe7-18ab8fd0591f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:49.386641 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e7b56b02-ca26-40a6-9fe7-18ab8fd0591f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:49.462039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:49.493970 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b56b02-ca26-40a6-9fe7-18ab8fd0591f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:39:49.495387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b56b02-ca26-40a6-9fe7-18ab8fd0591f service glance] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:39:49.513691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 701/1393] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:39:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:39:50.186446 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10151e0-ae39-47fd-a180-c8fe0fec28a2 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:50.186942 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10151e0-ae39-47fd-a180-c8fe0fec28a2 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:50.187045 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10151e0-ae39-47fd-a180-c8fe0fec28a2 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:50.188754 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 693/1394] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:50.194106 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c0031-2433-4b8c-96ce-bd6de784041e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:50.195054 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c0031-2433-4b8c-96ce-bd6de784041e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:50.195333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c0031-2433-4b8c-96ce-bd6de784041e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:50.261331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7f790-fa55-494c-b4a9-47868c15163c None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:50.261693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7f790-fa55-494c-b4a9-47868c15163c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:50.262047 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7f790-fa55-494c-b4a9-47868c15163c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:50.266185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d17c0031-2433-4b8c-96ce-bd6de784041e None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:50.267942 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d17c0031-2433-4b8c-96ce-bd6de784041e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:50.331512 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-7ef7f790-fa55-494c-b4a9-47868c15163c None None] MFA Rules not processed for user `bdc800f1d4174b5cba4f6f496207ec95`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:50.332734 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7ef7f790-fa55-494c-b4a9-47868c15163c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:50.370548 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 702/1395] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:50.389500 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:50.422710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 694/1396] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 10:39:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:39:50.465122 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ce85f-c6e0-492f-916f-890b8c7b21b4 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:50.465407 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ce85f-c6e0-492f-916f-890b8c7b21b4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:50.465696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ce85f-c6e0-492f-916f-890b8c7b21b4 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:50.467052 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 703/1397] 10.222.0.20 () {54 vars in 943 bytes} [Sun Sep 11 10:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:50.474228 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494734c-7606-4d1c-8f4b-d18230669cbc None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:50.474505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494734c-7606-4d1c-8f4b-d18230669cbc None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:50.474787 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494734c-7606-4d1c-8f4b-d18230669cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:50.551275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-3494734c-7606-4d1c-8f4b-d18230669cbc None None] MFA Rules not processed for user `28ff72290fd14ddaba6ed757051e182b`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:50.552466 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3494734c-7606-4d1c-8f4b-d18230669cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:50.661369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ce85f-c6e0-492f-916f-890b8c7b21b4 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:39:50.662508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 695/1398] 10.222.0.20 () {58 vars in 1040 bytes} [Sun Sep 11 10:39:50 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:50.662963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-983ce85f-c6e0-492f-916f-890b8c7b21b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:50.671777 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494734c-7606-4d1c-8f4b-d18230669cbc None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:39:50.681236 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494734c-7606-4d1c-8f4b-d18230669cbc None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:39:50.703389 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:50.708947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:50.799113 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86afd24-cf4e-4b16-8edf-bedcb83a86d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ff72290fd14ddaba6ed757051e182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:39:50.799751 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86afd24-cf4e-4b16-8edf-bedcb83a86d0 service swift] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:50.800031 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86afd24-cf4e-4b16-8edf-bedcb83a86d0 service swift] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:50.800302 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86afd24-cf4e-4b16-8edf-bedcb83a86d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:50.802035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d86afd24-cf4e-4b16-8edf-bedcb83a86d0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:50.815854 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ce85f-c6e0-492f-916f-890b8c7b21b4 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:39:50.886356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86afd24-cf4e-4b16-8edf-bedcb83a86d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:39:50.887972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86afd24-cf4e-4b16-8edf-bedcb83a86d0 service swift] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:39:50.896284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 696/1399] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 10:39:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 10:39:50.929485 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:50.932178 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561415e3-54e0-417f-b6d5-b36755ac6edc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:39:50.933194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561415e3-54e0-417f-b6d5-b36755ac6edc service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:50.933544 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561415e3-54e0-417f-b6d5-b36755ac6edc service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:50.934082 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561415e3-54e0-417f-b6d5-b36755ac6edc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:50.935909 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-561415e3-54e0-417f-b6d5-b36755ac6edc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:51.052959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561415e3-54e0-417f-b6d5-b36755ac6edc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:39:51.054831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561415e3-54e0-417f-b6d5-b36755ac6edc service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:39:51.077388 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 704/1400] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:39:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 10:39:53.274011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ab7ee-a3a5-4d07-8196-9a9e31c6444b None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:53.274599 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ab7ee-a3a5-4d07-8196-9a9e31c6444b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:53.274599 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ab7ee-a3a5-4d07-8196-9a9e31c6444b None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:53.276367 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 697/1401] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:53.281458 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a39f85-7574-4f3a-8319-5f179f8b5364 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:53.281880 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a39f85-7574-4f3a-8319-5f179f8b5364 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:53.282028 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a39f85-7574-4f3a-8319-5f179f8b5364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:53.357644 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-99a39f85-7574-4f3a-8319-5f179f8b5364 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:53.358861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-99a39f85-7574-4f3a-8319-5f179f8b5364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:53.435602 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:53.469382 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 705/1402] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:39:53.810140 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ab7ee-a3a5-4d07-8196-9a9e31c6444b None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:39:53.811665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-352ab7ee-a3a5-4d07-8196-9a9e31c6444b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:53.881914 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:53.979131 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ab7ee-a3a5-4d07-8196-9a9e31c6444b None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:39:54.109074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9da859-25c9-44b1-8d5b-eaba8c2c5676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:39:54.109892 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9da859-25c9-44b1-8d5b-eaba8c2c5676 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:54.110169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9da859-25c9-44b1-8d5b-eaba8c2c5676 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:54.110437 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9da859-25c9-44b1-8d5b-eaba8c2c5676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:54.112601 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8b9da859-25c9-44b1-8d5b-eaba8c2c5676 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:54.132743 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:54.214390 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9da859-25c9-44b1-8d5b-eaba8c2c5676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:39:54.216085 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9da859-25c9-44b1-8d5b-eaba8c2c5676 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:39:54.242170 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 698/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:39:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:39:56.481316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd71ec3-23f4-42e1-a03e-cf0c332692d1 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:56.481897 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd71ec3-23f4-42e1-a03e-cf0c332692d1 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:56.481897 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd71ec3-23f4-42e1-a03e-cf0c332692d1 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:56.483260 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 706/1404] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:56.489451 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4417dae-19d3-44c7-b2f5-a347ca490b5e None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:56.489911 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4417dae-19d3-44c7-b2f5-a347ca490b5e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:56.490005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4417dae-19d3-44c7-b2f5-a347ca490b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:56.560310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-c4417dae-19d3-44c7-b2f5-a347ca490b5e None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:56.561583 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c4417dae-19d3-44c7-b2f5-a347ca490b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:56.662722 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:56.668818 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 699/1405] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:39:56.974186 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd71ec3-23f4-42e1-a03e-cf0c332692d1 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:39:56.976333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8fd71ec3-23f4-42e1-a03e-cf0c332692d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:57.149195 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd71ec3-23f4-42e1-a03e-cf0c332692d1 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:39:57.217614 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:57.283344 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c0450-f21d-4a11-8d9d-101b5f073f06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:39:57.284119 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c0450-f21d-4a11-8d9d-101b5f073f06 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:57.284495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c0450-f21d-4a11-8d9d-101b5f073f06 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:57.284890 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c0450-f21d-4a11-8d9d-101b5f073f06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:57.286622 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-105c0450-f21d-4a11-8d9d-101b5f073f06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:57.388723 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c0450-f21d-4a11-8d9d-101b5f073f06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:39:57.390358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c0450-f21d-4a11-8d9d-101b5f073f06 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:39:57.411778 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 707/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:39:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:39:59.675975 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d2a6b-b0dd-418a-bd17-0e5f7be0cfed None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:59.676602 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d2a6b-b0dd-418a-bd17-0e5f7be0cfed None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:59.676602 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d2a6b-b0dd-418a-bd17-0e5f7be0cfed None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:59.678048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 700/1407] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:39:59.683132 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560b96d-4f54-45b4-9a68-01ac08c15c5e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:39:59.683570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560b96d-4f54-45b4-9a68-01ac08c15c5e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:39:59.683674 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560b96d-4f54-45b4-9a68-01ac08c15c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:39:59.756665 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9560b96d-4f54-45b4-9a68-01ac08c15c5e None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:39:59.757877 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9560b96d-4f54-45b4-9a68-01ac08c15c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:39:59.770450 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:39:59.866715 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 708/1408] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:40:00.157954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d2a6b-b0dd-418a-bd17-0e5f7be0cfed None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:40:00.159928 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-326d2a6b-b0dd-418a-bd17-0e5f7be0cfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:00.326265 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d2a6b-b0dd-418a-bd17-0e5f7be0cfed None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:40:00.404021 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:00.453826 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5f566-450e-4cfa-9580-f6276758daa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:40:00.455011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5f566-450e-4cfa-9580-f6276758daa0 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:00.455294 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5f566-450e-4cfa-9580-f6276758daa0 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:00.455571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5f566-450e-4cfa-9580-f6276758daa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:00.457199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-34e5f566-450e-4cfa-9580-f6276758daa0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:00.568117 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5f566-450e-4cfa-9580-f6276758daa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:40:00.571179 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5f566-450e-4cfa-9580-f6276758daa0 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:40:00.589589 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 701/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:09.864998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=38 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:10.586626 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=64 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:13.528821 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d84a5-65eb-4ef3-9b6d-024143600bd7 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:13.529393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d84a5-65eb-4ef3-9b6d-024143600bd7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:13.529393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d84a5-65eb-4ef3-9b6d-024143600bd7 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:13.530719 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 709/1410] 10.222.0.20 () {54 vars in 918 bytes} [Sun Sep 11 10:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:40:13.535678 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd65118-74f5-41f5-8294-cdfef444f740 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:13.536101 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd65118-74f5-41f5-8294-cdfef444f740 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:13.536248 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd65118-74f5-41f5-8294-cdfef444f740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:13.615484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-8dd65118-74f5-41f5-8294-cdfef444f740 None None] MFA Rules not processed for user `7f0211a05cca4e72b30d64eef4ba527c`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:40:13.616726 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8dd65118-74f5-41f5-8294-cdfef444f740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:13.723056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 702/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Sun Sep 11 10:40:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:40:13.737422 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ef62-0a94-48e9-a19f-53ccac25251e None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:13.737703 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ef62-0a94-48e9-a19f-53ccac25251e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:13.737973 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ef62-0a94-48e9-a19f-53ccac25251e None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:13.739316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 710/1412] 10.222.0.20 () {54 vars in 918 bytes} [Sun Sep 11 10:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:40:13.744205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5899e-78c6-4d7d-953f-2b013dc18244 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:13.744490 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5899e-78c6-4d7d-953f-2b013dc18244 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:13.744794 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5899e-78c6-4d7d-953f-2b013dc18244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:13.817189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:13.819807 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-77e5899e-78c6-4d7d-953f-2b013dc18244 None None] MFA Rules not processed for user `b642a1d00de940429fc1cc6131ac22b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:40:13.821665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-77e5899e-78c6-4d7d-953f-2b013dc18244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:13.935896 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 703/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Sun Sep 11 10:40:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:40:16.515249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be487e5-da8b-4e04-a1e8-5d6910594b74 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:16.515823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be487e5-da8b-4e04-a1e8-5d6910594b74 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:16.515823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be487e5-da8b-4e04-a1e8-5d6910594b74 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:16.517677 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 10:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:40:16.523035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd567b-adb5-4ca8-9d7e-91f12e992810 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:16.523440 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd567b-adb5-4ca8-9d7e-91f12e992810 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:16.523575 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd567b-adb5-4ca8-9d7e-91f12e992810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:16.590236 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-a3bd567b-adb5-4ca8-9d7e-91f12e992810 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:40:16.591431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a3bd567b-adb5-4ca8-9d7e-91f12e992810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:16.646377 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:16.688707 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 10:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:40:16.975758 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be487e5-da8b-4e04-a1e8-5d6910594b74 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:40:16.977338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7be487e5-da8b-4e04-a1e8-5d6910594b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:17.118767 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be487e5-da8b-4e04-a1e8-5d6910594b74 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:40:17.188431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:17.228930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6be7e0-6d70-44e9-9c39-768f3f57a8e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:40:17.229530 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6be7e0-6d70-44e9-9c39-768f3f57a8e9 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:17.229804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6be7e0-6d70-44e9-9c39-768f3f57a8e9 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:17.230063 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6be7e0-6d70-44e9-9c39-768f3f57a8e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:17.231644 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7e6be7e0-6d70-44e9-9c39-768f3f57a8e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:17.318682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6be7e0-6d70-44e9-9c39-768f3f57a8e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:40:17.320341 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6be7e0-6d70-44e9-9c39-768f3f57a8e9 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:40:17.338302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 712/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:40:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:18.463627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a7755-50e1-4444-a30d-cee8de0c91ba None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:18.464191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a7755-50e1-4444-a30d-cee8de0c91ba None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:18.464191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a7755-50e1-4444-a30d-cee8de0c91ba None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:18.465568 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 10:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:40:18.472659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cdc79-8f78-41a9-811e-5e368a32db93 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:18.473100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cdc79-8f78-41a9-811e-5e368a32db93 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:18.473203 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cdc79-8f78-41a9-811e-5e368a32db93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:18.546461 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-741cdc79-8f78-41a9-811e-5e368a32db93 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:40:18.548246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-741cdc79-8f78-41a9-811e-5e368a32db93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:18.573997 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:18.643199 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 10:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:40:18.792990 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a7755-50e1-4444-a30d-cee8de0c91ba None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:40:18.794545 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-128a7755-50e1-4444-a30d-cee8de0c91ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:18.936015 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a7755-50e1-4444-a30d-cee8de0c91ba None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:40:18.975713 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:19.047592 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11527efc-6cf9-4ba9-935c-915886b5b8b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:40:19.048195 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11527efc-6cf9-4ba9-935c-915886b5b8b9 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:19.048478 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11527efc-6cf9-4ba9-935c-915886b5b8b9 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:19.048772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11527efc-6cf9-4ba9-935c-915886b5b8b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:19.050363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-11527efc-6cf9-4ba9-935c-915886b5b8b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:19.138216 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11527efc-6cf9-4ba9-935c-915886b5b8b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:40:19.139799 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11527efc-6cf9-4ba9-935c-915886b5b8b9 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:40:19.157746 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 706/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:40:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:20.282296 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7035c96-c109-4d82-b0a5-cdb67584b19d None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:20.282881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7035c96-c109-4d82-b0a5-cdb67584b19d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:20.282881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7035c96-c109-4d82-b0a5-cdb67584b19d None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:20.284173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 10:40:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:40:20.290429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0a820-fde8-4436-b1b8-e78780007071 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:20.290874 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0a820-fde8-4436-b1b8-e78780007071 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:20.290986 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0a820-fde8-4436-b1b8-e78780007071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:20.345663 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:20.368341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-05d0a820-fde8-4436-b1b8-e78780007071 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:40:20.369571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-05d0a820-fde8-4436-b1b8-e78780007071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:20.463761 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 10:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:40:20.615135 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7035c96-c109-4d82-b0a5-cdb67584b19d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:40:20.616745 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d7035c96-c109-4d82-b0a5-cdb67584b19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:20.758425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7035c96-c109-4d82-b0a5-cdb67584b19d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:40:20.770116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:20.870181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f2206-f820-4fbb-aaa3-add8d1245afd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:40:20.870753 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f2206-f820-4fbb-aaa3-add8d1245afd service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:20.871032 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f2206-f820-4fbb-aaa3-add8d1245afd service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:20.871305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f2206-f820-4fbb-aaa3-add8d1245afd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:20.872923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e80f2206-f820-4fbb-aaa3-add8d1245afd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:20.960461 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f2206-f820-4fbb-aaa3-add8d1245afd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:40:20.962094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f2206-f820-4fbb-aaa3-add8d1245afd service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:40:20.981084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 715/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:40:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:22.097952 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed88ea-cc60-42af-ae31-bdc3b9fd31f4 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:22.098509 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed88ea-cc60-42af-ae31-bdc3b9fd31f4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:22.098509 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed88ea-cc60-42af-ae31-bdc3b9fd31f4 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:22.099852 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 10:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:40:22.106001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02ce98-bf36-4114-8ddf-bb1164be5921 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:22.106403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02ce98-bf36-4114-8ddf-bb1164be5921 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:22.106545 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02ce98-bf36-4114-8ddf-bb1164be5921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:22.126966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:22.181938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4d02ce98-bf36-4114-8ddf-bb1164be5921 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:40:22.183145 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4d02ce98-bf36-4114-8ddf-bb1164be5921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:22.277550 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 10:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:40:22.427895 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed88ea-cc60-42af-ae31-bdc3b9fd31f4 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:40:22.429375 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-59ed88ea-cc60-42af-ae31-bdc3b9fd31f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:22.537373 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:22.572144 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed88ea-cc60-42af-ae31-bdc3b9fd31f4 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:40:22.683684 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0dd8c-6435-40eb-919c-db894cee5528 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:40:22.684211 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0dd8c-6435-40eb-919c-db894cee5528 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:22.684487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0dd8c-6435-40eb-919c-db894cee5528 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:22.684793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0dd8c-6435-40eb-919c-db894cee5528 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:22.686371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a9b0dd8c-6435-40eb-919c-db894cee5528 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:22.763091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:22.777402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0dd8c-6435-40eb-919c-db894cee5528 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:40:22.779003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0dd8c-6435-40eb-919c-db894cee5528 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:40:22.797022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 709/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:40:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:23.902516 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d698c87-7067-4cae-88d2-4682032fbd62 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:23.903072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d698c87-7067-4cae-88d2-4682032fbd62 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:23.903072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d698c87-7067-4cae-88d2-4682032fbd62 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:23.904395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 10:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:40:23.910450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbf630-bb0d-4b2a-ab3c-dc4752ff7861 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:23.910838 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbf630-bb0d-4b2a-ab3c-dc4752ff7861 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:23.910998 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbf630-bb0d-4b2a-ab3c-dc4752ff7861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:23.986362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e6cbf630-bb0d-4b2a-ab3c-dc4752ff7861 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:40:23.987486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e6cbf630-bb0d-4b2a-ab3c-dc4752ff7861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:24.081841 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 10:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:40:24.231202 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d698c87-7067-4cae-88d2-4682032fbd62 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:40:24.232752 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7d698c87-7067-4cae-88d2-4682032fbd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:24.317200 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:24.381939 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d698c87-7067-4cae-88d2-4682032fbd62 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:40:24.492683 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97429c07-018f-41b7-be47-1918da0c49fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:40:24.493287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97429c07-018f-41b7-be47-1918da0c49fd service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:24.493564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97429c07-018f-41b7-be47-1918da0c49fd service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:24.493834 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97429c07-018f-41b7-be47-1918da0c49fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:24.495432 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-97429c07-018f-41b7-be47-1918da0c49fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:24.543038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:24.583239 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97429c07-018f-41b7-be47-1918da0c49fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:40:24.584780 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97429c07-018f-41b7-be47-1918da0c49fd service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:40:24.602814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 718/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:40:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:25.639917 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65254c-aca4-413c-9c09-d43aa532599b None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:25.640579 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65254c-aca4-413c-9c09-d43aa532599b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:25.640579 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65254c-aca4-413c-9c09-d43aa532599b None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:25.641847 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 10:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:40:25.647972 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba07868-5b19-4d84-8811-102da6fe2b25 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:25.648437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba07868-5b19-4d84-8811-102da6fe2b25 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:25.648539 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba07868-5b19-4d84-8811-102da6fe2b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:25.724758 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-8ba07868-5b19-4d84-8811-102da6fe2b25 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:40:25.725969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8ba07868-5b19-4d84-8811-102da6fe2b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:25.820505 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 10:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:40:25.971737 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65254c-aca4-413c-9c09-d43aa532599b None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:40:25.973217 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-cd65254c-aca4-413c-9c09-d43aa532599b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:26.022348 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:26.117633 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65254c-aca4-413c-9c09-d43aa532599b None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:40:26.232737 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f92c9-5665-432e-8035-90ef36c807da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:40:26.233266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f92c9-5665-432e-8035-90ef36c807da service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:26.233544 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f92c9-5665-432e-8035-90ef36c807da service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:26.233817 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f92c9-5665-432e-8035-90ef36c807da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:26.235420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-4a7f92c9-5665-432e-8035-90ef36c807da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:26.242412 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:26.325274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f92c9-5665-432e-8035-90ef36c807da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:40:26.326866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f92c9-5665-432e-8035-90ef36c807da service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:40:26.345699 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 712/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:40:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:27.391763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1949b2-af4b-49c9-9d61-2295af2b3026 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:27.392326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1949b2-af4b-49c9-9d61-2295af2b3026 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:27.392326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1949b2-af4b-49c9-9d61-2295af2b3026 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:27.393682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 10:40:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:40:27.400148 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380fcbf-8bd0-4bfb-991f-be726b57549a None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:27.400633 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380fcbf-8bd0-4bfb-991f-be726b57549a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:27.400740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380fcbf-8bd0-4bfb-991f-be726b57549a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:27.475477 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-7380fcbf-8bd0-4bfb-991f-be726b57549a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:40:27.476626 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7380fcbf-8bd0-4bfb-991f-be726b57549a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:27.543254 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:27.575939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 10:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:40:27.728357 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1949b2-af4b-49c9-9d61-2295af2b3026 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:40:27.729848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cf1949b2-af4b-49c9-9d61-2295af2b3026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:27.746999 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:27.873438 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1949b2-af4b-49c9-9d61-2295af2b3026 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:40:27.959203 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:27.985735 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d20365-b001-464a-9bb6-acbb2ee1d8c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:40:27.986274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d20365-b001-464a-9bb6-acbb2ee1d8c1 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:27.986552 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d20365-b001-464a-9bb6-acbb2ee1d8c1 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:27.986822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d20365-b001-464a-9bb6-acbb2ee1d8c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:27.988428 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-87d20365-b001-464a-9bb6-acbb2ee1d8c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:28.074325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d20365-b001-464a-9bb6-acbb2ee1d8c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:40:28.075897 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d20365-b001-464a-9bb6-acbb2ee1d8c1 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:40:28.093395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 721/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:29.138962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42d639-aa51-4243-90b0-a9b8b08fbd6c None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:29.139515 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42d639-aa51-4243-90b0-a9b8b08fbd6c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:29.139515 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42d639-aa51-4243-90b0-a9b8b08fbd6c None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:29.141511 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 10:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:40:29.147732 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4eb732-bffb-41f4-9c9b-05767ccafbd4 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:29.148155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4eb732-bffb-41f4-9c9b-05767ccafbd4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:29.148251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4eb732-bffb-41f4-9c9b-05767ccafbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:29.224927 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7e4eb732-bffb-41f4-9c9b-05767ccafbd4 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:40:29.226140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7e4eb732-bffb-41f4-9c9b-05767ccafbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:29.268197 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:29.321508 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 10:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:40:29.471270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42d639-aa51-4243-90b0-a9b8b08fbd6c None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:40:29.472734 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9a42d639-aa51-4243-90b0-a9b8b08fbd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:29.613568 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42d639-aa51-4243-90b0-a9b8b08fbd6c None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:40:29.666025 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:29.725589 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d874f-d791-4b71-9cb1-836cc4fa0ed8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:40:29.726139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d874f-d791-4b71-9cb1-836cc4fa0ed8 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:29.726413 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d874f-d791-4b71-9cb1-836cc4fa0ed8 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:29.726679 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d874f-d791-4b71-9cb1-836cc4fa0ed8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:29.728254 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-db4d874f-d791-4b71-9cb1-836cc4fa0ed8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:29.817907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d874f-d791-4b71-9cb1-836cc4fa0ed8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:40:29.819509 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d874f-d791-4b71-9cb1-836cc4fa0ed8 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:40:29.836970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 715/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:30.895499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feebe8-eb16-4b61-bb73-491b9146e70d None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:30.895959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feebe8-eb16-4b61-bb73-491b9146e70d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:30.896066 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feebe8-eb16-4b61-bb73-491b9146e70d None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:30.897447 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 10:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:40:30.903705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963f741-612d-4bf3-9228-ea0698d491ec None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:30.904152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963f741-612d-4bf3-9228-ea0698d491ec None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:30.904260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963f741-612d-4bf3-9228-ea0698d491ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:30.979662 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-0963f741-612d-4bf3-9228-ea0698d491ec None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:40:30.980804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0963f741-612d-4bf3-9228-ea0698d491ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:30.982772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:31.075806 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 10:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:40:31.225762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feebe8-eb16-4b61-bb73-491b9146e70d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:40:31.227268 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-96feebe8-eb16-4b61-bb73-491b9146e70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:31.370931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feebe8-eb16-4b61-bb73-491b9146e70d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:40:31.399325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:31.483367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725eaa3b-d78f-4561-9506-f9fe756b90eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:40:31.483990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725eaa3b-d78f-4561-9506-f9fe756b90eb service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:31.484269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725eaa3b-d78f-4561-9506-f9fe756b90eb service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:31.484538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725eaa3b-d78f-4561-9506-f9fe756b90eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:31.486149 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-725eaa3b-d78f-4561-9506-f9fe756b90eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:31.572821 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725eaa3b-d78f-4561-9506-f9fe756b90eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:40:31.574401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725eaa3b-d78f-4561-9506-f9fe756b90eb service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:40:31.591867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 724/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:40:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:33.648825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a8cde-1a38-48ea-bb66-59f8526106cd None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:33.649334 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a8cde-1a38-48ea-bb66-59f8526106cd None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:33.649334 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a8cde-1a38-48ea-bb66-59f8526106cd None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:33.650645 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 10:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:40:33.655923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e0ef3-7440-4e01-a53c-8bd4d10cd5ae None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:33.656315 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e0ef3-7440-4e01-a53c-8bd4d10cd5ae None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:33.656465 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e0ef3-7440-4e01-a53c-8bd4d10cd5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:33.696902 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:33.722766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-688e0ef3-7440-4e01-a53c-8bd4d10cd5ae None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:40:33.723992 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-688e0ef3-7440-4e01-a53c-8bd4d10cd5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:33.817915 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 10:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:40:34.099738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a8cde-1a38-48ea-bb66-59f8526106cd None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:40:34.101310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-df9a8cde-1a38-48ea-bb66-59f8526106cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:34.202417 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a8cde-1a38-48ea-bb66-59f8526106cd None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:40:34.237245 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:34.278995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d7bb4-7c6f-4bc6-8bd6-f5252db3c526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:40:34.279595 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d7bb4-7c6f-4bc6-8bd6-f5252db3c526 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:34.279869 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d7bb4-7c6f-4bc6-8bd6-f5252db3c526 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:34.280138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d7bb4-7c6f-4bc6-8bd6-f5252db3c526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:34.282253 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b90d7bb4-7c6f-4bc6-8bd6-f5252db3c526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:34.393369 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d7bb4-7c6f-4bc6-8bd6-f5252db3c526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:40:34.394743 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d7bb4-7c6f-4bc6-8bd6-f5252db3c526 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:40:34.412365 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 718/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:40:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:36.775251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2948d36-e46a-4e55-8aae-230da81f4417 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:36.775737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2948d36-e46a-4e55-8aae-230da81f4417 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:36.775848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2948d36-e46a-4e55-8aae-230da81f4417 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:36.777171 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 10:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:40:36.782353 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642678c-f8bd-4ccc-984e-b6a40b04acf6 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:36.782800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642678c-f8bd-4ccc-984e-b6a40b04acf6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:36.782904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642678c-f8bd-4ccc-984e-b6a40b04acf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:36.848817 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-8642678c-f8bd-4ccc-984e-b6a40b04acf6 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:40:36.850015 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8642678c-f8bd-4ccc-984e-b6a40b04acf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:36.862420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:36.947220 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 10:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:40:37.231610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2948d36-e46a-4e55-8aae-230da81f4417 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:40:37.233185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a2948d36-e46a-4e55-8aae-230da81f4417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:37.337134 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2948d36-e46a-4e55-8aae-230da81f4417 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:40:37.350213 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:37.409193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f95532-cc82-4262-b8f9-7813e82f6cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:40:37.409792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f95532-cc82-4262-b8f9-7813e82f6cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:37.410068 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f95532-cc82-4262-b8f9-7813e82f6cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:37.410337 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f95532-cc82-4262-b8f9-7813e82f6cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:37.411924 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c7f95532-cc82-4262-b8f9-7813e82f6cd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:37.518579 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f95532-cc82-4262-b8f9-7813e82f6cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:40:37.519929 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f95532-cc82-4262-b8f9-7813e82f6cd4 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:40:37.537738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 727/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:40:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:40.016888 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20809c2d-da85-4688-b95e-c9580d799c3f None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:40.017439 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20809c2d-da85-4688-b95e-c9580d799c3f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:40.017439 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20809c2d-da85-4688-b95e-c9580d799c3f None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:40.019012 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 10:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:40:40.024429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc03fd-125a-4c95-81b5-f8ae03d05c87 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:40.024889 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc03fd-125a-4c95-81b5-f8ae03d05c87 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:40.025037 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc03fd-125a-4c95-81b5-f8ae03d05c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:40.071824 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:40.089684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-12dc03fd-125a-4c95-81b5-f8ae03d05c87 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:40:40.090899 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-12dc03fd-125a-4c95-81b5-f8ae03d05c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:40.185162 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 10:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:40:40.474685 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20809c2d-da85-4688-b95e-c9580d799c3f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:40:40.476220 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-20809c2d-da85-4688-b95e-c9580d799c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:40.579059 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20809c2d-da85-4688-b95e-c9580d799c3f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:40:40.618484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:40.653098 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96a446-8987-4631-b673-0460de91783c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:40:40.653696 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96a446-8987-4631-b673-0460de91783c service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:40.653969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96a446-8987-4631-b673-0460de91783c service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:40.654235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96a446-8987-4631-b673-0460de91783c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:40.655819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6b96a446-8987-4631-b673-0460de91783c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:40.763848 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96a446-8987-4631-b673-0460de91783c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:40:40.765928 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96a446-8987-4631-b673-0460de91783c service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:40:40.784928 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 721/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:40:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:43.064458 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a2243-f67d-420b-825c-c07bed3483c6 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:43.065012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a2243-f67d-420b-825c-c07bed3483c6 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:43.065012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a2243-f67d-420b-825c-c07bed3483c6 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:43.066375 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 10:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:40:43.071702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b51ca-83e9-46d6-82eb-5187f769b8d7 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:43.072136 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b51ca-83e9-46d6-82eb-5187f769b8d7 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:43.072265 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b51ca-83e9-46d6-82eb-5187f769b8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:43.137320 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-676b51ca-83e9-46d6-82eb-5187f769b8d7 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:40:43.138519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-676b51ca-83e9-46d6-82eb-5187f769b8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:43.159910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:43.240123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 10:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:40:43.526845 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a2243-f67d-420b-825c-c07bed3483c6 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:40:43.528374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3f1a2243-f67d-420b-825c-c07bed3483c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:43.628639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a2243-f67d-420b-825c-c07bed3483c6 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:40:43.648939 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:43.703012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb285cc3-5616-47b4-a095-e9da7e3882a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:40:43.703614 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb285cc3-5616-47b4-a095-e9da7e3882a6 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:43.703892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb285cc3-5616-47b4-a095-e9da7e3882a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:43.704156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb285cc3-5616-47b4-a095-e9da7e3882a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:43.705777 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cb285cc3-5616-47b4-a095-e9da7e3882a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:43.930445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb285cc3-5616-47b4-a095-e9da7e3882a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:40:43.931834 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb285cc3-5616-47b4-a095-e9da7e3882a6 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:40:43.950044 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 730/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:46.161823 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c434cc5-0bda-4154-9e87-6b85980f9416 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:46.162438 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c434cc5-0bda-4154-9e87-6b85980f9416 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:46.162438 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c434cc5-0bda-4154-9e87-6b85980f9416 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:46.163774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 10:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:40:46.169203 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41492dd9-3daf-4a88-8672-fdebba694367 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:46.169628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41492dd9-3daf-4a88-8672-fdebba694367 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:46.169749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41492dd9-3daf-4a88-8672-fdebba694367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:46.234054 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:46.237134 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-41492dd9-3daf-4a88-8672-fdebba694367 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:40:46.238979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-41492dd9-3daf-4a88-8672-fdebba694367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:46.332942 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 10:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:40:46.617495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c434cc5-0bda-4154-9e87-6b85980f9416 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:40:46.619042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7c434cc5-0bda-4154-9e87-6b85980f9416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:46.721845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c434cc5-0bda-4154-9e87-6b85980f9416 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:40:46.770594 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:46.795170 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5f3e9-5b57-43c3-8319-ce137cb38293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:40:46.795901 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5f3e9-5b57-43c3-8319-ce137cb38293 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:46.796100 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5f3e9-5b57-43c3-8319-ce137cb38293 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:46.796366 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5f3e9-5b57-43c3-8319-ce137cb38293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:46.798010 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b0a5f3e9-5b57-43c3-8319-ce137cb38293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:46.905779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5f3e9-5b57-43c3-8319-ce137cb38293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:40:46.907204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5f3e9-5b57-43c3-8319-ce137cb38293 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:40:46.925655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 724/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:49.161964 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a085c1-0412-455f-ac2d-ca0aa09eba84 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:49.162516 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a085c1-0412-455f-ac2d-ca0aa09eba84 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:49.162516 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a085c1-0412-455f-ac2d-ca0aa09eba84 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:49.163862 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 10:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:40:49.169132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15904224-159f-434f-ad21-687cab7a7311 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:49.169516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15904224-159f-434f-ad21-687cab7a7311 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:49.169697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15904224-159f-434f-ad21-687cab7a7311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:49.236050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-15904224-159f-434f-ad21-687cab7a7311 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:40:49.237350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-15904224-159f-434f-ad21-687cab7a7311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:49.266142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:49.333071 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 10:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:40:49.619591 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a085c1-0412-455f-ac2d-ca0aa09eba84 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:40:49.621136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-17a085c1-0412-455f-ac2d-ca0aa09eba84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:49.721982 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a085c1-0412-455f-ac2d-ca0aa09eba84 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:40:49.749633 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:49.793544 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee7a11-c266-4c93-b29b-150e6115c88a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:40:49.794142 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7a11-c266-4c93-b29b-150e6115c88a service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:49.794416 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7a11-c266-4c93-b29b-150e6115c88a service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:49.794679 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7a11-c266-4c93-b29b-150e6115c88a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:49.796955 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ddee7a11-c266-4c93-b29b-150e6115c88a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:49.904304 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee7a11-c266-4c93-b29b-150e6115c88a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:40:49.905722 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee7a11-c266-4c93-b29b-150e6115c88a service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:40:49.924488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 733/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:52.133395 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114f0de-7574-4c59-8ee6-dc7ad33c5a55 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:52.133961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114f0de-7574-4c59-8ee6-dc7ad33c5a55 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:52.133961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114f0de-7574-4c59-8ee6-dc7ad33c5a55 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:52.135298 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 10:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:40:52.141080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5195b7-b9c2-4d9f-beda-7171d8b8e194 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:52.141486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5195b7-b9c2-4d9f-beda-7171d8b8e194 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:52.141627 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5195b7-b9c2-4d9f-beda-7171d8b8e194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:52.205750 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ac5195b7-b9c2-4d9f-beda-7171d8b8e194 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:40:52.206946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ac5195b7-b9c2-4d9f-beda-7171d8b8e194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:52.215006 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:52.302388 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 10:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:40:52.582459 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114f0de-7574-4c59-8ee6-dc7ad33c5a55 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:40:52.584026 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c114f0de-7574-4c59-8ee6-dc7ad33c5a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:52.686917 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114f0de-7574-4c59-8ee6-dc7ad33c5a55 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:40:52.742669 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:52.760988 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ba59c-b1bd-4615-97c3-6dde1475c361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:40:52.761623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ba59c-b1bd-4615-97c3-6dde1475c361 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:52.761900 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ba59c-b1bd-4615-97c3-6dde1475c361 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:52.762172 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ba59c-b1bd-4615-97c3-6dde1475c361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:52.763770 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-1f6ba59c-b1bd-4615-97c3-6dde1475c361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:52.872276 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ba59c-b1bd-4615-97c3-6dde1475c361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:40:52.874273 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ba59c-b1bd-4615-97c3-6dde1475c361 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:40:52.891904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 727/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:55.104961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fdc3d-259f-436a-9252-8df16a2f1755 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:55.105595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fdc3d-259f-436a-9252-8df16a2f1755 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:55.105595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fdc3d-259f-436a-9252-8df16a2f1755 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:55.106832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 10:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:40:55.112602 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0438b46-7e01-472a-ad98-4afd69f9c6d3 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:55.113059 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0438b46-7e01-472a-ad98-4afd69f9c6d3 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:55.113163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0438b46-7e01-472a-ad98-4afd69f9c6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:55.179015 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-f0438b46-7e01-472a-ad98-4afd69f9c6d3 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:40:55.180230 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f0438b46-7e01-472a-ad98-4afd69f9c6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:55.219109 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:55.277157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 10:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:40:55.561869 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fdc3d-259f-436a-9252-8df16a2f1755 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:40:55.563433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-af6fdc3d-259f-436a-9252-8df16a2f1755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:55.664849 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fdc3d-259f-436a-9252-8df16a2f1755 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:40:55.704850 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:55.743212 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d6c22-5da6-43ef-a56a-8882031643f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:40:55.743818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d6c22-5da6-43ef-a56a-8882031643f7 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:55.744095 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d6c22-5da6-43ef-a56a-8882031643f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:55.744361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d6c22-5da6-43ef-a56a-8882031643f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:55.746237 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cd0d6c22-5da6-43ef-a56a-8882031643f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:55.850910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d6c22-5da6-43ef-a56a-8882031643f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:40:55.852313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d6c22-5da6-43ef-a56a-8882031643f7 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:40:55.869479 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 736/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:40:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:40:58.019574 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e44d7-2af7-49f8-b61e-25761c24e3c1 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:58.020112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e44d7-2af7-49f8-b61e-25761c24e3c1 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:58.020112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e44d7-2af7-49f8-b61e-25761c24e3c1 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:58.021415 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 10:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:40:58.026679 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58f59f-652e-437e-84b7-45a64699af7d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:58.027069 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58f59f-652e-437e-84b7-45a64699af7d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:58.027218 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58f59f-652e-437e-84b7-45a64699af7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:58.091739 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7c58f59f-652e-437e-84b7-45a64699af7d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:40:58.093775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7c58f59f-652e-437e-84b7-45a64699af7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:58.111507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:58.187846 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 10:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:40:58.480220 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e44d7-2af7-49f8-b61e-25761c24e3c1 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:40:58.481805 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-375e44d7-2af7-49f8-b61e-25761c24e3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:58.589771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e44d7-2af7-49f8-b61e-25761c24e3c1 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:40:58.656782 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:40:58.663977 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e17ab-6a3b-47c8-ad98-f102976b4d0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:40:58.664610 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e17ab-6a3b-47c8-ad98-f102976b4d0f service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:40:58.664896 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e17ab-6a3b-47c8-ad98-f102976b4d0f service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:40:58.665168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e17ab-6a3b-47c8-ad98-f102976b4d0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:40:58.666772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b87e17ab-6a3b-47c8-ad98-f102976b4d0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:40:58.775202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e17ab-6a3b-47c8-ad98-f102976b4d0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:40:58.776583 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e17ab-6a3b-47c8-ad98-f102976b4d0f service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:40:58.794770 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 730/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:41:00.957235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b4494-a35b-44fb-9a31-8d6ddab4b68b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:00.957808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b4494-a35b-44fb-9a31-8d6ddab4b68b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:00.957808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b4494-a35b-44fb-9a31-8d6ddab4b68b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:00.959217 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 10:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:41:00.964787 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bf278-270e-4d13-81c8-7a2398c09b54 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:00.965205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bf278-270e-4d13-81c8-7a2398c09b54 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:00.965314 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bf278-270e-4d13-81c8-7a2398c09b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:01.031098 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-4e9bf278-270e-4d13-81c8-7a2398c09b54 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:41:01.032283 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-4e9bf278-270e-4d13-81c8-7a2398c09b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:01.079567 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:41:01.126922 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 10:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:41:01.408074 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b4494-a35b-44fb-9a31-8d6ddab4b68b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:41:01.409734 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8d7b4494-a35b-44fb-9a31-8d6ddab4b68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:01.511261 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b4494-a35b-44fb-9a31-8d6ddab4b68b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:41:01.557784 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:41:01.582547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072fde9-aea7-4b50-9d50-126a98624ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:41:01.583142 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072fde9-aea7-4b50-9d50-126a98624ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:01.583415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072fde9-aea7-4b50-9d50-126a98624ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:01.583682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072fde9-aea7-4b50-9d50-126a98624ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:01.585287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3072fde9-aea7-4b50-9d50-126a98624ff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:01.691954 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072fde9-aea7-4b50-9d50-126a98624ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:41:01.693315 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072fde9-aea7-4b50-9d50-126a98624ff9 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:41:01.711235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 739/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:41:11.125433 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=22 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:41:11.708840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=66 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:41:21.515120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96443d-b3f3-4bda-8d6a-9d5c72900416 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:21.515693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96443d-b3f3-4bda-8d6a-9d5c72900416 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:21.515693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96443d-b3f3-4bda-8d6a-9d5c72900416 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:21.517090 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 732/1471] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:41:21.522238 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c4428-2141-4c70-aba8-e08d1c9d6f24 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:21.522634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c4428-2141-4c70-aba8-e08d1c9d6f24 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:21.522783 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c4428-2141-4c70-aba8-e08d1c9d6f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:21.587020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-366c4428-2141-4c70-aba8-e08d1c9d6f24 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:41:21.588217 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-366c4428-2141-4c70-aba8-e08d1c9d6f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:21.681633 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 740/1472] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:41:21.981017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341433e-123c-472a-82bc-d09e24c13bba None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:21.981300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341433e-123c-472a-82bc-d09e24c13bba None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:21.981612 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341433e-123c-472a-82bc-d09e24c13bba None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:21.983619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 733/1473] 10.222.0.20 () {54 vars in 966 bytes} [Sun Sep 11 10:41:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:41:21.988850 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e176fee-c358-4de4-9ce7-d9d246dddcde None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:21.989136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e176fee-c358-4de4-9ce7-d9d246dddcde None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:21.989404 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e176fee-c358-4de4-9ce7-d9d246dddcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:22.066141 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-0e176fee-c358-4de4-9ce7-d9d246dddcde None None] MFA Rules not processed for user `28614526d50d4201b93b20df45465d32`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:41:22.067349 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0e176fee-c358-4de4-9ce7-d9d246dddcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:22.087465 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:41:22.141940 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 741/1474] 10.222.0.20 () {58 vars in 1063 bytes} [Sun Sep 11 10:41:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:41:22.149735 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341433e-123c-472a-82bc-d09e24c13bba None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:41:22.151237 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d341433e-123c-472a-82bc-d09e24c13bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:22.253450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341433e-123c-472a-82bc-d09e24c13bba None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:41:22.325855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f690e7-4406-4253-b4ea-badb5094747c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28614526d50d4201b93b20df45465d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:41:22.326407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f690e7-4406-4253-b4ea-badb5094747c service glance] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:22.326682 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f690e7-4406-4253-b4ea-badb5094747c service glance] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:22.326951 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f690e7-4406-4253-b4ea-badb5094747c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:22.328529 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-07f690e7-4406-4253-b4ea-badb5094747c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:22.381330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:41:22.434694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f690e7-4406-4253-b4ea-badb5094747c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:41:22.436740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f690e7-4406-4253-b4ea-badb5094747c service glance] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:41:22.454835 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 734/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:41:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:41:24.677115 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b9644-0cc2-4ec6-8e30-164cfda89d45 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:24.677685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b9644-0cc2-4ec6-8e30-164cfda89d45 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:24.677685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b9644-0cc2-4ec6-8e30-164cfda89d45 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:24.679130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 742/1476] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:41:24.684374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1517e2b-a484-48d1-8478-9e8cd2024355 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:24.684877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1517e2b-a484-48d1-8478-9e8cd2024355 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:24.684984 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1517e2b-a484-48d1-8478-9e8cd2024355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:24.868194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e1517e2b-a484-48d1-8478-9e8cd2024355 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:41:24.869733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e1517e2b-a484-48d1-8478-9e8cd2024355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:24.966415 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 735/1477] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:41:25.251748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b9644-0cc2-4ec6-8e30-164cfda89d45 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:41:25.254283 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e02b9644-0cc2-4ec6-8e30-164cfda89d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:25.397440 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b9644-0cc2-4ec6-8e30-164cfda89d45 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:41:25.445773 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:41:25.489730 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638352e0-7c9f-4042-8896-6e4787ee6b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:41:25.490330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638352e0-7c9f-4042-8896-6e4787ee6b9f admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:25.490611 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638352e0-7c9f-4042-8896-6e4787ee6b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:25.490882 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638352e0-7c9f-4042-8896-6e4787ee6b9f admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:25.491517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638352e0-7c9f-4042-8896-6e4787ee6b9f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:41:25.493293 dv-cinder-856460-3-smb devstack@keystone.service[88077]: WARNING py.warnings [None req-638352e0-7c9f-4042-8896-6e4787ee6b9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 10:41:25.493293 dv-cinder-856460-3-smb devstack@keystone.service[88077]: warnings.warn(msg) Sep 11 10:41:25.493293 dv-cinder-856460-3-smb devstack@keystone.service[88077]: Sep 11 10:41:25.494424 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638352e0-7c9f-4042-8896-6e4787ee6b9f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:41:25.514304 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 743/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 10:41:25 2022] GET /identity/v3/projects => generated 2553 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:41:27.741031 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044234ef-be75-4a34-b4ba-b2a6947cf42a None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:27.741651 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044234ef-be75-4a34-b4ba-b2a6947cf42a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:27.741651 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044234ef-be75-4a34-b4ba-b2a6947cf42a None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:27.743204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 736/1479] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:41:27.749573 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb4c5e-3539-415f-ae8b-4a1fdb06446e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:27.750073 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb4c5e-3539-415f-ae8b-4a1fdb06446e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:27.750182 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb4c5e-3539-415f-ae8b-4a1fdb06446e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:27.815367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-cbcb4c5e-3539-415f-ae8b-4a1fdb06446e None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:41:27.816587 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cbcb4c5e-3539-415f-ae8b-4a1fdb06446e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:27.910487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 744/1480] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:41:28.212918 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044234ef-be75-4a34-b4ba-b2a6947cf42a None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:41:28.214471 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-044234ef-be75-4a34-b4ba-b2a6947cf42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:28.225653 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:41:28.361775 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044234ef-be75-4a34-b4ba-b2a6947cf42a None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:41:28.440650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:41:28.473076 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792dcf6-a7bf-4843-a802-3fb1bbfdc523 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:41:28.473604 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792dcf6-a7bf-4843-a802-3fb1bbfdc523 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:28.473879 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792dcf6-a7bf-4843-a802-3fb1bbfdc523 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:28.474149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792dcf6-a7bf-4843-a802-3fb1bbfdc523 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:28.475723 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-1792dcf6-a7bf-4843-a802-3fb1bbfdc523 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:28.563488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792dcf6-a7bf-4843-a802-3fb1bbfdc523 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:41:28.565082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792dcf6-a7bf-4843-a802-3fb1bbfdc523 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:41:28.582539 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 737/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:41:30.921618 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542f14d-3156-4717-a582-367b8135e42c None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:30.922086 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542f14d-3156-4717-a582-367b8135e42c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:30.922189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542f14d-3156-4717-a582-367b8135e42c None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:30.923510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 745/1482] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:41:30.928730 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fead5-1341-4445-ac8f-162cd412831c None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:30.929174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fead5-1341-4445-ac8f-162cd412831c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:30.929291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fead5-1341-4445-ac8f-162cd412831c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:30.993989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-293fead5-1341-4445-ac8f-162cd412831c None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:41:30.995102 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-293fead5-1341-4445-ac8f-162cd412831c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:31.039048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:41:31.088012 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 738/1483] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:41:31.375628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542f14d-3156-4717-a582-367b8135e42c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:41:31.377189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5542f14d-3156-4717-a582-367b8135e42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:31.400757 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:41:31.479793 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542f14d-3156-4717-a582-367b8135e42c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:41:31.551384 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b5cf8-9627-45f4-ac0a-885336a664c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:41:31.551985 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b5cf8-9627-45f4-ac0a-885336a664c0 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:31.552267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b5cf8-9627-45f4-ac0a-885336a664c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:31.552540 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b5cf8-9627-45f4-ac0a-885336a664c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:31.554170 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4c3b5cf8-9627-45f4-ac0a-885336a664c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:31.631715 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:41:31.666128 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b5cf8-9627-45f4-ac0a-885336a664c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:41:31.667546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b5cf8-9627-45f4-ac0a-885336a664c0 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:41:31.685621 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 746/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:41:33.901123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0da082-437c-4ed7-bb83-f05091c5c06f None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:33.901676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0da082-437c-4ed7-bb83-f05091c5c06f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:33.901676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0da082-437c-4ed7-bb83-f05091c5c06f None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:33.903568 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 739/1485] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:41:33.908951 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11178bbf-3644-440f-89b0-7912551b2eb9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:33.909478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11178bbf-3644-440f-89b0-7912551b2eb9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:33.909478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11178bbf-3644-440f-89b0-7912551b2eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:33.974857 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-11178bbf-3644-440f-89b0-7912551b2eb9 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:41:33.975990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-11178bbf-3644-440f-89b0-7912551b2eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:34.069565 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 747/1486] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:41:34.363314 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0da082-437c-4ed7-bb83-f05091c5c06f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:41:34.364879 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-4e0da082-437c-4ed7-bb83-f05091c5c06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:34.467130 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0da082-437c-4ed7-bb83-f05091c5c06f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:41:34.537069 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:41:34.538615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed0710-d52c-47a2-b318-24ab5228e187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:41:34.539429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed0710-d52c-47a2-b318-24ab5228e187 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:34.539921 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed0710-d52c-47a2-b318-24ab5228e187 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:34.540252 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed0710-d52c-47a2-b318-24ab5228e187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:34.542292 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e9ed0710-d52c-47a2-b318-24ab5228e187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:34.648328 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed0710-d52c-47a2-b318-24ab5228e187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:41:34.649738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed0710-d52c-47a2-b318-24ab5228e187 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:41:34.667449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 740/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:41:37.018419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542348cb-f3a0-4450-967d-cee4fd74fbe9 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:37.018949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542348cb-f3a0-4450-967d-cee4fd74fbe9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:37.018949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542348cb-f3a0-4450-967d-cee4fd74fbe9 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:37.020231 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 748/1488] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:41:37.025465 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ede4a-5da9-4446-95af-05cca335a0f4 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:37.025859 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ede4a-5da9-4446-95af-05cca335a0f4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:37.026014 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ede4a-5da9-4446-95af-05cca335a0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:37.091786 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-086ede4a-5da9-4446-95af-05cca335a0f4 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:41:37.093248 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-086ede4a-5da9-4446-95af-05cca335a0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:37.143422 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:41:37.188905 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 741/1489] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:41:37.478969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542348cb-f3a0-4450-967d-cee4fd74fbe9 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:41:37.480538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-542348cb-f3a0-4450-967d-cee4fd74fbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:37.516139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:41:37.581818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542348cb-f3a0-4450-967d-cee4fd74fbe9 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:41:37.653860 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9681d7b-c2ed-47fd-a13f-7cde4d64748d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:41:37.654387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9681d7b-c2ed-47fd-a13f-7cde4d64748d service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:37.654662 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9681d7b-c2ed-47fd-a13f-7cde4d64748d service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:37.654932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9681d7b-c2ed-47fd-a13f-7cde4d64748d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:37.656504 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b9681d7b-c2ed-47fd-a13f-7cde4d64748d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:37.737259 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:41:37.765684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9681d7b-c2ed-47fd-a13f-7cde4d64748d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:41:37.767298 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9681d7b-c2ed-47fd-a13f-7cde4d64748d service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:41:37.785380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 749/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:41:40.135486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae6853-9e30-42f2-8221-98101e1bbba2 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:40.136043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae6853-9e30-42f2-8221-98101e1bbba2 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:40.136139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae6853-9e30-42f2-8221-98101e1bbba2 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:40.138062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 742/1491] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 10:41:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:41:40.144681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d41d80-5ab3-4a7a-886a-36a0efcd31f0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:40.145075 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d41d80-5ab3-4a7a-886a-36a0efcd31f0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:40.145228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d41d80-5ab3-4a7a-886a-36a0efcd31f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:40.210155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-22d41d80-5ab3-4a7a-886a-36a0efcd31f0 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:41:40.211347 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-22d41d80-5ab3-4a7a-886a-36a0efcd31f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:40.306257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 750/1492] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 10:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:41:40.596825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae6853-9e30-42f2-8221-98101e1bbba2 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:41:40.598368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-62ae6853-9e30-42f2-8221-98101e1bbba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:40.699975 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae6853-9e30-42f2-8221-98101e1bbba2 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:41:40.774534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275aadc4-e49d-45a2-95e0-7611091779c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:41:40.775152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275aadc4-e49d-45a2-95e0-7611091779c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:41:40.775434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275aadc4-e49d-45a2-95e0-7611091779c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:41:40.775703 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275aadc4-e49d-45a2-95e0-7611091779c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:41:40.777566 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-275aadc4-e49d-45a2-95e0-7611091779c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:41:40.786651 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:41:40.884148 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275aadc4-e49d-45a2-95e0-7611091779c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:41:40.885528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275aadc4-e49d-45a2-95e0-7611091779c4 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:41:40.904306 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 743/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:41:50.304761 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=82 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:41:50.901106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=50 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:43:00.043132 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd08341-94d0-46d2-a961-fd9ffe4839d1 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:43:00.043696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd08341-94d0-46d2-a961-fd9ffe4839d1 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:43:00.043696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd08341-94d0-46d2-a961-fd9ffe4839d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:43:00.118064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-8dd08341-94d0-46d2-a961-fd9ffe4839d1 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:43:00.119287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8dd08341-94d0-46d2-a961-fd9ffe4839d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:43:00.218982 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 751/1494] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:43:00.227115 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762aa0f-5709-4337-a372-68e2df4ed195 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:43:00.227595 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762aa0f-5709-4337-a372-68e2df4ed195 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:43:00.227693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762aa0f-5709-4337-a372-68e2df4ed195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:43:00.306641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-7762aa0f-5709-4337-a372-68e2df4ed195 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:43:00.307855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7762aa0f-5709-4337-a372-68e2df4ed195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:43:00.406516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 744/1495] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:43:00.411254 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd08341-94d0-46d2-a961-fd9ffe4839d1 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:43:00.412453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8dd08341-94d0-46d2-a961-fd9ffe4839d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:43:00.424152 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd08341-94d0-46d2-a961-fd9ffe4839d1 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:43:00.484992 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:43:00.519451 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b9a1a-28f0-47a6-a407-ea4e312327bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:43:00.520056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b9a1a-28f0-47a6-a407-ea4e312327bb admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:43:00.520334 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b9a1a-28f0-47a6-a407-ea4e312327bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:43:00.520634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b9a1a-28f0-47a6-a407-ea4e312327bb admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:43:00.521276 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b9a1a-28f0-47a6-a407-ea4e312327bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:43:00.521579 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b9a1a-28f0-47a6-a407-ea4e312327bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:43:00.522584 dv-cinder-856460-3-smb devstack@keystone.service[88077]: WARNING py.warnings [None req-841b9a1a-28f0-47a6-a407-ea4e312327bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 10:43:00.522584 dv-cinder-856460-3-smb devstack@keystone.service[88077]: warnings.warn(msg) Sep 11 10:43:00.522584 dv-cinder-856460-3-smb devstack@keystone.service[88077]: Sep 11 10:43:00.523461 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b9a1a-28f0-47a6-a407-ea4e312327bb admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:43:00.535020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 752/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:43:00.543374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762aa0f-5709-4337-a372-68e2df4ed195 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:43:00.552420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762aa0f-5709-4337-a372-68e2df4ed195 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:43:00.612677 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:43:00.646212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c381e8e-08bd-4243-b87b-4424fca6ad05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:43:00.646808 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c381e8e-08bd-4243-b87b-4424fca6ad05 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:43:00.647085 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c381e8e-08bd-4243-b87b-4424fca6ad05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:43:00.647362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c381e8e-08bd-4243-b87b-4424fca6ad05 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:43:00.647981 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c381e8e-08bd-4243-b87b-4424fca6ad05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:43:00.650299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: WARNING py.warnings [None req-9c381e8e-08bd-4243-b87b-4424fca6ad05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 10:43:00.650299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: warnings.warn(msg) Sep 11 10:43:00.650299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: Sep 11 10:43:00.651453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c381e8e-08bd-4243-b87b-4424fca6ad05 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:43:00.706069 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 745/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:43:00 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:43:00.710342 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b9a1a-28f0-47a6-a407-ea4e312327bb admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:43:00.712472 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-841b9a1a-28f0-47a6-a407-ea4e312327bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:43:00.745596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b9a1a-28f0-47a6-a407-ea4e312327bb admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:43:00.835449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f6444-e6bf-46d9-9bac-5614add454c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:43:00.836049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f6444-e6bf-46d9-9bac-5614add454c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:43:00.836332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f6444-e6bf-46d9-9bac-5614add454c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:43:00.836647 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f6444-e6bf-46d9-9bac-5614add454c9 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:43:00.837285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f6444-e6bf-46d9-9bac-5614add454c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:43:00.838625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: WARNING py.warnings [None req-c14f6444-e6bf-46d9-9bac-5614add454c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 10:43:00.838625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: warnings.warn(msg) Sep 11 10:43:00.838625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: Sep 11 10:43:00.839811 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f6444-e6bf-46d9-9bac-5614add454c9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:43:00.887436 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 753/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:43:00 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:43:00.896018 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c381e8e-08bd-4243-b87b-4424fca6ad05 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:43:00.897587 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9c381e8e-08bd-4243-b87b-4424fca6ad05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:43:00.960526 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c381e8e-08bd-4243-b87b-4424fca6ad05 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:43:01.044950 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:43:01.056436 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5c8c4-ced0-479b-81ce-a6075903ff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:43:01.057074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5c8c4-ced0-479b-81ce-a6075903ff85 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:43:01.057356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5c8c4-ced0-479b-81ce-a6075903ff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:43:01.057629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5c8c4-ced0-479b-81ce-a6075903ff85 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:43:01.058272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5c8c4-ced0-479b-81ce-a6075903ff85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:43:01.059279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: WARNING py.warnings [None req-d0c5c8c4-ced0-479b-81ce-a6075903ff85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 10:43:01.059279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: warnings.warn(msg) Sep 11 10:43:01.059279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: Sep 11 10:43:01.060151 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5c8c4-ced0-479b-81ce-a6075903ff85 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:43:01.072895 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 746/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:43:01.077054 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f6444-e6bf-46d9-9bac-5614add454c9 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:43:01.078561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c14f6444-e6bf-46d9-9bac-5614add454c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:43:01.089892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f6444-e6bf-46d9-9bac-5614add454c9 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:43:01.114873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:43:01.194904 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab0763-21f7-499a-ad64-74603b2bf6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:43:01.195960 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab0763-21f7-499a-ad64-74603b2bf6dd admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:43:01.196405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab0763-21f7-499a-ad64-74603b2bf6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:43:01.196830 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab0763-21f7-499a-ad64-74603b2bf6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:43:01.197497 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab0763-21f7-499a-ad64-74603b2bf6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:43:01.198539 dv-cinder-856460-3-smb devstack@keystone.service[88077]: WARNING py.warnings [None req-2fab0763-21f7-499a-ad64-74603b2bf6dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 10:43:01.198539 dv-cinder-856460-3-smb devstack@keystone.service[88077]: warnings.warn(msg) Sep 11 10:43:01.198539 dv-cinder-856460-3-smb devstack@keystone.service[88077]: Sep 11 10:43:01.199433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab0763-21f7-499a-ad64-74603b2bf6dd admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:43:01.212983 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 754/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 10:43:01.217460 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5c8c4-ced0-479b-81ce-a6075903ff85 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:43:01.218982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d0c5c8c4-ced0-479b-81ce-a6075903ff85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:43:01.254883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5c8c4-ced0-479b-81ce-a6075903ff85 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:43:01.348408 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199baacb-49be-43c7-b25d-22df7d275b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:43:01.349104 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199baacb-49be-43c7-b25d-22df7d275b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:43:01.349384 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199baacb-49be-43c7-b25d-22df7d275b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:43:01.349657 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199baacb-49be-43c7-b25d-22df7d275b6d admin admin] PATH_INFO: `/v3/projects/c42ee72727004f6496b03a47e4941ddc/users/944f28d85ae246c5bb46815322adef22/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:43:01.372991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199baacb-49be-43c7-b25d-22df7d275b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42ee72727004f6496b03a47e4941ddc, user_id=944f28d85ae246c5bb46815322adef22, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:43:01.374024 dv-cinder-856460-3-smb devstack@keystone.service[88076]: WARNING py.warnings [None req-199baacb-49be-43c7-b25d-22df7d275b6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 10:43:01.374024 dv-cinder-856460-3-smb devstack@keystone.service[88076]: warnings.warn(msg) Sep 11 10:43:01.374024 dv-cinder-856460-3-smb devstack@keystone.service[88076]: Sep 11 10:43:01.375955 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199baacb-49be-43c7-b25d-22df7d275b6d admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:43:01.399778 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 747/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:43:01 2022] PUT /identity/v3/projects/c42ee72727004f6496b03a47e4941ddc/users/944f28d85ae246c5bb46815322adef22/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:43:01.411894 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaed217-8da3-4e18-8981-7297e1b78542 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:43:01.412184 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaed217-8da3-4e18-8981-7297e1b78542 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:43:01.412459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaed217-8da3-4e18-8981-7297e1b78542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:43:01.469357 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3eaed217-8da3-4e18-8981-7297e1b78542 None None] MFA Rules not processed for user `944f28d85ae246c5bb46815322adef22`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:43:01.470577 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3eaed217-8da3-4e18-8981-7297e1b78542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:43:01.552722 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 755/1502] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:43:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:43:01.565897 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7644e0c-df13-4a9d-a090-4d80adcbd58f None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:43:01.566184 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7644e0c-df13-4a9d-a090-4d80adcbd58f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:43:01.566461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7644e0c-df13-4a9d-a090-4d80adcbd58f None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:43:01.567803 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 748/1503] 10.222.0.20 () {54 vars in 964 bytes} [Sun Sep 11 10:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:43:01.572513 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca54ed-bfb1-4949-aa86-604038902ddc None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:43:01.572832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca54ed-bfb1-4949-aa86-604038902ddc None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:43:01.573106 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca54ed-bfb1-4949-aa86-604038902ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:43:01.604843 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:43:01.647970 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-29ca54ed-bfb1-4949-aa86-604038902ddc None None] MFA Rules not processed for user `caa0d9fe3d4942be8901876e57d1e561`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:43:01.649696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-29ca54ed-bfb1-4949-aa86-604038902ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:43:01.722507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 756/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Sun Sep 11 10:43:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:43:01.731090 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7644e0c-df13-4a9d-a090-4d80adcbd58f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:43:01.732646 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a7644e0c-df13-4a9d-a090-4d80adcbd58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:43:01.781648 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:43:01.835528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7644e0c-df13-4a9d-a090-4d80adcbd58f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:43:01.908834 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8d9a5-8268-4eb9-81fd-c4ed577170a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:43:01.909355 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8d9a5-8268-4eb9-81fd-c4ed577170a3 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:43:01.909629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8d9a5-8268-4eb9-81fd-c4ed577170a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:43:01.909897 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8d9a5-8268-4eb9-81fd-c4ed577170a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:43:01.911457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-40e8d9a5-8268-4eb9-81fd-c4ed577170a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:43:02.010206 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8d9a5-8268-4eb9-81fd-c4ed577170a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:43:02.011620 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8d9a5-8268-4eb9-81fd-c4ed577170a3 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:43:02.015061 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:43:02.029824 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 749/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:43:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:43:02.074964 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388143f-582d-4d3a-b91b-f3d19128a952 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:43:02.075249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388143f-582d-4d3a-b91b-f3d19128a952 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:43:02.075521 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388143f-582d-4d3a-b91b-f3d19128a952 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:43:02.079178 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 757/1506] 10.222.0.20 () {52 vars in 830 bytes} [Sun Sep 11 10:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:43:02.080413 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8d9a5-8268-4eb9-81fd-c4ed577170a3 service cinder] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:43:02.081676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-40e8d9a5-8268-4eb9-81fd-c4ed577170a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:43:02.181249 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8d9a5-8268-4eb9-81fd-c4ed577170a3 service cinder] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:43:02.277650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7691a-0feb-4c8d-b144-b3e21bf28bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:43:02.278309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7691a-0feb-4c8d-b144-b3e21bf28bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:43:02.278550 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7691a-0feb-4c8d-b144-b3e21bf28bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:43:02.278825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7691a-0feb-4c8d-b144-b3e21bf28bb6 admin admin] PATH_INFO: `/v3/users/944f28d85ae246c5bb46815322adef22` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:43:02.292244 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7691a-0feb-4c8d-b144-b3e21bf28bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=944f28d85ae246c5bb46815322adef22)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:43:02.293319 dv-cinder-856460-3-smb devstack@keystone.service[88076]: WARNING py.warnings [None req-9bc7691a-0feb-4c8d-b144-b3e21bf28bb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 10:43:02.293319 dv-cinder-856460-3-smb devstack@keystone.service[88076]: warnings.warn(msg) Sep 11 10:43:02.293319 dv-cinder-856460-3-smb devstack@keystone.service[88076]: Sep 11 10:43:02.294519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7691a-0feb-4c8d-b144-b3e21bf28bb6 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:43:02.304207 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:43:02.359474 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9bc7691a-0feb-4c8d-b144-b3e21bf28bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '944f28d85ae246c5bb46815322adef22'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:43:02.368910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9bc7691a-0feb-4c8d-b144-b3e21bf28bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '944f28d85ae246c5bb46815322adef22'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:43:02.369332 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9bc7691a-0feb-4c8d-b144-b3e21bf28bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '944f28d85ae246c5bb46815322adef22'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:43:02.369824 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9bc7691a-0feb-4c8d-b144-b3e21bf28bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '944f28d85ae246c5bb46815322adef22'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:43:02.383666 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9bc7691a-0feb-4c8d-b144-b3e21bf28bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '944f28d85ae246c5bb46815322adef22'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:43:02.411005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 750/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:43:02 2022] DELETE /identity/v3/users/944f28d85ae246c5bb46815322adef22 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:43:02.415959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121b219-b36b-46b3-b558-a0645a4e24d1 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:43:02.416248 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121b219-b36b-46b3-b558-a0645a4e24d1 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:43:02.416525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121b219-b36b-46b3-b558-a0645a4e24d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:43:02.472128 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4121b219-b36b-46b3-b558-a0645a4e24d1 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:43:02.473298 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4121b219-b36b-46b3-b558-a0645a4e24d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:43:02.547360 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:43:02.560213 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 758/1508] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:43:02.569771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7691a-0feb-4c8d-b144-b3e21bf28bb6 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:43:02.571585 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9bc7691a-0feb-4c8d-b144-b3e21bf28bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:43:02.673142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7691a-0feb-4c8d-b144-b3e21bf28bb6 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:43:02.731096 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:43:02.751739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682d5ba-2532-4f24-a3d8-f91ed1abe5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:43:02.752356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d5ba-2532-4f24-a3d8-f91ed1abe5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:43:02.752668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d5ba-2532-4f24-a3d8-f91ed1abe5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:43:02.752941 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d5ba-2532-4f24-a3d8-f91ed1abe5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:43:02.754568 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-4682d5ba-2532-4f24-a3d8-f91ed1abe5d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:43:02.860902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682d5ba-2532-4f24-a3d8-f91ed1abe5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:43:02.862357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682d5ba-2532-4f24-a3d8-f91ed1abe5d0 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:43:02.882142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 751/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:43:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:43:03.211173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121b219-b36b-46b3-b558-a0645a4e24d1 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:43:03.213090 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4121b219-b36b-46b3-b558-a0645a4e24d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:43:03.227832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121b219-b36b-46b3-b558-a0645a4e24d1 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:43:03.330669 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad34ac-df75-4a1f-b8a5-ae697d9ecc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:43:03.331302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad34ac-df75-4a1f-b8a5-ae697d9ecc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:43:03.331578 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad34ac-df75-4a1f-b8a5-ae697d9ecc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:43:03.331845 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad34ac-df75-4a1f-b8a5-ae697d9ecc29 admin admin] PATH_INFO: `/v3/projects/c42ee72727004f6496b03a47e4941ddc` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:43:03.342659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad34ac-df75-4a1f-b8a5-ae697d9ecc29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42ee72727004f6496b03a47e4941ddc)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:43:03.343681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: WARNING py.warnings [None req-2aad34ac-df75-4a1f-b8a5-ae697d9ecc29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 10:43:03.343681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: warnings.warn(msg) Sep 11 10:43:03.343681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: Sep 11 10:43:03.344911 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad34ac-df75-4a1f-b8a5-ae697d9ecc29 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:43:03.402312 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2aad34ac-df75-4a1f-b8a5-ae697d9ecc29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42ee72727004f6496b03a47e4941ddc', 'request_id': 'req-2aad34ac-df75-4a1f-b8a5-ae697d9ecc29'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:43:03.416567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2aad34ac-df75-4a1f-b8a5-ae697d9ecc29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42ee72727004f6496b03a47e4941ddc', 'request_id': 'req-2aad34ac-df75-4a1f-b8a5-ae697d9ecc29'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:43:03.425877 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2aad34ac-df75-4a1f-b8a5-ae697d9ecc29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42ee72727004f6496b03a47e4941ddc', 'request_id': 'req-2aad34ac-df75-4a1f-b8a5-ae697d9ecc29'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:43:03.448640 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2aad34ac-df75-4a1f-b8a5-ae697d9ecc29 admin admin] The token cache is being invalidate because project c42ee72727004f6496b03a47e4941ddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:43:03.448945 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2aad34ac-df75-4a1f-b8a5-ae697d9ecc29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:43:03.449484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2aad34ac-df75-4a1f-b8a5-ae697d9ecc29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:43:03.450887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 759/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:43:03 2022] DELETE /identity/v3/projects/c42ee72727004f6496b03a47e4941ddc => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:43:12.879554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=62 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:43:13.446151 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:44:34.232868 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c97c2-ac78-4a72-891d-ba954b900ab3 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:34.233487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c97c2-ac78-4a72-891d-ba954b900ab3 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:34.233487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c97c2-ac78-4a72-891d-ba954b900ab3 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:34.234796 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 10:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:44:34.239579 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd365f-0835-43ec-8898-ff1497658bf7 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:34.240061 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd365f-0835-43ec-8898-ff1497658bf7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:34.240254 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd365f-0835-43ec-8898-ff1497658bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:34.321715 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b4bd365f-0835-43ec-8898-ff1497658bf7 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:44:34.323121 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b4bd365f-0835-43ec-8898-ff1497658bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:44:34.425491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 10:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:44:34.580796 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c97c2-ac78-4a72-891d-ba954b900ab3 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:44:34.582892 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6d9c97c2-ac78-4a72-891d-ba954b900ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:44:34.699557 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c97c2-ac78-4a72-891d-ba954b900ab3 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:44:34.704914 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff4b21-f3d9-48e1-8dcf-7f7fb541d59b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:44:34.705518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff4b21-f3d9-48e1-8dcf-7f7fb541d59b service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:34.705793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff4b21-f3d9-48e1-8dcf-7f7fb541d59b service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:34.706062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff4b21-f3d9-48e1-8dcf-7f7fb541d59b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:34.715993 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff4b21-f3d9-48e1-8dcf-7f7fb541d59b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:44:34.717631 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff4b21-f3d9-48e1-8dcf-7f7fb541d59b service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:44:34.727112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 753/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:44:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:44:35.804943 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9324968-ef65-4636-a5e7-8223c45d49be None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:35.805447 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9324968-ef65-4636-a5e7-8223c45d49be None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:35.805564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9324968-ef65-4636-a5e7-8223c45d49be None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:35.806840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 10:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:44:35.813175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f8968-af6d-4b15-b203-8f7e1ccc14a5 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:35.813680 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f8968-af6d-4b15-b203-8f7e1ccc14a5 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:35.813784 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f8968-af6d-4b15-b203-8f7e1ccc14a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:35.833383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-ca3f8968-af6d-4b15-b203-8f7e1ccc14a5 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:44:35.834570 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ca3f8968-af6d-4b15-b203-8f7e1ccc14a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:44:35.843129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 10:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:44:35.994474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9324968-ef65-4636-a5e7-8223c45d49be None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:44:36.009034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9324968-ef65-4636-a5e7-8223c45d49be None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:44:36.014362 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2099c1-942f-4a84-90fb-69ee9040286b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:44:36.014963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2099c1-942f-4a84-90fb-69ee9040286b service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:36.015239 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2099c1-942f-4a84-90fb-69ee9040286b service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:36.015512 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2099c1-942f-4a84-90fb-69ee9040286b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:36.023290 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2099c1-942f-4a84-90fb-69ee9040286b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:44:36.024880 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2099c1-942f-4a84-90fb-69ee9040286b service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:44:36.034094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 762/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:44:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:44:36.231439 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7f2f2-0f11-4c33-9256-9de936a2fa17 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:36.231706 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7f2f2-0f11-4c33-9256-9de936a2fa17 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:36.231978 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7f2f2-0f11-4c33-9256-9de936a2fa17 None None] PATH_INFO: `/v3` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:36.233296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 755/1517] 10.222.0.23 () {54 vars in 925 bytes} [Sun Sep 11 10:44:36 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:44:36.241555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cb282-0c07-49d6-81fb-5b0517497b97 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:36.241879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cb282-0c07-49d6-81fb-5b0517497b97 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:36.242198 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cb282-0c07-49d6-81fb-5b0517497b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:36.300573 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f38cb282-0c07-49d6-81fb-5b0517497b97 None None] MFA Rules not processed for user `7f0211a05cca4e72b30d64eef4ba527c`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:44:36.301696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f38cb282-0c07-49d6-81fb-5b0517497b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:44:36.318488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:44:36.371844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 763/1518] 10.222.0.23 () {58 vars in 1015 bytes} [Sun Sep 11 10:44:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:44:39.875613 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9d944-9583-4064-9aba-897088d48b2e None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:39.876066 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9d944-9583-4064-9aba-897088d48b2e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:39.876171 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9d944-9583-4064-9aba-897088d48b2e None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:39.877545 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 756/1519] 10.222.0.20 () {54 vars in 961 bytes} [Sun Sep 11 10:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:44:39.882528 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635fcba-d8a9-42d3-848f-3fd5ce1dabbc None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:39.882981 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635fcba-d8a9-42d3-848f-3fd5ce1dabbc None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:39.883081 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635fcba-d8a9-42d3-848f-3fd5ce1dabbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:39.904243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a635fcba-d8a9-42d3-848f-3fd5ce1dabbc None None] MFA Rules not processed for user `7f0211a05cca4e72b30d64eef4ba527c`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:44:39.905656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a635fcba-d8a9-42d3-848f-3fd5ce1dabbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:44:39.915632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 764/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Sun Sep 11 10:44:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:44:39.923212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9d944-9583-4064-9aba-897088d48b2e None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:44:39.936339 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9d944-9583-4064-9aba-897088d48b2e None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:44:39.941314 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2960307-2d20-4288-b9be-045ad5fd34b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0211a05cca4e72b30d64eef4ba527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:44:39.941899 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2960307-2d20-4288-b9be-045ad5fd34b0 service placement] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:39.942204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2960307-2d20-4288-b9be-045ad5fd34b0 service placement] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:39.942473 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2960307-2d20-4288-b9be-045ad5fd34b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:39.950697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2960307-2d20-4288-b9be-045ad5fd34b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:44:39.952252 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2960307-2d20-4288-b9be-045ad5fd34b0 service placement] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:44:39.962159 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 757/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:44:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:44:47.504947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d045bad-2d93-4df5-b5c6-2d7e171a89a5 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:47.505552 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d045bad-2d93-4df5-b5c6-2d7e171a89a5 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:47.505552 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d045bad-2d93-4df5-b5c6-2d7e171a89a5 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:47.507373 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 10:44:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:44:47.513528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a67e09-303b-42b4-a283-60f4f059f22e None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:47.513967 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a67e09-303b-42b4-a283-60f4f059f22e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:47.514112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a67e09-303b-42b4-a283-60f4f059f22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:47.533949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-20a67e09-303b-42b4-a283-60f4f059f22e None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:44:47.535137 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-20a67e09-303b-42b4-a283-60f4f059f22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:44:47.542881 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 10:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:44:47.695600 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d045bad-2d93-4df5-b5c6-2d7e171a89a5 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:44:47.710706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d045bad-2d93-4df5-b5c6-2d7e171a89a5 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:44:47.716642 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde39a89-f818-488c-b620-3f6309c99097 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:44:47.717239 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde39a89-f818-488c-b620-3f6309c99097 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:47.717514 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde39a89-f818-488c-b620-3f6309c99097 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:47.717781 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde39a89-f818-488c-b620-3f6309c99097 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:47.726124 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde39a89-f818-488c-b620-3f6309c99097 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:44:47.727678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde39a89-f818-488c-b620-3f6309c99097 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:44:47.736779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 766/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:44:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:44:48.819102 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5cabd-7bfe-480e-b0fd-004cf310d084 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:48.819673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5cabd-7bfe-480e-b0fd-004cf310d084 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:48.819673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5cabd-7bfe-480e-b0fd-004cf310d084 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:48.821063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 10:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:44:48.827301 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc504b6c-64a0-4335-ae65-f40b3f907b0d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:48.827738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc504b6c-64a0-4335-ae65-f40b3f907b0d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:48.827851 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc504b6c-64a0-4335-ae65-f40b3f907b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:48.847694 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-fc504b6c-64a0-4335-ae65-f40b3f907b0d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:44:48.848935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fc504b6c-64a0-4335-ae65-f40b3f907b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:44:48.857427 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 10:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:44:49.009380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5cabd-7bfe-480e-b0fd-004cf310d084 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:44:49.024059 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5cabd-7bfe-480e-b0fd-004cf310d084 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:44:49.029404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34170804-dda7-464c-86a2-79ed979d34c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:44:49.029991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34170804-dda7-464c-86a2-79ed979d34c9 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:49.030271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34170804-dda7-464c-86a2-79ed979d34c9 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:49.030545 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34170804-dda7-464c-86a2-79ed979d34c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:49.038432 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34170804-dda7-464c-86a2-79ed979d34c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:44:49.039987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34170804-dda7-464c-86a2-79ed979d34c9 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:44:49.049403 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 760/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:44:53.017249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a337d1-0322-419a-9d9d-6c3a5f8c1dab None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:53.017698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a337d1-0322-419a-9d9d-6c3a5f8c1dab None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:53.017825 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a337d1-0322-419a-9d9d-6c3a5f8c1dab None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:53.019222 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 10:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:44:53.024897 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f0b6f-78a6-4869-95c3-c153ab6665b4 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:53.025323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f0b6f-78a6-4869-95c3-c153ab6665b4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:53.025419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f0b6f-78a6-4869-95c3-c153ab6665b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:53.044278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-2f2f0b6f-78a6-4869-95c3-c153ab6665b4 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:44:53.045496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2f2f0b6f-78a6-4869-95c3-c153ab6665b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:44:53.053162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 10:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:44:53.350760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a337d1-0322-419a-9d9d-6c3a5f8c1dab None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:44:53.352481 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b1a337d1-0322-419a-9d9d-6c3a5f8c1dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:44:53.430852 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a337d1-0322-419a-9d9d-6c3a5f8c1dab None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:44:53.434327 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c2a84-6bc5-452c-ba76-936e6bb6ab1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:44:53.434921 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c2a84-6bc5-452c-ba76-936e6bb6ab1a service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:53.435195 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c2a84-6bc5-452c-ba76-936e6bb6ab1a service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:53.435465 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c2a84-6bc5-452c-ba76-936e6bb6ab1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:53.445195 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c2a84-6bc5-452c-ba76-936e6bb6ab1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:44:53.446614 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c2a84-6bc5-452c-ba76-936e6bb6ab1a service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:44:53.457341 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 769/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:44:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:44:55.567879 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f4e93-422e-4694-9fed-ae4db8c1f67c None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:55.568408 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f4e93-422e-4694-9fed-ae4db8c1f67c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:55.568518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f4e93-422e-4694-9fed-ae4db8c1f67c None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:55.569928 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 10:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:44:55.575531 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd95a6-169f-41cf-87fe-15e1cedfc0cb None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:55.575983 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd95a6-169f-41cf-87fe-15e1cedfc0cb None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:55.576113 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd95a6-169f-41cf-87fe-15e1cedfc0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:55.596207 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-20dd95a6-169f-41cf-87fe-15e1cedfc0cb None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:44:55.597435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-20dd95a6-169f-41cf-87fe-15e1cedfc0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:44:55.605109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 10:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:44:55.902597 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f4e93-422e-4694-9fed-ae4db8c1f67c None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:44:55.913409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f4e93-422e-4694-9fed-ae4db8c1f67c None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:44:55.916913 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a025e-e2fe-4895-bf9e-c4dd295ca733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:44:55.917505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a025e-e2fe-4895-bf9e-c4dd295ca733 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:55.917784 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a025e-e2fe-4895-bf9e-c4dd295ca733 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:55.918052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a025e-e2fe-4895-bf9e-c4dd295ca733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:55.926723 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a025e-e2fe-4895-bf9e-c4dd295ca733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:44:55.928134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a025e-e2fe-4895-bf9e-c4dd295ca733 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:44:55.939742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 763/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:44:59.569385 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17484409-cd8e-4533-b63f-8257c86bd6d0 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:59.569972 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17484409-cd8e-4533-b63f-8257c86bd6d0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:59.569972 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17484409-cd8e-4533-b63f-8257c86bd6d0 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:59.571327 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 10:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:44:59.576771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dda151-2071-4095-af0c-f26512d4f9bd None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:44:59.577413 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dda151-2071-4095-af0c-f26512d4f9bd None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:44:59.577413 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dda151-2071-4095-af0c-f26512d4f9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:44:59.598418 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-f6dda151-2071-4095-af0c-f26512d4f9bd None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:44:59.599638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f6dda151-2071-4095-af0c-f26512d4f9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:44:59.608025 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 10:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:44:59.916076 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17484409-cd8e-4533-b63f-8257c86bd6d0 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:44:59.917778 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-17484409-cd8e-4533-b63f-8257c86bd6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:44:59.980887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:44:59.995709 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17484409-cd8e-4533-b63f-8257c86bd6d0 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:44:59.999333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0f7dc-ebee-44b7-9e8a-212ee64ec072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:44:59.999951 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0f7dc-ebee-44b7-9e8a-212ee64ec072 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:45:00.000221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0f7dc-ebee-44b7-9e8a-212ee64ec072 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:45:00.000495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0f7dc-ebee-44b7-9e8a-212ee64ec072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:45:00.010005 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0f7dc-ebee-44b7-9e8a-212ee64ec072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:45:00.011415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0f7dc-ebee-44b7-9e8a-212ee64ec072 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:45:00.020702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 772/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:44:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:45:02.180228 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece0a2f-9182-44f6-9bf2-dfb7b2d2ed2c None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:45:02.180860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece0a2f-9182-44f6-9bf2-dfb7b2d2ed2c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:45:02.180860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece0a2f-9182-44f6-9bf2-dfb7b2d2ed2c None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:45:02.182209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 10:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:45:02.187531 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb66a3-78a2-40ca-a6db-48e1058f237d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:45:02.188029 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb66a3-78a2-40ca-a6db-48e1058f237d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:45:02.188128 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb66a3-78a2-40ca-a6db-48e1058f237d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:45:02.210738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f3bb66a3-78a2-40ca-a6db-48e1058f237d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:45:02.211961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f3bb66a3-78a2-40ca-a6db-48e1058f237d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:45:02.220358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 10:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:45:02.528567 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece0a2f-9182-44f6-9bf2-dfb7b2d2ed2c None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:45:02.530281 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9ece0a2f-9182-44f6-9bf2-dfb7b2d2ed2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:45:02.543012 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece0a2f-9182-44f6-9bf2-dfb7b2d2ed2c None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:45:02.546464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e853d42-a17d-411a-9e7b-5fdb34b13456 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:45:02.547051 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e853d42-a17d-411a-9e7b-5fdb34b13456 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:45:02.547331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e853d42-a17d-411a-9e7b-5fdb34b13456 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:45:02.547604 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e853d42-a17d-411a-9e7b-5fdb34b13456 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:45:02.556331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e853d42-a17d-411a-9e7b-5fdb34b13456 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:45:02.557775 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e853d42-a17d-411a-9e7b-5fdb34b13456 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:45:02.566954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 766/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:45:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:45:12.205646 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=11 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:45:12.562942 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:28.546079 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f3c0e-8885-4113-af72-6d6131455d9a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:28.547253 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f3c0e-8885-4113-af72-6d6131455d9a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:28.547765 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f3c0e-8885-4113-af72-6d6131455d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:28.576326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-dc7f3c0e-8885-4113-af72-6d6131455d9a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:28.583060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-dc7f3c0e-8885-4113-af72-6d6131455d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:28.599997 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 774/1540] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:28.609457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82d5a0-cc14-4221-9e71-e858d0df5da8 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:28.610627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82d5a0-cc14-4221-9e71-e858d0df5da8 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:28.611135 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82d5a0-cc14-4221-9e71-e858d0df5da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:28.646212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-9b82d5a0-cc14-4221-9e71-e858d0df5da8 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:28.648174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9b82d5a0-cc14-4221-9e71-e858d0df5da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:28.665388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 767/1541] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:28.670762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f3c0e-8885-4113-af72-6d6131455d9a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:28.689269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f3c0e-8885-4113-af72-6d6131455d9a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:28.708928 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6685c-5356-4de6-b6e2-2151bc9ac883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:28.709739 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6685c-5356-4de6-b6e2-2151bc9ac883 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:28.710016 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6685c-5356-4de6-b6e2-2151bc9ac883 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:28.710284 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6685c-5356-4de6-b6e2-2151bc9ac883 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:28.710964 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6685c-5356-4de6-b6e2-2151bc9ac883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:46:28.711265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6685c-5356-4de6-b6e2-2151bc9ac883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:28.712967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6685c-5356-4de6-b6e2-2151bc9ac883 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:28.737915 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 775/1542] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:46:28.746466 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82d5a0-cc14-4221-9e71-e858d0df5da8 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:28.763585 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82d5a0-cc14-4221-9e71-e858d0df5da8 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:28.771656 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34be071-76ed-49cc-a235-7934188df088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:28.772750 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34be071-76ed-49cc-a235-7934188df088 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:28.773278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34be071-76ed-49cc-a235-7934188df088 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:28.773818 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34be071-76ed-49cc-a235-7934188df088 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:28.774894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34be071-76ed-49cc-a235-7934188df088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:28.777576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34be071-76ed-49cc-a235-7934188df088 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:28.845361 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 768/1543] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:28 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:28.850322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6685c-5356-4de6-b6e2-2151bc9ac883 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:28.862560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6685c-5356-4de6-b6e2-2151bc9ac883 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:28.943969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b00d7-96c9-4fdf-8bc0-10f96acabee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:28.944606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b00d7-96c9-4fdf-8bc0-10f96acabee0 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:28.944887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b00d7-96c9-4fdf-8bc0-10f96acabee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:28.945156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b00d7-96c9-4fdf-8bc0-10f96acabee0 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:28.945803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b00d7-96c9-4fdf-8bc0-10f96acabee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:28.948899 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b00d7-96c9-4fdf-8bc0-10f96acabee0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:28.982937 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 776/1544] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:28 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:28.987150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34be071-76ed-49cc-a235-7934188df088 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:29.001440 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34be071-76ed-49cc-a235-7934188df088 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:29.012940 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0a5c5-e940-4710-9f9f-b58ca539dbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:29.013904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0a5c5-e940-4710-9f9f-b58ca539dbdd admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.014440 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0a5c5-e940-4710-9f9f-b58ca539dbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.014951 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0a5c5-e940-4710-9f9f-b58ca539dbdd admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.015838 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0a5c5-e940-4710-9f9f-b58ca539dbdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:29.017736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0a5c5-e940-4710-9f9f-b58ca539dbdd admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:29.026487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f54b1e-30f9-440f-8dbf-d4c3af36b169 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.026823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f54b1e-30f9-440f-8dbf-d4c3af36b169 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.027042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f54b1e-30f9-440f-8dbf-d4c3af36b169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.037414 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 769/1545] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:29.041152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0a5c5-e940-4710-9f9f-b58ca539dbdd admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:29.057200 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0a5c5-e940-4710-9f9f-b58ca539dbdd admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:29.066466 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f3f54b1e-30f9-440f-8dbf-d4c3af36b169 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:29.067677 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f3f54b1e-30f9-440f-8dbf-d4c3af36b169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:29.073868 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a47a35-aa7e-449b-89ed-89b7624470af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:29.074648 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a47a35-aa7e-449b-89ed-89b7624470af admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.074931 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a47a35-aa7e-449b-89ed-89b7624470af admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.075203 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a47a35-aa7e-449b-89ed-89b7624470af admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.077239 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a47a35-aa7e-449b-89ed-89b7624470af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:29.079073 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a47a35-aa7e-449b-89ed-89b7624470af admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:29.089855 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 777/1546] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 11 10:46:29.091120 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75eb98-ba2e-4c1b-856a-c52982c9d45c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.091566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75eb98-ba2e-4c1b-856a-c52982c9d45c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.091845 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75eb98-ba2e-4c1b-856a-c52982c9d45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.092506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 770/1547] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 10:46:29.094234 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60345e8-c066-4d67-b7ec-d8d7df7ff2aa None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.094683 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60345e8-c066-4d67-b7ec-d8d7df7ff2aa None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.095266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60345e8-c066-4d67-b7ec-d8d7df7ff2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.122427 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9f75eb98-ba2e-4c1b-856a-c52982c9d45c None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:29.123348 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-b60345e8-c066-4d67-b7ec-d8d7df7ff2aa None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:29.123572 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9f75eb98-ba2e-4c1b-856a-c52982c9d45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:29.125354 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b60345e8-c066-4d67-b7ec-d8d7df7ff2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:29.134519 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 778/1548] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:29.135760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429a817-061d-4644-b759-9b653b21e844 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.136040 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429a817-061d-4644-b759-9b653b21e844 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.136307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429a817-061d-4644-b759-9b653b21e844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.137759 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 771/1549] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:29.146065 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8f0eb-8249-41c4-b748-32d3a5caf360 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.146343 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8f0eb-8249-41c4-b748-32d3a5caf360 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.146610 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8f0eb-8249-41c4-b748-32d3a5caf360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.156870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a429a817-061d-4644-b759-9b653b21e844 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:29.158070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a429a817-061d-4644-b759-9b653b21e844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:29.166562 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-17d8f0eb-8249-41c4-b748-32d3a5caf360 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:29.166884 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 779/1550] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:29.167634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429a817-061d-4644-b759-9b653b21e844 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:29.167914 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-17d8f0eb-8249-41c4-b748-32d3a5caf360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:29.176362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 772/1551] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:29.177331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429a817-061d-4644-b759-9b653b21e844 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:29.177614 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec4bd7-9866-4a91-9e49-03deb611d5e7 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.177942 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec4bd7-9866-4a91-9e49-03deb611d5e7 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.178161 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec4bd7-9866-4a91-9e49-03deb611d5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.181928 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba59d4c-a226-4224-8ca9-510cf844fd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:29.182576 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba59d4c-a226-4224-8ca9-510cf844fd73 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.182893 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba59d4c-a226-4224-8ca9-510cf844fd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.183231 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba59d4c-a226-4224-8ca9-510cf844fd73 admin admin] PATH_INFO: `/v3/projects/5e528d88681f48bd9a93b9851aa9b8dc/users/d89caad53e7344948b7c2e8e50f21687/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.197820 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-daec4bd7-9866-4a91-9e49-03deb611d5e7 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:29.198483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba59d4c-a226-4224-8ca9-510cf844fd73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e528d88681f48bd9a93b9851aa9b8dc, user_id=d89caad53e7344948b7c2e8e50f21687, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:29.199022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-daec4bd7-9866-4a91-9e49-03deb611d5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:29.199520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: WARNING py.warnings [None req-eba59d4c-a226-4224-8ca9-510cf844fd73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 10:46:29.199520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: warnings.warn(msg) Sep 11 10:46:29.199520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: Sep 11 10:46:29.201467 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba59d4c-a226-4224-8ca9-510cf844fd73 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:29.207494 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 773/1552] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:29.208707 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c919-2f9e-413d-b5b4-c79a4d95e5f7 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.208997 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c919-2f9e-413d-b5b4-c79a4d95e5f7 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.209270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c919-2f9e-413d-b5b4-c79a4d95e5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.216346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 780/1553] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:29 2022] PUT /identity/v3/projects/5e528d88681f48bd9a93b9851aa9b8dc/users/d89caad53e7344948b7c2e8e50f21687/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:29.217774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b9b11-6195-4b0c-af5e-9e5c4c75afab None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.218063 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b9b11-6195-4b0c-af5e-9e5c4c75afab None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.218342 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b9b11-6195-4b0c-af5e-9e5c4c75afab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.229057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-fb06c919-2f9e-413d-b5b4-c79a4d95e5f7 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:29.230248 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fb06c919-2f9e-413d-b5b4-c79a4d95e5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:29.237895 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2f7b9b11-6195-4b0c-af5e-9e5c4c75afab None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:29.239076 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2f7b9b11-6195-4b0c-af5e-9e5c4c75afab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:29.294988 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 774/1554] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:29.296046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c056739-568c-402b-9e34-fdacb72f0d1f None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.296335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c056739-568c-402b-9e34-fdacb72f0d1f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.296643 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c056739-568c-402b-9e34-fdacb72f0d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.310056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 781/1555] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:29.311786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5f012-a02d-4eba-a8cd-4091cd1c3fe2 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.312218 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5f012-a02d-4eba-a8cd-4091cd1c3fe2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.312763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5f012-a02d-4eba-a8cd-4091cd1c3fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.315947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-6c056739-568c-402b-9e34-fdacb72f0d1f None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:29.317188 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6c056739-568c-402b-9e34-fdacb72f0d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:29.325039 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 775/1556] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:29.326516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6a64a-fa7f-4065-9ea9-8d686f970e38 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.326516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6a64a-fa7f-4065-9ea9-8d686f970e38 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.326760 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6a64a-fa7f-4065-9ea9-8d686f970e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.334206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f0c5f012-a02d-4eba-a8cd-4091cd1c3fe2 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:29.335414 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f0c5f012-a02d-4eba-a8cd-4091cd1c3fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:29.343721 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 782/1557] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:29.344977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f208168-217f-4752-9376-f8e8a70c2040 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.345265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f208168-217f-4752-9376-f8e8a70c2040 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.345530 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f208168-217f-4752-9376-f8e8a70c2040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.346361 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-bec6a64a-fa7f-4065-9ea9-8d686f970e38 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:29.347530 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-bec6a64a-fa7f-4065-9ea9-8d686f970e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:29.355249 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 776/1558] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:29.356028 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6a64a-fa7f-4065-9ea9-8d686f970e38 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:29.365747 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6a64a-fa7f-4065-9ea9-8d686f970e38 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:29.367318 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4f208168-217f-4752-9376-f8e8a70c2040 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:29.368589 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4f208168-217f-4752-9376-f8e8a70c2040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:29.370200 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7446e5-d37b-473d-a12c-0efcb445e3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:29.370783 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7446e5-d37b-473d-a12c-0efcb445e3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.371060 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7446e5-d37b-473d-a12c-0efcb445e3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.371333 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7446e5-d37b-473d-a12c-0efcb445e3c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.371971 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7446e5-d37b-473d-a12c-0efcb445e3c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:46:29.372278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7446e5-d37b-473d-a12c-0efcb445e3c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:29.373481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: WARNING py.warnings [None req-3d7446e5-d37b-473d-a12c-0efcb445e3c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 10:46:29.373481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: warnings.warn(msg) Sep 11 10:46:29.373481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: Sep 11 10:46:29.374297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7446e5-d37b-473d-a12c-0efcb445e3c1 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:29.376883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 783/1559] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:29.377739 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bbf1a-ecaa-47ca-bf43-3784b83e501d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.378023 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bbf1a-ecaa-47ca-bf43-3784b83e501d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.378351 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bbf1a-ecaa-47ca-bf43-3784b83e501d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.394293 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 777/1560] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:46:29.394293 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc18ffb-5082-4cbc-9995-ee8f06eddf6b None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.394293 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc18ffb-5082-4cbc-9995-ee8f06eddf6b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.394293 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc18ffb-5082-4cbc-9995-ee8f06eddf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.397132 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-452bbf1a-ecaa-47ca-bf43-3784b83e501d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:29.398327 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-452bbf1a-ecaa-47ca-bf43-3784b83e501d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:29.405789 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 784/1561] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:29.406953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb37605-2be0-4014-9359-19801a4dd801 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.407234 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb37605-2be0-4014-9359-19801a4dd801 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.407506 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb37605-2be0-4014-9359-19801a4dd801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.408275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-6cc18ffb-5082-4cbc-9995-ee8f06eddf6b None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:29.410133 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6cc18ffb-5082-4cbc-9995-ee8f06eddf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:29.417491 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 778/1562] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:29.418279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc18ffb-5082-4cbc-9995-ee8f06eddf6b None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:29.421095 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:29.428257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-8cb37605-2be0-4014-9359-19801a4dd801 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:29.430045 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8cb37605-2be0-4014-9359-19801a4dd801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:29.433924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc18ffb-5082-4cbc-9995-ee8f06eddf6b None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:29.437984 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 785/1563] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:29.438595 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140595d-38fa-44db-9144-c98385b99958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:29.438733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb37605-2be0-4014-9359-19801a4dd801 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:29.439336 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140595d-38fa-44db-9144-c98385b99958 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.439621 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140595d-38fa-44db-9144-c98385b99958 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.439902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140595d-38fa-44db-9144-c98385b99958 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.440755 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140595d-38fa-44db-9144-c98385b99958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:46:29.441065 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140595d-38fa-44db-9144-c98385b99958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:29.442733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140595d-38fa-44db-9144-c98385b99958 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:29.448262 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb37605-2be0-4014-9359-19801a4dd801 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:29.452954 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054415a2-ac9a-410a-bfa0-609f4ab1c122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:29.453548 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054415a2-ac9a-410a-bfa0-609f4ab1c122 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.453834 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054415a2-ac9a-410a-bfa0-609f4ab1c122 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.454109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054415a2-ac9a-410a-bfa0-609f4ab1c122 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.462172 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 779/1564] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:46:29.462312 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054415a2-ac9a-410a-bfa0-609f4ab1c122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:46:29.462312 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054415a2-ac9a-410a-bfa0-609f4ab1c122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:29.462488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140595d-38fa-44db-9144-c98385b99958 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:29.462578 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054415a2-ac9a-410a-bfa0-609f4ab1c122 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:29.465756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140595d-38fa-44db-9144-c98385b99958 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:29.470371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06732e70-30a0-4812-bc98-12435cabbdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:29.470953 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06732e70-30a0-4812-bc98-12435cabbdae admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.471334 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06732e70-30a0-4812-bc98-12435cabbdae admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.471618 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06732e70-30a0-4812-bc98-12435cabbdae admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.472255 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06732e70-30a0-4812-bc98-12435cabbdae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:46:29.472585 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06732e70-30a0-4812-bc98-12435cabbdae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:29.479832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 786/1565] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:46:29.479832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054415a2-ac9a-410a-bfa0-609f4ab1c122 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:29.480067 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06732e70-30a0-4812-bc98-12435cabbdae admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:29.489302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054415a2-ac9a-410a-bfa0-609f4ab1c122 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:29.490710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 780/1566] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:46:29.491542 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06732e70-30a0-4812-bc98-12435cabbdae admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:29.493816 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c67b5-43f6-4ebe-b562-3e349ae66395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:29.494401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c67b5-43f6-4ebe-b562-3e349ae66395 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.494678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c67b5-43f6-4ebe-b562-3e349ae66395 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.494948 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c67b5-43f6-4ebe-b562-3e349ae66395 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.495580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c67b5-43f6-4ebe-b562-3e349ae66395 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:46:29.495879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c67b5-43f6-4ebe-b562-3e349ae66395 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:29.497902 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c67b5-43f6-4ebe-b562-3e349ae66395 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:29.500988 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06732e70-30a0-4812-bc98-12435cabbdae admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:29.506226 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8528c35-e487-47dc-9a80-910c1cfc7bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:29.506807 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8528c35-e487-47dc-9a80-910c1cfc7bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.507084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8528c35-e487-47dc-9a80-910c1cfc7bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.507356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8528c35-e487-47dc-9a80-910c1cfc7bb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.507976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8528c35-e487-47dc-9a80-910c1cfc7bb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:29.509875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8528c35-e487-47dc-9a80-910c1cfc7bb2 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:29.514616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 787/1567] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:46:29.514616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c67b5-43f6-4ebe-b562-3e349ae66395 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:29.535819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:29.544428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 781/1568] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/projects => generated 403 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:29.545610 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8528c35-e487-47dc-9a80-910c1cfc7bb2 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:29.577170 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c67b5-43f6-4ebe-b562-3e349ae66395 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:29.609584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8528c35-e487-47dc-9a80-910c1cfc7bb2 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:29.614821 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253acf1-d537-4ba9-b04a-15d6b791bea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:29.615417 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253acf1-d537-4ba9-b04a-15d6b791bea5 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.615698 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253acf1-d537-4ba9-b04a-15d6b791bea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.615975 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253acf1-d537-4ba9-b04a-15d6b791bea5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.616679 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253acf1-d537-4ba9-b04a-15d6b791bea5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:46:29.616990 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253acf1-d537-4ba9-b04a-15d6b791bea5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:29.618581 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253acf1-d537-4ba9-b04a-15d6b791bea5 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:29.624511 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984bad0-c1e8-46f4-899e-2cc4fa52c136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:29.625083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984bad0-c1e8-46f4-899e-2cc4fa52c136 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.625356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984bad0-c1e8-46f4-899e-2cc4fa52c136 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.625624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984bad0-c1e8-46f4-899e-2cc4fa52c136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.630081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 782/1569] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:46:29.630961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253acf1-d537-4ba9-b04a-15d6b791bea5 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:29.637924 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984bad0-c1e8-46f4-899e-2cc4fa52c136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:29.639372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984bad0-c1e8-46f4-899e-2cc4fa52c136 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:29.640738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253acf1-d537-4ba9-b04a-15d6b791bea5 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:29.646119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18028708-f533-4ba7-8953-673562d348d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:29.646694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18028708-f533-4ba7-8953-673562d348d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.646969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18028708-f533-4ba7-8953-673562d348d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.647240 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18028708-f533-4ba7-8953-673562d348d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.647866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18028708-f533-4ba7-8953-673562d348d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:46:29.648169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18028708-f533-4ba7-8953-673562d348d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:29.648850 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 788/1570] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:29.649619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984bad0-c1e8-46f4-899e-2cc4fa52c136 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:29.650052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18028708-f533-4ba7-8953-673562d348d2 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:29.658355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984bad0-c1e8-46f4-899e-2cc4fa52c136 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:29.669800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 783/1571] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:46:29.669800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18028708-f533-4ba7-8953-673562d348d2 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:29.671047 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c7ae7-800c-45f3-95fc-3c971d7b38a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:29.671666 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c7ae7-800c-45f3-95fc-3c971d7b38a2 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.671950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c7ae7-800c-45f3-95fc-3c971d7b38a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.672227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c7ae7-800c-45f3-95fc-3c971d7b38a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.673198 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c7ae7-800c-45f3-95fc-3c971d7b38a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:29.674012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: WARNING py.warnings [None req-3c9c7ae7-800c-45f3-95fc-3c971d7b38a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 10:46:29.674012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: warnings.warn(msg) Sep 11 10:46:29.674012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: Sep 11 10:46:29.675213 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c7ae7-800c-45f3-95fc-3c971d7b38a2 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:29.681114 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18028708-f533-4ba7-8953-673562d348d2 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:29.685973 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559231b-b6ee-4028-b2e7-a33e02521351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:29.686580 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559231b-b6ee-4028-b2e7-a33e02521351 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.686864 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559231b-b6ee-4028-b2e7-a33e02521351 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.687128 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559231b-b6ee-4028-b2e7-a33e02521351 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.687754 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559231b-b6ee-4028-b2e7-a33e02521351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:29.689667 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559231b-b6ee-4028-b2e7-a33e02521351 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:29.703836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 789/1572] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:29.704519 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c7ae7-800c-45f3-95fc-3c971d7b38a2 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:29.727124 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 784/1573] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/projects => generated 389 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:29.727899 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559231b-b6ee-4028-b2e7-a33e02521351 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:29.782042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c7ae7-800c-45f3-95fc-3c971d7b38a2 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:29.795587 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:29.802937 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559231b-b6ee-4028-b2e7-a33e02521351 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:29.809543 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f03621-45a0-4e6b-9b66-a651393cc9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:29.810015 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f03621-45a0-4e6b-9b66-a651393cc9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.810292 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f03621-45a0-4e6b-9b66-a651393cc9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.810929 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f03621-45a0-4e6b-9b66-a651393cc9a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.812053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f03621-45a0-4e6b-9b66-a651393cc9a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:29.816207 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f03621-45a0-4e6b-9b66-a651393cc9a9 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:29.856429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fcd59-2ed8-4b81-933c-ae80ed22d4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:29.857096 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fcd59-2ed8-4b81-933c-ae80ed22d4bc admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.860348 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 785/1574] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/projects => generated 405 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:29.860465 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fcd59-2ed8-4b81-933c-ae80ed22d4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.860465 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fcd59-2ed8-4b81-933c-ae80ed22d4bc admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.860669 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f03621-45a0-4e6b-9b66-a651393cc9a9 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:29.860772 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fcd59-2ed8-4b81-933c-ae80ed22d4bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:29.860772 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fcd59-2ed8-4b81-933c-ae80ed22d4bc admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:29.890880 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 790/1575] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/projects => generated 367 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:29.891717 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fcd59-2ed8-4b81-933c-ae80ed22d4bc admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:29.914506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:29.934675 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f03621-45a0-4e6b-9b66-a651393cc9a9 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:29.964526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fcd59-2ed8-4b81-933c-ae80ed22d4bc admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:29.970151 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf62b8f-15db-4c3a-81f8-78a6dc344e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:29.970763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf62b8f-15db-4c3a-81f8-78a6dc344e73 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:29.971073 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf62b8f-15db-4c3a-81f8-78a6dc344e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:29.971446 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf62b8f-15db-4c3a-81f8-78a6dc344e73 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:29.972079 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf62b8f-15db-4c3a-81f8-78a6dc344e73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:29.974792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf62b8f-15db-4c3a-81f8-78a6dc344e73 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.025964 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 791/1576] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:30.026922 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf62b8f-15db-4c3a-81f8-78a6dc344e73 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.030829 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa182d7-65d6-4d43-a3aa-1ff7352ee14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.031579 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa182d7-65d6-4d43-a3aa-1ff7352ee14f admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.031905 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa182d7-65d6-4d43-a3aa-1ff7352ee14f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.032168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa182d7-65d6-4d43-a3aa-1ff7352ee14f admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.032941 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa182d7-65d6-4d43-a3aa-1ff7352ee14f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.034460 dv-cinder-856460-3-smb devstack@keystone.service[88076]: WARNING py.warnings [None req-4aa182d7-65d6-4d43-a3aa-1ff7352ee14f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 10:46:30.034460 dv-cinder-856460-3-smb devstack@keystone.service[88076]: warnings.warn(msg) Sep 11 10:46:30.034460 dv-cinder-856460-3-smb devstack@keystone.service[88076]: Sep 11 10:46:30.035814 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa182d7-65d6-4d43-a3aa-1ff7352ee14f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.064581 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 786/1577] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:29 2022] POST /identity/v3/users => generated 302 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:30.065878 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa182d7-65d6-4d43-a3aa-1ff7352ee14f admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.078175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa182d7-65d6-4d43-a3aa-1ff7352ee14f admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.121225 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf62b8f-15db-4c3a-81f8-78a6dc344e73 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.126460 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311750e-f465-4f2b-9029-adf8547601da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.127080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311750e-f465-4f2b-9029-adf8547601da admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.128390 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311750e-f465-4f2b-9029-adf8547601da admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.128707 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311750e-f465-4f2b-9029-adf8547601da admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.129354 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311750e-f465-4f2b-9029-adf8547601da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.132337 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311750e-f465-4f2b-9029-adf8547601da admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.150510 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50bed7-7e89-49ef-8aba-1bace47a5511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.151729 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50bed7-7e89-49ef-8aba-1bace47a5511 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.151877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50bed7-7e89-49ef-8aba-1bace47a5511 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.152986 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50bed7-7e89-49ef-8aba-1bace47a5511 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.153914 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50bed7-7e89-49ef-8aba-1bace47a5511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.156291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50bed7-7e89-49ef-8aba-1bace47a5511 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.168170 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 792/1578] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:30 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:30.169125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311750e-f465-4f2b-9029-adf8547601da admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.181800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 787/1579] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:30 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:30.183399 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50bed7-7e89-49ef-8aba-1bace47a5511 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.186606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:30.195517 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50bed7-7e89-49ef-8aba-1bace47a5511 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.243739 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311750e-f465-4f2b-9029-adf8547601da admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.248726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65b6a2-b32e-4fce-8cff-d6bddf3c299b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.249336 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65b6a2-b32e-4fce-8cff-d6bddf3c299b admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.249618 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65b6a2-b32e-4fce-8cff-d6bddf3c299b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.249921 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65b6a2-b32e-4fce-8cff-d6bddf3c299b admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.250648 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65b6a2-b32e-4fce-8cff-d6bddf3c299b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.253295 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65b6a2-b32e-4fce-8cff-d6bddf3c299b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.276714 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 793/1580] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:30 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:30.280505 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65b6a2-b32e-4fce-8cff-d6bddf3c299b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.281545 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e530ba-a562-46e2-9114-b1cfd8bcb4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.282567 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e530ba-a562-46e2-9114-b1cfd8bcb4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.283063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e530ba-a562-46e2-9114-b1cfd8bcb4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.283555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e530ba-a562-46e2-9114-b1cfd8bcb4c6 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.285263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e530ba-a562-46e2-9114-b1cfd8bcb4c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.289982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e530ba-a562-46e2-9114-b1cfd8bcb4c6 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.291460 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65b6a2-b32e-4fce-8cff-d6bddf3c299b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.296479 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353b990-f6f2-48ad-8c31-792415728e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.297110 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353b990-f6f2-48ad-8c31-792415728e42 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.297393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353b990-f6f2-48ad-8c31-792415728e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.297667 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353b990-f6f2-48ad-8c31-792415728e42 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.298280 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353b990-f6f2-48ad-8c31-792415728e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.300839 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353b990-f6f2-48ad-8c31-792415728e42 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.319994 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:30.324274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 794/1581] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:30 2022] POST /identity/v3/users => generated 284 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:30.325224 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353b990-f6f2-48ad-8c31-792415728e42 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.336527 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 788/1582] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:30 2022] POST /identity/v3/users => generated 303 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:30.336527 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e530ba-a562-46e2-9114-b1cfd8bcb4c6 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.348912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353b990-f6f2-48ad-8c31-792415728e42 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.354891 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240237f-0fed-4f61-a5ef-70d50654f6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.355526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240237f-0fed-4f61-a5ef-70d50654f6f4 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.355795 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240237f-0fed-4f61-a5ef-70d50654f6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.356074 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240237f-0fed-4f61-a5ef-70d50654f6f4 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.356748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240237f-0fed-4f61-a5ef-70d50654f6f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.358150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e530ba-a562-46e2-9114-b1cfd8bcb4c6 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.358996 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240237f-0fed-4f61-a5ef-70d50654f6f4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.374611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b653b-fc9f-4008-b654-67c174526c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.374611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b653b-fc9f-4008-b654-67c174526c11 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.374611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b653b-fc9f-4008-b654-67c174526c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.374611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b653b-fc9f-4008-b654-67c174526c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.375147 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b653b-fc9f-4008-b654-67c174526c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.377697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b653b-fc9f-4008-b654-67c174526c11 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.395694 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 795/1583] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:30 2022] POST /identity/v3/users => generated 293 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:30.396835 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240237f-0fed-4f61-a5ef-70d50654f6f4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.404088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 789/1584] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:30.410376 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b653b-fc9f-4008-b654-67c174526c11 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.412750 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240237f-0fed-4f61-a5ef-70d50654f6f4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.418041 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525b6bb-0815-4a62-91fd-8b4609255199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.418311 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525b6bb-0815-4a62-91fd-8b4609255199 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.418593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525b6bb-0815-4a62-91fd-8b4609255199 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.418868 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525b6bb-0815-4a62-91fd-8b4609255199 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.419505 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525b6bb-0815-4a62-91fd-8b4609255199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.427530 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b653b-fc9f-4008-b654-67c174526c11 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.432122 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525b6bb-0815-4a62-91fd-8b4609255199 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.435610 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb63a8b-b018-4646-8961-6a9a491ed1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.436638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb63a8b-b018-4646-8961-6a9a491ed1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.437105 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb63a8b-b018-4646-8961-6a9a491ed1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.437570 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb63a8b-b018-4646-8961-6a9a491ed1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.438601 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb63a8b-b018-4646-8961-6a9a491ed1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.441787 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb63a8b-b018-4646-8961-6a9a491ed1b4 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.459080 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 790/1585] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:30.460960 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb63a8b-b018-4646-8961-6a9a491ed1b4 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.471430 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 796/1586] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:30 2022] POST /identity/v3/users => generated 287 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:30.473217 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525b6bb-0815-4a62-91fd-8b4609255199 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.483032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb63a8b-b018-4646-8961-6a9a491ed1b4 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.484030 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525b6bb-0815-4a62-91fd-8b4609255199 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.489185 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f5a6e-42bf-411e-bcd1-ca6971f1a191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.489579 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1b0de-2782-492b-b5c1-047e74d5560e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.490041 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f5a6e-42bf-411e-bcd1-ca6971f1a191 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.490246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1b0de-2782-492b-b5c1-047e74d5560e admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.490570 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f5a6e-42bf-411e-bcd1-ca6971f1a191 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.490964 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f5a6e-42bf-411e-bcd1-ca6971f1a191 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.491158 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1b0de-2782-492b-b5c1-047e74d5560e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.491453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1b0de-2782-492b-b5c1-047e74d5560e admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.491969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f5a6e-42bf-411e-bcd1-ca6971f1a191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.492140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1b0de-2782-492b-b5c1-047e74d5560e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.493712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1b0de-2782-492b-b5c1-047e74d5560e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.494114 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f5a6e-42bf-411e-bcd1-ca6971f1a191 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.507055 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 797/1587] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:30.507906 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1b0de-2782-492b-b5c1-047e74d5560e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.519536 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 791/1588] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:30.521816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f5a6e-42bf-411e-bcd1-ca6971f1a191 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.523537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1b0de-2782-492b-b5c1-047e74d5560e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.530417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e662f14-d60d-4d44-b14c-3dd975e221f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.531040 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e662f14-d60d-4d44-b14c-3dd975e221f8 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.531320 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e662f14-d60d-4d44-b14c-3dd975e221f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.532138 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e662f14-d60d-4d44-b14c-3dd975e221f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.532810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e662f14-d60d-4d44-b14c-3dd975e221f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.534762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e662f14-d60d-4d44-b14c-3dd975e221f8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.549279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f5a6e-42bf-411e-bcd1-ca6971f1a191 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.552841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 798/1589] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:30.553758 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e662f14-d60d-4d44-b14c-3dd975e221f8 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.558576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae9938-b687-4d91-aa2e-c87cb8d8f61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.560477 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae9938-b687-4d91-aa2e-c87cb8d8f61b admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.561683 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae9938-b687-4d91-aa2e-c87cb8d8f61b admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.562254 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae9938-b687-4d91-aa2e-c87cb8d8f61b admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.564170 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae9938-b687-4d91-aa2e-c87cb8d8f61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.568203 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae9938-b687-4d91-aa2e-c87cb8d8f61b admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.569419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e662f14-d60d-4d44-b14c-3dd975e221f8 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.576216 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08940497-b854-4b8e-90ef-2e95996b3a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.577047 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08940497-b854-4b8e-90ef-2e95996b3a6c admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.577547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08940497-b854-4b8e-90ef-2e95996b3a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.578558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08940497-b854-4b8e-90ef-2e95996b3a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.579497 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08940497-b854-4b8e-90ef-2e95996b3a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.581350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08940497-b854-4b8e-90ef-2e95996b3a6c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.591797 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 792/1590] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:30.592711 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae9938-b687-4d91-aa2e-c87cb8d8f61b admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.604136 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae9938-b687-4d91-aa2e-c87cb8d8f61b admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.606766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 799/1591] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:30.609447 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08940497-b854-4b8e-90ef-2e95996b3a6c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.609861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb429a-28c1-4bfe-97b6-95de6042dbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.610751 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb429a-28c1-4bfe-97b6-95de6042dbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.610901 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb429a-28c1-4bfe-97b6-95de6042dbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.611034 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb429a-28c1-4bfe-97b6-95de6042dbe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.611772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb429a-28c1-4bfe-97b6-95de6042dbe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.613544 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb429a-28c1-4bfe-97b6-95de6042dbe1 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.630624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 793/1592] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:30.630624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb429a-28c1-4bfe-97b6-95de6042dbe1 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.631812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08940497-b854-4b8e-90ef-2e95996b3a6c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.644078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb429a-28c1-4bfe-97b6-95de6042dbe1 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.645130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8113cfd-1d80-45e9-b754-4e3b194f97cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.647515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8113cfd-1d80-45e9-b754-4e3b194f97cb admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.648173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8113cfd-1d80-45e9-b754-4e3b194f97cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.648889 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8113cfd-1d80-45e9-b754-4e3b194f97cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.649548 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce85291-af60-4c66-bbf7-1a16b25476ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.650095 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8113cfd-1d80-45e9-b754-4e3b194f97cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.650265 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce85291-af60-4c66-bbf7-1a16b25476ea admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.650646 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce85291-af60-4c66-bbf7-1a16b25476ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.651003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce85291-af60-4c66-bbf7-1a16b25476ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.651713 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce85291-af60-4c66-bbf7-1a16b25476ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.653444 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce85291-af60-4c66-bbf7-1a16b25476ea admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.657381 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8113cfd-1d80-45e9-b754-4e3b194f97cb admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.669759 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 794/1593] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:30.669759 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce85291-af60-4c66-bbf7-1a16b25476ea admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.677809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce85291-af60-4c66-bbf7-1a16b25476ea admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.682815 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4f1c2-84f3-472c-a9f4-7f395d01c71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.683660 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4f1c2-84f3-472c-a9f4-7f395d01c71e admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.684012 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4f1c2-84f3-472c-a9f4-7f395d01c71e admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.684354 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4f1c2-84f3-472c-a9f4-7f395d01c71e admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.685113 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4f1c2-84f3-472c-a9f4-7f395d01c71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.690859 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4f1c2-84f3-472c-a9f4-7f395d01c71e admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.691068 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 800/1594] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:30.692133 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8113cfd-1d80-45e9-b754-4e3b194f97cb admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.710753 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8113cfd-1d80-45e9-b754-4e3b194f97cb admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.718600 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889de434-a06c-41d7-a76d-8342f709743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.719553 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889de434-a06c-41d7-a76d-8342f709743f admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.720013 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889de434-a06c-41d7-a76d-8342f709743f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.720763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889de434-a06c-41d7-a76d-8342f709743f admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.722545 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889de434-a06c-41d7-a76d-8342f709743f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.726561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889de434-a06c-41d7-a76d-8342f709743f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.733198 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 795/1595] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:30.735042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4f1c2-84f3-472c-a9f4-7f395d01c71e admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.751169 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 801/1596] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:30.753883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889de434-a06c-41d7-a76d-8342f709743f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.756355 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4f1c2-84f3-472c-a9f4-7f395d01c71e admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.762922 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30693b-12cc-4646-b87d-55fd10974e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.763877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30693b-12cc-4646-b87d-55fd10974e0e admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.764080 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30693b-12cc-4646-b87d-55fd10974e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.764365 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30693b-12cc-4646-b87d-55fd10974e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.766165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30693b-12cc-4646-b87d-55fd10974e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.767227 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30693b-12cc-4646-b87d-55fd10974e0e admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.777581 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889de434-a06c-41d7-a76d-8342f709743f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.779479 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 796/1597] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:30.786013 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30693b-12cc-4646-b87d-55fd10974e0e admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.792093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2f978-0b64-49e0-9c4a-440f605ab064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.792807 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2f978-0b64-49e0-9c4a-440f605ab064 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.793089 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2f978-0b64-49e0-9c4a-440f605ab064 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.793362 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2f978-0b64-49e0-9c4a-440f605ab064 admin admin] PATH_INFO: `/v3/projects/1f7ca4eebd79451d894648d6e7b43074/users/cb432e5b033540b7ac1eef7bdf44e90a/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.798782 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30693b-12cc-4646-b87d-55fd10974e0e admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.805672 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382c7c0-b805-4805-b0f5-2c995f6d2afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.806404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382c7c0-b805-4805-b0f5-2c995f6d2afe admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.806680 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382c7c0-b805-4805-b0f5-2c995f6d2afe admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.806954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382c7c0-b805-4805-b0f5-2c995f6d2afe admin admin] PATH_INFO: `/v3/projects/cc739bb11f724380b7c66dcd73c4d9ad/users/2fe59ff9bd6d4eb7ab6386550746a12c/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.810585 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2f978-0b64-49e0-9c4a-440f605ab064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f7ca4eebd79451d894648d6e7b43074, user_id=cb432e5b033540b7ac1eef7bdf44e90a, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.815098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2f978-0b64-49e0-9c4a-440f605ab064 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.828916 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382c7c0-b805-4805-b0f5-2c995f6d2afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc739bb11f724380b7c66dcd73c4d9ad, user_id=2fe59ff9bd6d4eb7ab6386550746a12c, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.832624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382c7c0-b805-4805-b0f5-2c995f6d2afe admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.839187 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 802/1598] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:30 2022] PUT /identity/v3/projects/1f7ca4eebd79451d894648d6e7b43074/users/cb432e5b033540b7ac1eef7bdf44e90a/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:30.840865 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2f978-0b64-49e0-9c4a-440f605ab064 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.849680 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 797/1599] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:30 2022] PUT /identity/v3/projects/cc739bb11f724380b7c66dcd73c4d9ad/users/2fe59ff9bd6d4eb7ab6386550746a12c/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:30.851252 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382c7c0-b805-4805-b0f5-2c995f6d2afe admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.889369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:30.928155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2f978-0b64-49e0-9c4a-440f605ab064 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.943844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382c7c0-b805-4805-b0f5-2c995f6d2afe admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.951246 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d65c4-ebab-44d4-9abe-1a4b1c7821f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.951999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d65c4-ebab-44d4-9abe-1a4b1c7821f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.952358 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d65c4-ebab-44d4-9abe-1a4b1c7821f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.952735 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d65c4-ebab-44d4-9abe-1a4b1c7821f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:30.954146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d65c4-ebab-44d4-9abe-1a4b1c7821f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:30.956437 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d65c4-ebab-44d4-9abe-1a4b1c7821f3 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:30.969789 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 798/1600] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:30.970526 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d65c4-ebab-44d4-9abe-1a4b1c7821f3 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:30.981505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d65c4-ebab-44d4-9abe-1a4b1c7821f3 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:30.986431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47f779-ce13-4ab4-9721-0d56c9f80982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:30.987370 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47f779-ce13-4ab4-9721-0d56c9f80982 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:30.988037 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47f779-ce13-4ab4-9721-0d56c9f80982 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:30.988535 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47f779-ce13-4ab4-9721-0d56c9f80982 admin admin] PATH_INFO: `/v3/projects/02525ff265d54629b682029fcc8e08cf/users/d0d2655f3c6a42898c67f82a697ef7a8/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:31.006973 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23bf25-a561-4018-bebc-18bdc0c5feda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:31.007881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23bf25-a561-4018-bebc-18bdc0c5feda admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:31.008274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23bf25-a561-4018-bebc-18bdc0c5feda admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:31.008394 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47f779-ce13-4ab4-9721-0d56c9f80982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02525ff265d54629b682029fcc8e08cf, user_id=d0d2655f3c6a42898c67f82a697ef7a8, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:31.008725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23bf25-a561-4018-bebc-18bdc0c5feda admin admin] PATH_INFO: `/v3/projects/c3d1de53fef04cfe9f1cd215b8547398/users/4214b219280a40318279a949dd5e434b/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:31.011469 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47f779-ce13-4ab4-9721-0d56c9f80982 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:31.030358 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 799/1601] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:30 2022] PUT /identity/v3/projects/02525ff265d54629b682029fcc8e08cf/users/d0d2655f3c6a42898c67f82a697ef7a8/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:31.031364 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47f779-ce13-4ab4-9721-0d56c9f80982 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:31.032404 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23bf25-a561-4018-bebc-18bdc0c5feda admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d1de53fef04cfe9f1cd215b8547398, user_id=4214b219280a40318279a949dd5e434b, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:31.038050 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23bf25-a561-4018-bebc-18bdc0c5feda admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:31.061204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:31.072326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 803/1602] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:30 2022] PUT /identity/v3/projects/c3d1de53fef04cfe9f1cd215b8547398/users/4214b219280a40318279a949dd5e434b/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:31.074620 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23bf25-a561-4018-bebc-18bdc0c5feda admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:31.118583 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47f779-ce13-4ab4-9721-0d56c9f80982 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:31.183956 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23bf25-a561-4018-bebc-18bdc0c5feda admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:31.190983 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fe911-2fad-4501-ac14-964b41bc811d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:31.191668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fe911-2fad-4501-ac14-964b41bc811d admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:31.191974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fe911-2fad-4501-ac14-964b41bc811d admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:31.192250 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fe911-2fad-4501-ac14-964b41bc811d admin admin] PATH_INFO: `/v3/projects/91960c42649a4d50a5080f5cc9482e0c/users/2465a3ec985c4bacb213ad86ad45ab8f/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:31.198987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b5784-cdce-44a3-9622-46068eb31562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:31.199674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b5784-cdce-44a3-9622-46068eb31562 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:31.199953 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b5784-cdce-44a3-9622-46068eb31562 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:31.200230 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b5784-cdce-44a3-9622-46068eb31562 admin admin] PATH_INFO: `/v3/projects/1c94d29d8a084cb19dc192b1bc431e87/users/3cb0938a89e14ad682ad53311c322faf/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:31.211948 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fe911-2fad-4501-ac14-964b41bc811d admin admin] RBAC: Authorizing `identity:create_grant(project_id=91960c42649a4d50a5080f5cc9482e0c, user_id=2465a3ec985c4bacb213ad86ad45ab8f, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:31.216873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fe911-2fad-4501-ac14-964b41bc811d admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:31.217571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b5784-cdce-44a3-9622-46068eb31562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c94d29d8a084cb19dc192b1bc431e87, user_id=3cb0938a89e14ad682ad53311c322faf, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:31.222295 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b5784-cdce-44a3-9622-46068eb31562 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:31.238326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 804/1603] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:31 2022] PUT /identity/v3/projects/91960c42649a4d50a5080f5cc9482e0c/users/2465a3ec985c4bacb213ad86ad45ab8f/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:31.239504 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 800/1604] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:31 2022] PUT /identity/v3/projects/1c94d29d8a084cb19dc192b1bc431e87/users/3cb0938a89e14ad682ad53311c322faf/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:31.240334 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8aa0f-942a-4c9d-b040-4011398aca11 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:31.240875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a3876-4989-433f-a1a1-0e5f99b0fa96 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:31.241121 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8aa0f-942a-4c9d-b040-4011398aca11 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:31.241227 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a3876-4989-433f-a1a1-0e5f99b0fa96 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:31.241517 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a3876-4989-433f-a1a1-0e5f99b0fa96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:31.253324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8aa0f-942a-4c9d-b040-4011398aca11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:31.286000 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-b82a3876-4989-433f-a1a1-0e5f99b0fa96 None None] MFA Rules not processed for user `2fe59ff9bd6d4eb7ab6386550746a12c`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:31.287417 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b82a3876-4989-433f-a1a1-0e5f99b0fa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:31.288320 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-98c8aa0f-942a-4c9d-b040-4011398aca11 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:31.290457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-98c8aa0f-942a-4c9d-b040-4011398aca11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:31.350995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:31.376970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 801/1605] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:31.379509 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a3876-4989-433f-a1a1-0e5f99b0fa96 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:31.389340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 805/1606] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:31.390897 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde45b9-b4ad-4bc7-9fac-80f1564af202 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:31.391782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde45b9-b4ad-4bc7-9fac-80f1564af202 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:31.392164 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde45b9-b4ad-4bc7-9fac-80f1564af202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:31.419606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a3876-4989-433f-a1a1-0e5f99b0fa96 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:31.429064 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7226b47-2baa-4291-ba85-03dec3aeb15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:31.429672 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7226b47-2baa-4291-ba85-03dec3aeb15e admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:31.429948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7226b47-2baa-4291-ba85-03dec3aeb15e admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:31.430218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7226b47-2baa-4291-ba85-03dec3aeb15e admin admin] PATH_INFO: `/v3/projects/30304c1cfa224c9085df50ae202863b0/users/a4fbe9b7d2964118b012fbd6c41f219e/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:31.430599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-6bde45b9-b4ad-4bc7-9fac-80f1564af202 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:31.432029 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6bde45b9-b4ad-4bc7-9fac-80f1564af202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:31.450383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 806/1607] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:31.454628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3097a0a-4af5-436f-a7e2-30f8ee375933 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:31.454918 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3097a0a-4af5-436f-a7e2-30f8ee375933 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:31.455192 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3097a0a-4af5-436f-a7e2-30f8ee375933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:31.459300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7226b47-2baa-4291-ba85-03dec3aeb15e admin admin] RBAC: Authorizing `identity:create_grant(project_id=30304c1cfa224c9085df50ae202863b0, user_id=a4fbe9b7d2964118b012fbd6c41f219e, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:31.467426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7226b47-2baa-4291-ba85-03dec3aeb15e admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:31.501803 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 802/1608] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:31 2022] PUT /identity/v3/projects/30304c1cfa224c9085df50ae202863b0/users/a4fbe9b7d2964118b012fbd6c41f219e/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:31.501803 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39792d-7fd1-4dcc-88ca-1c49faf780bd None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:31.501803 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39792d-7fd1-4dcc-88ca-1c49faf780bd None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:31.501803 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39792d-7fd1-4dcc-88ca-1c49faf780bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:31.509609 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b3097a0a-4af5-436f-a7e2-30f8ee375933 None None] MFA Rules not processed for user `4214b219280a40318279a949dd5e434b`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:31.510841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b3097a0a-4af5-436f-a7e2-30f8ee375933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:31.520480 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-bc39792d-7fd1-4dcc-88ca-1c49faf780bd None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:31.522828 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-bc39792d-7fd1-4dcc-88ca-1c49faf780bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:31.534738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:31.591473 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 807/1609] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:31.595319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe54e70-063a-4234-8298-93d11f41209b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:31.595319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe54e70-063a-4234-8298-93d11f41209b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:31.595515 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 803/1610] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:31.595515 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39792d-7fd1-4dcc-88ca-1c49faf780bd None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:31.597632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe54e70-063a-4234-8298-93d11f41209b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:31.603369 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-bc39792d-7fd1-4dcc-88ca-1c49faf780bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:31.633083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-dbe54e70-063a-4234-8298-93d11f41209b None None] MFA Rules not processed for user `3cb0938a89e14ad682ad53311c322faf`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:31.634425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-dbe54e70-063a-4234-8298-93d11f41209b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:31.679744 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39792d-7fd1-4dcc-88ca-1c49faf780bd None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:31.689688 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe46ca1-437c-4297-b94a-0dadb75e185f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:31.690860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe46ca1-437c-4297-b94a-0dadb75e185f service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:31.691210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe46ca1-437c-4297-b94a-0dadb75e185f service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:31.691502 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe46ca1-437c-4297-b94a-0dadb75e185f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:31.762996 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe46ca1-437c-4297-b94a-0dadb75e185f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:31.762996 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe46ca1-437c-4297-b94a-0dadb75e185f service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:31.762996 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 804/1611] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:31.762996 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5877fa2-2fe7-4358-b4e2-83a803342ba4 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:31.762996 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5877fa2-2fe7-4358-b4e2-83a803342ba4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:31.762996 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5877fa2-2fe7-4358-b4e2-83a803342ba4 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:31.762996 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 805/1612] 10.222.0.20 () {54 vars in 962 bytes} [Sun Sep 11 10:46:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:46:31.765360 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5877fa2-2fe7-4358-b4e2-83a803342ba4 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:31.765360 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5877fa2-2fe7-4358-b4e2-83a803342ba4 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:31.769414 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 808/1613] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:31.770321 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f278c-df8f-4a1b-8f5e-e4fad84f7956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:31.772591 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c763962-eb28-474c-8ebe-b69ef8dde1c8 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:31.775069 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f278c-df8f-4a1b-8f5e-e4fad84f7956 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:31.775566 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f278c-df8f-4a1b-8f5e-e4fad84f7956 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:31.776042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f278c-df8f-4a1b-8f5e-e4fad84f7956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:31.780964 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c763962-eb28-474c-8ebe-b69ef8dde1c8 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:31.781281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c763962-eb28-474c-8ebe-b69ef8dde1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:31.802164 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f278c-df8f-4a1b-8f5e-e4fad84f7956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:31.803777 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f278c-df8f-4a1b-8f5e-e4fad84f7956 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:31.816839 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 806/1614] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:31.818081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f278c-df8f-4a1b-8f5e-e4fad84f7956 service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:31.824344 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3c763962-eb28-474c-8ebe-b69ef8dde1c8 None None] MFA Rules not processed for user `a4fbe9b7d2964118b012fbd6c41f219e`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:31.825712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3c763962-eb28-474c-8ebe-b69ef8dde1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:31.827388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f278c-df8f-4a1b-8f5e-e4fad84f7956 service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:31.833541 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e102f4-75e2-4e08-80b8-254a8b0d0d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:31.834162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e102f4-75e2-4e08-80b8-254a8b0d0d18 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:31.834440 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e102f4-75e2-4e08-80b8-254a8b0d0d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:31.834840 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e102f4-75e2-4e08-80b8-254a8b0d0d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:31.835600 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e102f4-75e2-4e08-80b8-254a8b0d0d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:31.837698 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e102f4-75e2-4e08-80b8-254a8b0d0d18 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:31.886908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 807/1615] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:31 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:31.888228 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e102f4-75e2-4e08-80b8-254a8b0d0d18 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:31.914062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:31.953219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 809/1616] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:31.954310 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c88fbd-8ade-40ab-9770-6689b807a1ac None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:31.954751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c88fbd-8ade-40ab-9770-6689b807a1ac None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:31.955035 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c88fbd-8ade-40ab-9770-6689b807a1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:32.005213 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e5c88fbd-8ade-40ab-9770-6689b807a1ac None None] MFA Rules not processed for user `b642a1d00de940429fc1cc6131ac22b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:32.007360 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e5c88fbd-8ade-40ab-9770-6689b807a1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:32.020869 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e102f4-75e2-4e08-80b8-254a8b0d0d18 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:32.037295 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1b4f3-3332-473c-8a45-656d14ef7f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:32.039791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1b4f3-3332-473c-8a45-656d14ef7f57 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:32.041634 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1b4f3-3332-473c-8a45-656d14ef7f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:32.042089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1b4f3-3332-473c-8a45-656d14ef7f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:32.107496 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 810/1617] 10.222.0.20 () {58 vars in 1059 bytes} [Sun Sep 11 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:32.108482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c88fbd-8ade-40ab-9770-6689b807a1ac None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:32.122062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:32.163121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1b4f3-3332-473c-8a45-656d14ef7f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:32.166881 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1b4f3-3332-473c-8a45-656d14ef7f57 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:32.184163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 808/1618] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:32.185061 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1b4f3-3332-473c-8a45-656d14ef7f57 service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:32.203495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1b4f3-3332-473c-8a45-656d14ef7f57 service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:32.210487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524235e-ed09-4d80-84d6-b6bcd60e17c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:32.211375 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524235e-ed09-4d80-84d6-b6bcd60e17c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:32.211747 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524235e-ed09-4d80-84d6-b6bcd60e17c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:32.212116 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524235e-ed09-4d80-84d6-b6bcd60e17c8 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:32.213007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524235e-ed09-4d80-84d6-b6bcd60e17c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:32.215909 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524235e-ed09-4d80-84d6-b6bcd60e17c8 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:32.216509 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c88fbd-8ade-40ab-9770-6689b807a1ac None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:32.227080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a3126-b025-4a0a-b5de-039228e9db21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:32.238488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3126-b025-4a0a-b5de-039228e9db21 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:32.238488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3126-b025-4a0a-b5de-039228e9db21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:32.238488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3126-b025-4a0a-b5de-039228e9db21 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:32.238488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a3126-b025-4a0a-b5de-039228e9db21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:32.238488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a3126-b025-4a0a-b5de-039228e9db21 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:32.249191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 809/1619] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:32 2022] POST /identity/v3/users => generated 291 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:32.251919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b60e46-94bc-472a-af3a-1445542be767 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:32.252930 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b60e46-94bc-472a-af3a-1445542be767 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:32.253246 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b60e46-94bc-472a-af3a-1445542be767 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:32.257174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 810/1620] 10.222.0.20 () {54 vars in 962 bytes} [Sun Sep 11 10:46:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:46:32.257798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b60e46-94bc-472a-af3a-1445542be767 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:32.275706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 811/1621] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:32 2022] POST /identity/v3/projects => generated 405 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:32.276714 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a3126-b025-4a0a-b5de-039228e9db21 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:32.278682 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b60e46-94bc-472a-af3a-1445542be767 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:32.364525 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9c56a-5979-4170-af10-0c76c54ab690 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:32.365303 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9c56a-5979-4170-af10-0c76c54ab690 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:32.365537 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9c56a-5979-4170-af10-0c76c54ab690 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:32.365876 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9c56a-5979-4170-af10-0c76c54ab690 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:32.376366 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:32.393595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a3126-b025-4a0a-b5de-039228e9db21 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:32.399495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7f7d3-4da7-40bb-99af-287281e87f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:32.401285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f7d3-4da7-40bb-99af-287281e87f86 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:32.401737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f7d3-4da7-40bb-99af-287281e87f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:32.402160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f7d3-4da7-40bb-99af-287281e87f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:32.403004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7f7d3-4da7-40bb-99af-287281e87f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:32.405201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7f7d3-4da7-40bb-99af-287281e87f86 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:32.423209 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 812/1622] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:32.425534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271632f-76f0-46fe-a083-0de998c4913a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:32.425850 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271632f-76f0-46fe-a083-0de998c4913a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:32.426149 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271632f-76f0-46fe-a083-0de998c4913a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:32.449492 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-0271632f-76f0-46fe-a083-0de998c4913a None None] MFA Rules not processed for user `b642a1d00de940429fc1cc6131ac22b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:32.450760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0271632f-76f0-46fe-a083-0de998c4913a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:32.462907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9c56a-5979-4170-af10-0c76c54ab690 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:32.465886 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9c56a-5979-4170-af10-0c76c54ab690 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:32.467056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 813/1623] 10.222.0.20 () {58 vars in 1059 bytes} [Sun Sep 11 10:46:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:32.467899 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271632f-76f0-46fe-a083-0de998c4913a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:32.479620 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271632f-76f0-46fe-a083-0de998c4913a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:32.491524 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 811/1624] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:32.492357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9c56a-5979-4170-af10-0c76c54ab690 service nova] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:32.503159 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c00f5-37aa-4b27-80c8-8a31be6be4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:32.503797 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c00f5-37aa-4b27-80c8-8a31be6be4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:32.504076 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c00f5-37aa-4b27-80c8-8a31be6be4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:32.504348 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c00f5-37aa-4b27-80c8-8a31be6be4a1 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:32.508998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c00f5-37aa-4b27-80c8-8a31be6be4a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:32.511012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c00f5-37aa-4b27-80c8-8a31be6be4a1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:32.518988 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9c56a-5979-4170-af10-0c76c54ab690 service nova] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:32.527799 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1cbf3-d688-414e-9f0e-b85e9ba938b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:32.529567 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1cbf3-d688-414e-9f0e-b85e9ba938b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:32.529855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1cbf3-d688-414e-9f0e-b85e9ba938b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:32.530134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1cbf3-d688-414e-9f0e-b85e9ba938b2 admin admin] PATH_INFO: `/v3/projects/6e2be19bd3024443b6f9d6792cd0358c/users/fa274374be7b47a0b00083aacee2f2f1/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:32.566189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1cbf3-d688-414e-9f0e-b85e9ba938b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2be19bd3024443b6f9d6792cd0358c, user_id=fa274374be7b47a0b00083aacee2f2f1, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:32.573611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1cbf3-d688-414e-9f0e-b85e9ba938b2 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:32.574080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 814/1625] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:32 2022] POST /identity/v3/users => generated 309 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:32.575233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c00f5-37aa-4b27-80c8-8a31be6be4a1 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:32.606206 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 812/1626] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:32 2022] PUT /identity/v3/projects/6e2be19bd3024443b6f9d6792cd0358c/users/fa274374be7b47a0b00083aacee2f2f1/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:32.608789 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1cbf3-d688-414e-9f0e-b85e9ba938b2 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:32.611765 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c00f5-37aa-4b27-80c8-8a31be6be4a1 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:32.684384 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:32.754169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1cbf3-d688-414e-9f0e-b85e9ba938b2 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:32.769361 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b57f8-2a8a-4c8e-8600-902e86b4e591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:32.770328 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b57f8-2a8a-4c8e-8600-902e86b4e591 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:32.770971 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b57f8-2a8a-4c8e-8600-902e86b4e591 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:32.771528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b57f8-2a8a-4c8e-8600-902e86b4e591 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:32.772395 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b57f8-2a8a-4c8e-8600-902e86b4e591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:32.774697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b57f8-2a8a-4c8e-8600-902e86b4e591 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:32.810586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 813/1627] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:32.810586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b57f8-2a8a-4c8e-8600-902e86b4e591 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:32.823677 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08cfaa-a4ba-4f27-b6a6-67435d9dfa6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:32.824415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08cfaa-a4ba-4f27-b6a6-67435d9dfa6f service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:32.824783 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08cfaa-a4ba-4f27-b6a6-67435d9dfa6f service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:32.825124 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08cfaa-a4ba-4f27-b6a6-67435d9dfa6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:32.852812 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b57f8-2a8a-4c8e-8600-902e86b4e591 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:32.866697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fb258-988b-4bb0-92f1-d709f7f93877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:32.867845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fb258-988b-4bb0-92f1-d709f7f93877 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:32.868969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fb258-988b-4bb0-92f1-d709f7f93877 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:32.870187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fb258-988b-4bb0-92f1-d709f7f93877 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:32.870981 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fb258-988b-4bb0-92f1-d709f7f93877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:32.879130 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fb258-988b-4bb0-92f1-d709f7f93877 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:32.905511 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 814/1628] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:32.906423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fb258-988b-4bb0-92f1-d709f7f93877 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:32.945297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fb258-988b-4bb0-92f1-d709f7f93877 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:32.960943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bd006-ce9d-43be-8737-0c53a557ed00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:32.963798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bd006-ce9d-43be-8737-0c53a557ed00 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:32.964089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bd006-ce9d-43be-8737-0c53a557ed00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:32.965346 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bd006-ce9d-43be-8737-0c53a557ed00 admin admin] PATH_INFO: `/v3/projects/7712ef6f602d414b9ebcdf099f61c2ed/users/b344313403e04b6c81287e2c89e58d76/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:32.993464 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08cfaa-a4ba-4f27-b6a6-67435d9dfa6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:32.998072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08cfaa-a4ba-4f27-b6a6-67435d9dfa6f service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:33.014367 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bd006-ce9d-43be-8737-0c53a557ed00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7712ef6f602d414b9ebcdf099f61c2ed, user_id=b344313403e04b6c81287e2c89e58d76, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:33.021633 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bd006-ce9d-43be-8737-0c53a557ed00 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:33.026555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 815/1629] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:33.027488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08cfaa-a4ba-4f27-b6a6-67435d9dfa6f service nova] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:33.050053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 815/1630] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:32 2022] PUT /identity/v3/projects/7712ef6f602d414b9ebcdf099f61c2ed/users/b344313403e04b6c81287e2c89e58d76/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:33.051377 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee27d9-026a-42a8-a672-0268d9a2356a None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:33.053445 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee27d9-026a-42a8-a672-0268d9a2356a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:33.053742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee27d9-026a-42a8-a672-0268d9a2356a None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:33.055339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08cfaa-a4ba-4f27-b6a6-67435d9dfa6f service nova] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:33.057248 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 816/1631] 10.222.0.20 () {54 vars in 912 bytes} [Sun Sep 11 10:46:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:46:33.058048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee27d9-026a-42a8-a672-0268d9a2356a None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:33.243404 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c57310-a251-4ba3-96c9-8d5110809bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:33.244224 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c57310-a251-4ba3-96c9-8d5110809bce admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:33.244509 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c57310-a251-4ba3-96c9-8d5110809bce admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:33.244807 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c57310-a251-4ba3-96c9-8d5110809bce admin admin] PATH_INFO: `/v3/projects/6e2be19bd3024443b6f9d6792cd0358c/users/fa274374be7b47a0b00083aacee2f2f1/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:33.251364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c57310-a251-4ba3-96c9-8d5110809bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2be19bd3024443b6f9d6792cd0358c, user_id=fa274374be7b47a0b00083aacee2f2f1, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:33.262317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c57310-a251-4ba3-96c9-8d5110809bce admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:33.269731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:33.274132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee27d9-026a-42a8-a672-0268d9a2356a None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:33.289483 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ca70c-536e-4c38-8242-7a8d87b1250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:33.295723 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ca70c-536e-4c38-8242-7a8d87b1250f admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:33.296757 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ca70c-536e-4c38-8242-7a8d87b1250f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:33.296879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 816/1632] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:33 2022] PUT /identity/v3/projects/6e2be19bd3024443b6f9d6792cd0358c/users/fa274374be7b47a0b00083aacee2f2f1/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:33.297606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ca70c-536e-4c38-8242-7a8d87b1250f admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:33.298963 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ca70c-536e-4c38-8242-7a8d87b1250f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:33.301561 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ca70c-536e-4c38-8242-7a8d87b1250f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:33.309786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36866d49-da6a-4f02-9bac-4b73613604ae None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:33.310072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36866d49-da6a-4f02-9bac-4b73613604ae None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:33.310354 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36866d49-da6a-4f02-9bac-4b73613604ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:33.324936 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 817/1633] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:33.331597 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec52ad8-e9c5-4659-9278-4b5e4e9e47ee None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:33.332114 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec52ad8-e9c5-4659-9278-4b5e4e9e47ee None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:33.332657 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec52ad8-e9c5-4659-9278-4b5e4e9e47ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:33.366121 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-36866d49-da6a-4f02-9bac-4b73613604ae None None] MFA Rules not processed for user `b642a1d00de940429fc1cc6131ac22b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:33.367394 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-36866d49-da6a-4f02-9bac-4b73613604ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:33.399871 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-6ec52ad8-e9c5-4659-9278-4b5e4e9e47ee None None] MFA Rules not processed for user `fa274374be7b47a0b00083aacee2f2f1`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:33.401395 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6ec52ad8-e9c5-4659-9278-4b5e4e9e47ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:33.492600 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 817/1634] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 10:46:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:33.493570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36866d49-da6a-4f02-9bac-4b73613604ae None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:33.564050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 818/1635] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:33.565540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec52ad8-e9c5-4659-9278-4b5e4e9e47ee None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:33.593852 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:33.609190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36866d49-da6a-4f02-9bac-4b73613604ae None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:33.616217 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a29aa-a835-407d-b296-7c9c1f6313d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:33.617565 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a29aa-a835-407d-b296-7c9c1f6313d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:33.617907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a29aa-a835-407d-b296-7c9c1f6313d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:33.618188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a29aa-a835-407d-b296-7c9c1f6313d5 admin admin] PATH_INFO: `/v3/projects/7712ef6f602d414b9ebcdf099f61c2ed/users/b344313403e04b6c81287e2c89e58d76/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:33.620443 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a29aa-a835-407d-b296-7c9c1f6313d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7712ef6f602d414b9ebcdf099f61c2ed, user_id=b344313403e04b6c81287e2c89e58d76, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:33.623772 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a29aa-a835-407d-b296-7c9c1f6313d5 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:33.649571 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 818/1636] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:33 2022] PUT /identity/v3/projects/7712ef6f602d414b9ebcdf099f61c2ed/users/b344313403e04b6c81287e2c89e58d76/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:33.651215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a29aa-a835-407d-b296-7c9c1f6313d5 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:33.699902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec52ad8-e9c5-4659-9278-4b5e4e9e47ee None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:33.845677 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a29aa-a835-407d-b296-7c9c1f6313d5 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:33.853163 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c1f03-cbff-4a96-a557-e35153463863 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:33.853408 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089d181-dad3-4049-a80e-831b645f22d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:33.853796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c1f03-cbff-4a96-a557-e35153463863 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:33.853986 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089d181-dad3-4049-a80e-831b645f22d7 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:33.854104 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c1f03-cbff-4a96-a557-e35153463863 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:33.854269 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089d181-dad3-4049-a80e-831b645f22d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:33.854381 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c1f03-cbff-4a96-a557-e35153463863 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:33.854545 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089d181-dad3-4049-a80e-831b645f22d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:33.945713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:34.023562 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c1f03-cbff-4a96-a557-e35153463863 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:34.025218 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c1f03-cbff-4a96-a557-e35153463863 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:34.045183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 819/1637] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:34.046583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a31652-8464-45a3-b7ad-dfe43766e0ca None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:34.048258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089d181-dad3-4049-a80e-831b645f22d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:34.049898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a31652-8464-45a3-b7ad-dfe43766e0ca None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:34.051220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a31652-8464-45a3-b7ad-dfe43766e0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:34.053441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089d181-dad3-4049-a80e-831b645f22d7 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:34.077753 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 819/1638] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:34.081127 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b6700-870a-4647-b930-369f6ab2235c None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:34.081484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b6700-870a-4647-b930-369f6ab2235c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:34.081849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b6700-870a-4647-b930-369f6ab2235c None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:34.085757 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 820/1639] 10.222.0.20 () {54 vars in 912 bytes} [Sun Sep 11 10:46:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:46:34.091526 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb36bc-3ac3-4a94-8715-ec577aaa7c7d None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:34.091908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb36bc-3ac3-4a94-8715-ec577aaa7c7d None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:34.092279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb36bc-3ac3-4a94-8715-ec577aaa7c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:34.141524 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e0bb36bc-3ac3-4a94-8715-ec577aaa7c7d None None] MFA Rules not processed for user `b642a1d00de940429fc1cc6131ac22b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:34.142913 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e0bb36bc-3ac3-4a94-8715-ec577aaa7c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:34.148665 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d6a31652-8464-45a3-b7ad-dfe43766e0ca None None] MFA Rules not processed for user `b344313403e04b6c81287e2c89e58d76`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:34.152855 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d6a31652-8464-45a3-b7ad-dfe43766e0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:34.169444 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 821/1640] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 10:46:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:34.216420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb36bc-3ac3-4a94-8715-ec577aaa7c7d None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:34.239463 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb36bc-3ac3-4a94-8715-ec577aaa7c7d None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:34.243680 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918912c9-0dd0-4eb8-bbd0-189523fc83ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:34.244674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918912c9-0dd0-4eb8-bbd0-189523fc83ba service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:34.244674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918912c9-0dd0-4eb8-bbd0-189523fc83ba service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:34.244898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918912c9-0dd0-4eb8-bbd0-189523fc83ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:34.273962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918912c9-0dd0-4eb8-bbd0-189523fc83ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:34.275393 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918912c9-0dd0-4eb8-bbd0-189523fc83ba service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:34.313755 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 822/1641] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:34.374473 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 820/1642] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:34 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:34.466112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918912c9-0dd0-4eb8-bbd0-189523fc83ba service cinder] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:34.478658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918912c9-0dd0-4eb8-bbd0-189523fc83ba service cinder] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:34.496884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822b46a-6517-4351-b299-8f72ab756ab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:34.498693 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48192c-557d-4e23-b45e-0278e88b5ebd None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:34.498979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48192c-557d-4e23-b45e-0278e88b5ebd None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:34.499255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48192c-557d-4e23-b45e-0278e88b5ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:34.502506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822b46a-6517-4351-b299-8f72ab756ab4 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:34.502795 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822b46a-6517-4351-b299-8f72ab756ab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:34.503072 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822b46a-6517-4351-b299-8f72ab756ab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:34.526549 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822b46a-6517-4351-b299-8f72ab756ab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:34.530157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822b46a-6517-4351-b299-8f72ab756ab4 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:34.567322 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 823/1643] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:34 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:34.588661 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7e48192c-557d-4e23-b45e-0278e88b5ebd None None] MFA Rules not processed for user `cb432e5b033540b7ac1eef7bdf44e90a`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:34.590220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7e48192c-557d-4e23-b45e-0278e88b5ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:34.746738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 821/1644] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:34 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:34.748107 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822b46a-6517-4351-b299-8f72ab756ab4 service cinder] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:34.866971 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:34.994495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48192c-557d-4e23-b45e-0278e88b5ebd None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:34.996889 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822b46a-6517-4351-b299-8f72ab756ab4 service cinder] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:34.996889 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a08613-644e-41c2-a6f5-af21195c3669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:34.996889 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a08613-644e-41c2-a6f5-af21195c3669 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:34.996889 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a08613-644e-41c2-a6f5-af21195c3669 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:34.997907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a08613-644e-41c2-a6f5-af21195c3669 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:34.997907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a08613-644e-41c2-a6f5-af21195c3669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:34.998040 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48192c-557d-4e23-b45e-0278e88b5ebd None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:34.999189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a08613-644e-41c2-a6f5-af21195c3669 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:34.999287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769b5e6-a483-40ee-a7f7-f51ad40d29d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:34.999287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769b5e6-a483-40ee-a7f7-f51ad40d29d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:34.999287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769b5e6-a483-40ee-a7f7-f51ad40d29d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:34.999287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769b5e6-a483-40ee-a7f7-f51ad40d29d4 admin admin] PATH_INFO: `/v3/users/2fe59ff9bd6d4eb7ab6386550746a12c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:35.000259 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769b5e6-a483-40ee-a7f7-f51ad40d29d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fe59ff9bd6d4eb7ab6386550746a12c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:35.003418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: WARNING py.warnings [None req-0769b5e6-a483-40ee-a7f7-f51ad40d29d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 10:46:35.003418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: warnings.warn(msg) Sep 11 10:46:35.003418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: Sep 11 10:46:35.008468 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769b5e6-a483-40ee-a7f7-f51ad40d29d4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:35.094679 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 824/1645] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:34 2022] POST /identity/v3/projects => generated 403 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:35.102035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a08613-644e-41c2-a6f5-af21195c3669 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:35.150100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:35.173145 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0769b5e6-a483-40ee-a7f7-f51ad40d29d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fe59ff9bd6d4eb7ab6386550746a12c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:35.189001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0769b5e6-a483-40ee-a7f7-f51ad40d29d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fe59ff9bd6d4eb7ab6386550746a12c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:35.189824 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0769b5e6-a483-40ee-a7f7-f51ad40d29d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fe59ff9bd6d4eb7ab6386550746a12c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:35.197115 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0769b5e6-a483-40ee-a7f7-f51ad40d29d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fe59ff9bd6d4eb7ab6386550746a12c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:35.226551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0769b5e6-a483-40ee-a7f7-f51ad40d29d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fe59ff9bd6d4eb7ab6386550746a12c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:35.296886 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a08613-644e-41c2-a6f5-af21195c3669 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:35.306043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e668dd8-c443-431d-b622-8ebfcf87ac0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:35.306850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e668dd8-c443-431d-b622-8ebfcf87ac0c admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:35.307200 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e668dd8-c443-431d-b622-8ebfcf87ac0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:35.307559 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e668dd8-c443-431d-b622-8ebfcf87ac0c admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:35.308204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e668dd8-c443-431d-b622-8ebfcf87ac0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:35.314023 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e668dd8-c443-431d-b622-8ebfcf87ac0c admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:35.335788 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 822/1646] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:46:34 2022] DELETE /identity/v3/users/2fe59ff9bd6d4eb7ab6386550746a12c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:46:35.340287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769b5e6-a483-40ee-a7f7-f51ad40d29d4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:35.356441 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0769b5e6-a483-40ee-a7f7-f51ad40d29d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:35.372516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 825/1647] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:35 2022] POST /identity/v3/users => generated 308 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:35.372516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811ff7f-06e2-4d55-a9fe-a99e61a08593 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:35.372516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811ff7f-06e2-4d55-a9fe-a99e61a08593 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:35.372516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811ff7f-06e2-4d55-a9fe-a99e61a08593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:35.411861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-7811ff7f-06e2-4d55-a9fe-a99e61a08593 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:35.413150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7811ff7f-06e2-4d55-a9fe-a99e61a08593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:35.594248 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769b5e6-a483-40ee-a7f7-f51ad40d29d4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:35.611048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 826/1648] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:35.611889 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811ff7f-06e2-4d55-a9fe-a99e61a08593 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:35.615595 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7811ff7f-06e2-4d55-a9fe-a99e61a08593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:35.622157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0039f1-1b53-4213-8fff-349ec134a3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:35.623094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0039f1-1b53-4213-8fff-349ec134a3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:35.623575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0039f1-1b53-4213-8fff-349ec134a3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:35.624092 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0039f1-1b53-4213-8fff-349ec134a3f9 admin admin] PATH_INFO: `/v3/users/3cb0938a89e14ad682ad53311c322faf` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:35.627018 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0039f1-1b53-4213-8fff-349ec134a3f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cb0938a89e14ad682ad53311c322faf)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:35.629886 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0039f1-1b53-4213-8fff-349ec134a3f9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:35.660013 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811ff7f-06e2-4d55-a9fe-a99e61a08593 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:35.683012 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27629ac9-c0e1-4113-9966-9bbbdc3cade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:35.685849 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27629ac9-c0e1-4113-9966-9bbbdc3cade7 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:35.689068 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27629ac9-c0e1-4113-9966-9bbbdc3cade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:35.692805 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27629ac9-c0e1-4113-9966-9bbbdc3cade7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:35.693617 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27629ac9-c0e1-4113-9966-9bbbdc3cade7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:35.695385 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27629ac9-c0e1-4113-9966-9bbbdc3cade7 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:35.740044 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 827/1649] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:35.742550 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27629ac9-c0e1-4113-9966-9bbbdc3cade7 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:35.748429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-27629ac9-c0e1-4113-9966-9bbbdc3cade7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:35.769957 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fe0039f1-1b53-4213-8fff-349ec134a3f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cb0938a89e14ad682ad53311c322faf'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:35.803368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fe0039f1-1b53-4213-8fff-349ec134a3f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cb0938a89e14ad682ad53311c322faf'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:35.804104 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fe0039f1-1b53-4213-8fff-349ec134a3f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cb0938a89e14ad682ad53311c322faf'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:35.805168 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fe0039f1-1b53-4213-8fff-349ec134a3f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cb0938a89e14ad682ad53311c322faf'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:35.827524 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fe0039f1-1b53-4213-8fff-349ec134a3f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cb0938a89e14ad682ad53311c322faf'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:35.888519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:35.901615 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 823/1650] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:46:35 2022] DELETE /identity/v3/users/3cb0938a89e14ad682ad53311c322faf => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:35.902758 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0039f1-1b53-4213-8fff-349ec134a3f9 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:35.905242 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fe0039f1-1b53-4213-8fff-349ec134a3f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:35.933938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27629ac9-c0e1-4113-9966-9bbbdc3cade7 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:36.045828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:36.055160 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3590d3-1ede-4845-abeb-8fd1da49a3ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:36.059844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3590d3-1ede-4845-abeb-8fd1da49a3ef service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:36.060355 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3590d3-1ede-4845-abeb-8fd1da49a3ef service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:36.061287 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3590d3-1ede-4845-abeb-8fd1da49a3ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:36.067083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-bf3590d3-1ede-4845-abeb-8fd1da49a3ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:36.139357 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0039f1-1b53-4213-8fff-349ec134a3f9 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:36.163069 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690276eb-f3ac-4410-bc2c-e32d0eb75ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:36.163898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690276eb-f3ac-4410-bc2c-e32d0eb75ecc admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:36.164302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690276eb-f3ac-4410-bc2c-e32d0eb75ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:36.164744 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690276eb-f3ac-4410-bc2c-e32d0eb75ecc admin admin] PATH_INFO: `/v3/projects/fbe8ff6601984d8197cdc7c234c9a05f/users/7c29e3dab8b444c69b8b78806e5ff376/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:36.199401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690276eb-f3ac-4410-bc2c-e32d0eb75ecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe8ff6601984d8197cdc7c234c9a05f, user_id=7c29e3dab8b444c69b8b78806e5ff376, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:36.203644 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690276eb-f3ac-4410-bc2c-e32d0eb75ecc admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:36.271281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 824/1651] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:35 2022] PUT /identity/v3/projects/fbe8ff6601984d8197cdc7c234c9a05f/users/7c29e3dab8b444c69b8b78806e5ff376/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:36.272991 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066e28f-ccb3-4baf-aed8-6326235b153d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:36.273414 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066e28f-ccb3-4baf-aed8-6326235b153d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:36.274068 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066e28f-ccb3-4baf-aed8-6326235b153d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:36.288168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3590d3-1ede-4845-abeb-8fd1da49a3ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:36.289836 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3590d3-1ede-4845-abeb-8fd1da49a3ef service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:36.309890 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3066e28f-ccb3-4baf-aed8-6326235b153d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:36.313106 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3066e28f-ccb3-4baf-aed8-6326235b153d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:36.328474 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 828/1652] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:36.328474 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3590d3-1ede-4845-abeb-8fd1da49a3ef service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:36.351417 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3590d3-1ede-4845-abeb-8fd1da49a3ef service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:36.549063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439e141-fba7-479f-a6dc-b386e5530df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:36.549871 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439e141-fba7-479f-a6dc-b386e5530df8 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:36.550769 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439e141-fba7-479f-a6dc-b386e5530df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:36.552247 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439e141-fba7-479f-a6dc-b386e5530df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:36.557380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439e141-fba7-479f-a6dc-b386e5530df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:36.557895 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 825/1653] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:36.559596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439e141-fba7-479f-a6dc-b386e5530df8 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:36.592910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 829/1654] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:36.597703 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066e28f-ccb3-4baf-aed8-6326235b153d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:36.599517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3066e28f-ccb3-4baf-aed8-6326235b153d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:36.601747 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439e141-fba7-479f-a6dc-b386e5530df8 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:36.635883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439e141-fba7-479f-a6dc-b386e5530df8 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:36.661340 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605aa81-e04e-40c7-b1bb-f397f4087df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:36.662221 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605aa81-e04e-40c7-b1bb-f397f4087df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:36.662616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605aa81-e04e-40c7-b1bb-f397f4087df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:36.663006 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605aa81-e04e-40c7-b1bb-f397f4087df5 admin admin] PATH_INFO: `/v3/projects/fbe8ff6601984d8197cdc7c234c9a05f/users/7c29e3dab8b444c69b8b78806e5ff376/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:36.672929 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605aa81-e04e-40c7-b1bb-f397f4087df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe8ff6601984d8197cdc7c234c9a05f, user_id=7c29e3dab8b444c69b8b78806e5ff376, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:36.676343 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605aa81-e04e-40c7-b1bb-f397f4087df5 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:36.731316 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 830/1655] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:36 2022] PUT /identity/v3/projects/fbe8ff6601984d8197cdc7c234c9a05f/users/7c29e3dab8b444c69b8b78806e5ff376/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:36.777766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066e28f-ccb3-4baf-aed8-6326235b153d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:36.892597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222a17b-3f51-424f-af60-80a6d0935df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:36.894071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222a17b-3f51-424f-af60-80a6d0935df7 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:36.894395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222a17b-3f51-424f-af60-80a6d0935df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:36.894839 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222a17b-3f51-424f-af60-80a6d0935df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:36.969944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:37.083679 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222a17b-3f51-424f-af60-80a6d0935df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:37.086134 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222a17b-3f51-424f-af60-80a6d0935df7 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:37.109572 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 826/1656] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:37.942725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605aa81-e04e-40c7-b1bb-f397f4087df5 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:37.947314 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c605aa81-e04e-40c7-b1bb-f397f4087df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:37.977380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605aa81-e04e-40c7-b1bb-f397f4087df5 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:38.001248 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb14440-9660-4a5d-a68a-90b9b23cbe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:38.001915 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb14440-9660-4a5d-a68a-90b9b23cbe09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:38.002770 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb14440-9660-4a5d-a68a-90b9b23cbe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:38.003218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb14440-9660-4a5d-a68a-90b9b23cbe09 admin admin] PATH_INFO: `/v3/projects/cc739bb11f724380b7c66dcd73c4d9ad` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:38.009141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb14440-9660-4a5d-a68a-90b9b23cbe09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc739bb11f724380b7c66dcd73c4d9ad)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:38.010202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: WARNING py.warnings [None req-ccb14440-9660-4a5d-a68a-90b9b23cbe09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 10:46:38.010202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: warnings.warn(msg) Sep 11 10:46:38.010202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: Sep 11 10:46:38.011602 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb14440-9660-4a5d-a68a-90b9b23cbe09 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:38.082142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:38.159732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ccb14440-9660-4a5d-a68a-90b9b23cbe09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc739bb11f724380b7c66dcd73c4d9ad', 'request_id': 'req-ccb14440-9660-4a5d-a68a-90b9b23cbe09'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:38.163654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222a17b-3f51-424f-af60-80a6d0935df7 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:38.166688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f222a17b-3f51-424f-af60-80a6d0935df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:38.183792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222a17b-3f51-424f-af60-80a6d0935df7 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:38.210509 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ccb14440-9660-4a5d-a68a-90b9b23cbe09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc739bb11f724380b7c66dcd73c4d9ad', 'request_id': 'req-ccb14440-9660-4a5d-a68a-90b9b23cbe09'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:38.230477 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ccb14440-9660-4a5d-a68a-90b9b23cbe09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc739bb11f724380b7c66dcd73c4d9ad', 'request_id': 'req-ccb14440-9660-4a5d-a68a-90b9b23cbe09'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:38.267481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ccb14440-9660-4a5d-a68a-90b9b23cbe09 admin admin] The token cache is being invalidate because project cc739bb11f724380b7c66dcd73c4d9ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:46:38.267865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ccb14440-9660-4a5d-a68a-90b9b23cbe09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:38.269302 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ccb14440-9660-4a5d-a68a-90b9b23cbe09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:38.275539 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 831/1657] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:46:37 2022] DELETE /identity/v3/projects/cc739bb11f724380b7c66dcd73c4d9ad => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:38.282104 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07ee33-3077-4e5b-bb2c-10890b318edf None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:38.282104 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07ee33-3077-4e5b-bb2c-10890b318edf None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:38.282879 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07ee33-3077-4e5b-bb2c-10890b318edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:38.312127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0a69f-d742-48ed-82af-14669c366a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:38.312821 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0a69f-d742-48ed-82af-14669c366a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:38.313097 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0a69f-d742-48ed-82af-14669c366a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:38.313372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0a69f-d742-48ed-82af-14669c366a3c admin admin] PATH_INFO: `/v3/users/4214b219280a40318279a949dd5e434b` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:38.315821 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0a69f-d742-48ed-82af-14669c366a3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4214b219280a40318279a949dd5e434b)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:38.317804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0a69f-d742-48ed-82af-14669c366a3c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:38.330461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-ea07ee33-3077-4e5b-bb2c-10890b318edf None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:38.331880 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ea07ee33-3077-4e5b-bb2c-10890b318edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:38.356349 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 832/1658] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:46:38.367723 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719bd7f-a502-44cf-82de-52a84fd7eede None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:38.368909 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719bd7f-a502-44cf-82de-52a84fd7eede None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:38.369369 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719bd7f-a502-44cf-82de-52a84fd7eede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:38.420139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-1719bd7f-a502-44cf-82de-52a84fd7eede None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:38.421563 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-1719bd7f-a502-44cf-82de-52a84fd7eede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:38.426110 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-57f0a69f-d742-48ed-82af-14669c366a3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4214b219280a40318279a949dd5e434b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:38.443692 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 833/1659] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:38.448186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719bd7f-a502-44cf-82de-52a84fd7eede None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:38.448731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-57f0a69f-d742-48ed-82af-14669c366a3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4214b219280a40318279a949dd5e434b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:38.449497 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-57f0a69f-d742-48ed-82af-14669c366a3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4214b219280a40318279a949dd5e434b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:38.450228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-57f0a69f-d742-48ed-82af-14669c366a3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4214b219280a40318279a949dd5e434b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:38.464170 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-57f0a69f-d742-48ed-82af-14669c366a3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4214b219280a40318279a949dd5e434b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:38.466350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719bd7f-a502-44cf-82de-52a84fd7eede None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:38.483160 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b7fb8-2eca-41ca-b98c-b950b5bb0d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:38.483848 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b7fb8-2eca-41ca-b98c-b950b5bb0d88 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:38.484075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b7fb8-2eca-41ca-b98c-b950b5bb0d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:38.484627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b7fb8-2eca-41ca-b98c-b950b5bb0d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:38.491659 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b7fb8-2eca-41ca-b98c-b950b5bb0d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:46:38.491659 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b7fb8-2eca-41ca-b98c-b950b5bb0d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:38.497178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b7fb8-2eca-41ca-b98c-b950b5bb0d88 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:38.504386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 827/1660] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:46:38 2022] DELETE /identity/v3/users/4214b219280a40318279a949dd5e434b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:38.506140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401b7f3-bb42-4637-9c6a-4f0ba545f374 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:38.506546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401b7f3-bb42-4637-9c6a-4f0ba545f374 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:38.507021 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401b7f3-bb42-4637-9c6a-4f0ba545f374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:38.531486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 834/1661] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:46:38.537233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b7fb8-2eca-41ca-b98c-b950b5bb0d88 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:38.550336 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-716b7fb8-2eca-41ca-b98c-b950b5bb0d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:38.551508 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f401b7f3-bb42-4637-9c6a-4f0ba545f374 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:38.554069 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f401b7f3-bb42-4637-9c6a-4f0ba545f374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:38.571470 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b7fb8-2eca-41ca-b98c-b950b5bb0d88 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:38.651301 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:38.721468 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 828/1662] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:46:38.723194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401b7f3-bb42-4637-9c6a-4f0ba545f374 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:38.727110 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618d516-354a-4e44-b1f2-c36e4e87284a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:38.727894 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f401b7f3-bb42-4637-9c6a-4f0ba545f374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:38.731062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618d516-354a-4e44-b1f2-c36e4e87284a admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:38.731356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618d516-354a-4e44-b1f2-c36e4e87284a admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:38.731773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618d516-354a-4e44-b1f2-c36e4e87284a admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:38.733970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618d516-354a-4e44-b1f2-c36e4e87284a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:38.737661 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618d516-354a-4e44-b1f2-c36e4e87284a admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:38.745742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401b7f3-bb42-4637-9c6a-4f0ba545f374 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:38.751245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc572b0c-0228-4959-ae71-031d31162f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:38.752848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc572b0c-0228-4959-ae71-031d31162f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:38.753354 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc572b0c-0228-4959-ae71-031d31162f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:38.753856 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc572b0c-0228-4959-ae71-031d31162f22 admin admin] PATH_INFO: `/v3/users/a4fbe9b7d2964118b012fbd6c41f219e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:38.755452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc572b0c-0228-4959-ae71-031d31162f22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4fbe9b7d2964118b012fbd6c41f219e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:38.759635 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc572b0c-0228-4959-ae71-031d31162f22 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:38.787183 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 835/1663] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:38 2022] POST /identity/v3/projects => generated 365 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:46:38.791052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618d516-354a-4e44-b1f2-c36e4e87284a admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:38.869841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-dc572b0c-0228-4959-ae71-031d31162f22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4fbe9b7d2964118b012fbd6c41f219e'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:38.882701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-dc572b0c-0228-4959-ae71-031d31162f22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4fbe9b7d2964118b012fbd6c41f219e'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:38.883479 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-dc572b0c-0228-4959-ae71-031d31162f22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4fbe9b7d2964118b012fbd6c41f219e'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:38.886455 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-dc572b0c-0228-4959-ae71-031d31162f22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4fbe9b7d2964118b012fbd6c41f219e'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:38.899751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-dc572b0c-0228-4959-ae71-031d31162f22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4fbe9b7d2964118b012fbd6c41f219e'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:38.933068 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618d516-354a-4e44-b1f2-c36e4e87284a admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:38.943410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 829/1664] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:46:38 2022] DELETE /identity/v3/users/a4fbe9b7d2964118b012fbd6c41f219e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:38.943410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc572b0c-0228-4959-ae71-031d31162f22 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:38.971185 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ef746-9a37-402e-ad28-892d8e6367d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:38.972352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ef746-9a37-402e-ad28-892d8e6367d9 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:38.972641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ef746-9a37-402e-ad28-892d8e6367d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:38.972929 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ef746-9a37-402e-ad28-892d8e6367d9 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:38.974003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-dc572b0c-0228-4959-ae71-031d31162f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:38.979630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ef746-9a37-402e-ad28-892d8e6367d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:38.981747 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ef746-9a37-402e-ad28-892d8e6367d9 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:39.032283 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:39.042193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 836/1665] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:38 2022] POST /identity/v3/users => generated 283 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:39.043092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ef746-9a37-402e-ad28-892d8e6367d9 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:39.051802 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e77ef746-9a37-402e-ad28-892d8e6367d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:39.080105 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ef746-9a37-402e-ad28-892d8e6367d9 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:39.139149 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc572b0c-0228-4959-ae71-031d31162f22 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:39.151253 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331b638-59f3-40da-b8e8-1485d1b3bb18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:39.152473 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331b638-59f3-40da-b8e8-1485d1b3bb18 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:39.152802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331b638-59f3-40da-b8e8-1485d1b3bb18 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:39.153078 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331b638-59f3-40da-b8e8-1485d1b3bb18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:39.157604 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d331b638-59f3-40da-b8e8-1485d1b3bb18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:39.259700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cfda5f-5c66-4d42-9784-beec98009bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:39.260774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfda5f-5c66-4d42-9784-beec98009bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:39.261111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfda5f-5c66-4d42-9784-beec98009bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:39.261345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfda5f-5c66-4d42-9784-beec98009bc6 admin admin] PATH_INFO: `/v3/projects/1c94d29d8a084cb19dc192b1bc431e87` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:39.265995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cfda5f-5c66-4d42-9784-beec98009bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c94d29d8a084cb19dc192b1bc431e87)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:39.274182 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cfda5f-5c66-4d42-9784-beec98009bc6 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:39.362786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331b638-59f3-40da-b8e8-1485d1b3bb18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:39.364253 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331b638-59f3-40da-b8e8-1485d1b3bb18 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:39.382277 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 830/1666] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:39.398330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100aff3-cd5f-4636-b308-1ab7597ee490 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:39.399022 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100aff3-cd5f-4636-b308-1ab7597ee490 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:39.399441 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100aff3-cd5f-4636-b308-1ab7597ee490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:39.424817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:39.426664 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-47cfda5f-5c66-4d42-9784-beec98009bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c94d29d8a084cb19dc192b1bc431e87', 'request_id': 'req-47cfda5f-5c66-4d42-9784-beec98009bc6'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:39.433621 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9100aff3-cd5f-4636-b308-1ab7597ee490 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:39.436134 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9100aff3-cd5f-4636-b308-1ab7597ee490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:39.463227 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-47cfda5f-5c66-4d42-9784-beec98009bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c94d29d8a084cb19dc192b1bc431e87', 'request_id': 'req-47cfda5f-5c66-4d42-9784-beec98009bc6'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:39.488393 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-47cfda5f-5c66-4d42-9784-beec98009bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c94d29d8a084cb19dc192b1bc431e87', 'request_id': 'req-47cfda5f-5c66-4d42-9784-beec98009bc6'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:39.522350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-47cfda5f-5c66-4d42-9784-beec98009bc6 admin admin] The token cache is being invalidate because project 1c94d29d8a084cb19dc192b1bc431e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:46:39.523209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-47cfda5f-5c66-4d42-9784-beec98009bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:39.529793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-47cfda5f-5c66-4d42-9784-beec98009bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:39.531896 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 837/1667] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:46:39 2022] DELETE /identity/v3/projects/1c94d29d8a084cb19dc192b1bc431e87 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:39.532907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cfda5f-5c66-4d42-9784-beec98009bc6 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:39.536439 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-47cfda5f-5c66-4d42-9784-beec98009bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:39.573488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 831/1668] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:39.574571 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100aff3-cd5f-4636-b308-1ab7597ee490 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:39.576803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9100aff3-cd5f-4636-b308-1ab7597ee490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:39.630971 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100aff3-cd5f-4636-b308-1ab7597ee490 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:39.644057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92526c82-d756-493d-93b9-8df2c4673ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:39.645072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92526c82-d756-493d-93b9-8df2c4673ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:39.647251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92526c82-d756-493d-93b9-8df2c4673ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:39.649463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92526c82-d756-493d-93b9-8df2c4673ec3 admin admin] PATH_INFO: `/v3/users/b344313403e04b6c81287e2c89e58d76` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:39.653865 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92526c82-d756-493d-93b9-8df2c4673ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b344313403e04b6c81287e2c89e58d76)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:39.660262 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92526c82-d756-493d-93b9-8df2c4673ec3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:39.688133 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cfda5f-5c66-4d42-9784-beec98009bc6 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:39.703813 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6947-412e-4911-8b5d-c7d31bd3f706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:39.707301 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6947-412e-4911-8b5d-c7d31bd3f706 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:39.707799 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6947-412e-4911-8b5d-c7d31bd3f706 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:39.707939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6947-412e-4911-8b5d-c7d31bd3f706 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:39.708740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6947-412e-4911-8b5d-c7d31bd3f706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:39.710630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6947-412e-4911-8b5d-c7d31bd3f706 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:39.727916 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 838/1669] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:39.729211 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6947-412e-4911-8b5d-c7d31bd3f706 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:39.732164 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0d1d6947-412e-4911-8b5d-c7d31bd3f706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:39.764752 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-92526c82-d756-493d-93b9-8df2c4673ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b344313403e04b6c81287e2c89e58d76'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:39.777206 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:39.782598 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-92526c82-d756-493d-93b9-8df2c4673ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b344313403e04b6c81287e2c89e58d76'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:39.783936 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-92526c82-d756-493d-93b9-8df2c4673ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b344313403e04b6c81287e2c89e58d76'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:39.784842 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-92526c82-d756-493d-93b9-8df2c4673ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b344313403e04b6c81287e2c89e58d76'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:39.799727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-92526c82-d756-493d-93b9-8df2c4673ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b344313403e04b6c81287e2c89e58d76'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:39.836086 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6947-412e-4911-8b5d-c7d31bd3f706 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:39.840358 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108638f-696c-47c5-97ba-7b4fbf2d5655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:39.841223 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108638f-696c-47c5-97ba-7b4fbf2d5655 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:39.841675 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108638f-696c-47c5-97ba-7b4fbf2d5655 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:39.841952 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108638f-696c-47c5-97ba-7b4fbf2d5655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:39.845037 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 832/1670] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:46:39 2022] DELETE /identity/v3/users/b344313403e04b6c81287e2c89e58d76 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:39.845037 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92526c82-d756-493d-93b9-8df2c4673ec3 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:39.847451 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-92526c82-d756-493d-93b9-8df2c4673ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:39.848305 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0108638f-696c-47c5-97ba-7b4fbf2d5655 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:39.868863 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108638f-696c-47c5-97ba-7b4fbf2d5655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:39.870577 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108638f-696c-47c5-97ba-7b4fbf2d5655 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:39.893164 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 839/1671] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:39.974333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92526c82-d756-493d-93b9-8df2c4673ec3 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:39.985219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9dd03-a9a4-462f-8084-6309977ac533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:39.987287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9dd03-a9a4-462f-8084-6309977ac533 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:39.987779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9dd03-a9a4-462f-8084-6309977ac533 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:39.988113 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9dd03-a9a4-462f-8084-6309977ac533 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:39.988858 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9dd03-a9a4-462f-8084-6309977ac533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:39.992007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9dd03-a9a4-462f-8084-6309977ac533 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:40.018298 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 833/1672] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:40.024278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108638f-696c-47c5-97ba-7b4fbf2d5655 service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:40.045630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108638f-696c-47c5-97ba-7b4fbf2d5655 service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:40.051715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe3831-5df6-4f3c-908c-310b3b5a6334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:40.052424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe3831-5df6-4f3c-908c-310b3b5a6334 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:40.052793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe3831-5df6-4f3c-908c-310b3b5a6334 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:40.053071 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe3831-5df6-4f3c-908c-310b3b5a6334 admin admin] PATH_INFO: `/v3/projects/89ce7fd1a5524d36b9c4bd9a819d40be/users/4097239580e1462c8bbab3ab9281c7bb/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:40.088005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe3831-5df6-4f3c-908c-310b3b5a6334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ce7fd1a5524d36b9c4bd9a819d40be, user_id=4097239580e1462c8bbab3ab9281c7bb, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:40.092036 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe3831-5df6-4f3c-908c-310b3b5a6334 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:40.129256 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79fb51-da07-4cb8-ad33-a24f96f97867 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:40.129479 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79fb51-da07-4cb8-ad33-a24f96f97867 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:40.129639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79fb51-da07-4cb8-ad33-a24f96f97867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:40.130273 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 840/1673] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:40 2022] PUT /identity/v3/projects/89ce7fd1a5524d36b9c4bd9a819d40be/users/4097239580e1462c8bbab3ab9281c7bb/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:40.171818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ef79fb51-da07-4cb8-ad33-a24f96f97867 None None] MFA Rules not processed for user `4097239580e1462c8bbab3ab9281c7bb`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:40.173100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ef79fb51-da07-4cb8-ad33-a24f96f97867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:40.177987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:40.258895 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 834/1674] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:40.262274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe3831-5df6-4f3c-908c-310b3b5a6334 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:40.379172 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe3831-5df6-4f3c-908c-310b3b5a6334 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:40.389062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed16a06-99cf-4acc-8a92-c3151d594233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:40.390284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed16a06-99cf-4acc-8a92-c3151d594233 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:40.390718 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed16a06-99cf-4acc-8a92-c3151d594233 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:40.391479 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed16a06-99cf-4acc-8a92-c3151d594233 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:40.392315 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed16a06-99cf-4acc-8a92-c3151d594233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:40.395130 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed16a06-99cf-4acc-8a92-c3151d594233 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:40.443774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79fb51-da07-4cb8-ad33-a24f96f97867 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:40.456631 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 841/1675] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:40 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:40.463133 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79fb51-da07-4cb8-ad33-a24f96f97867 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:40.554920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3741113-92b2-4fd2-ba28-9759e653f79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:40.555645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3741113-92b2-4fd2-ba28-9759e653f79d admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:40.555931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3741113-92b2-4fd2-ba28-9759e653f79d admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:40.556291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3741113-92b2-4fd2-ba28-9759e653f79d admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:40.557426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3741113-92b2-4fd2-ba28-9759e653f79d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:40.559998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3741113-92b2-4fd2-ba28-9759e653f79d admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:40.590015 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 835/1676] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:40 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:40.594324 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed16a06-99cf-4acc-8a92-c3151d594233 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:40.607243 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed16a06-99cf-4acc-8a92-c3151d594233 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:40.627600 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac70d54-c3e9-4fb8-b8f9-5fe6f5fb4d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:40.628153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac70d54-c3e9-4fb8-b8f9-5fe6f5fb4d17 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:40.628440 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac70d54-c3e9-4fb8-b8f9-5fe6f5fb4d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:40.628745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac70d54-c3e9-4fb8-b8f9-5fe6f5fb4d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:40.629742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac70d54-c3e9-4fb8-b8f9-5fe6f5fb4d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:40.631438 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac70d54-c3e9-4fb8-b8f9-5fe6f5fb4d17 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:40.654135 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 842/1677] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:40.655152 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3741113-92b2-4fd2-ba28-9759e653f79d admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:40.670078 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3741113-92b2-4fd2-ba28-9759e653f79d admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:40.686862 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35d15b-2b63-41e2-9394-52e22dde4b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:40.687864 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35d15b-2b63-41e2-9394-52e22dde4b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:40.700681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35d15b-2b63-41e2-9394-52e22dde4b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:40.701062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35d15b-2b63-41e2-9394-52e22dde4b08 admin admin] PATH_INFO: `/v3/projects/0fad5668932841848bff1058a4c9e2e6/users/9997a012cb2c4c43b17e37eff426e781/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:40.729046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35d15b-2b63-41e2-9394-52e22dde4b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fad5668932841848bff1058a4c9e2e6, user_id=9997a012cb2c4c43b17e37eff426e781, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:40.731920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35d15b-2b63-41e2-9394-52e22dde4b08 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:40.771071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 836/1678] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:40 2022] PUT /identity/v3/projects/0fad5668932841848bff1058a4c9e2e6/users/9997a012cb2c4c43b17e37eff426e781/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:40.775170 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac70d54-c3e9-4fb8-b8f9-5fe6f5fb4d17 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:40.792437 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac70d54-c3e9-4fb8-b8f9-5fe6f5fb4d17 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:40.925675 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a558e-6ad8-4051-a6a0-718c14eeaaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:40.926408 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a558e-6ad8-4051-a6a0-718c14eeaaba admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:40.927318 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a558e-6ad8-4051-a6a0-718c14eeaaba admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:40.927671 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a558e-6ad8-4051-a6a0-718c14eeaaba admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:40.928400 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a558e-6ad8-4051-a6a0-718c14eeaaba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:40.930154 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a558e-6ad8-4051-a6a0-718c14eeaaba admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:40.954804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 843/1679] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:40.956150 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35d15b-2b63-41e2-9394-52e22dde4b08 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:40.978447 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35d15b-2b63-41e2-9394-52e22dde4b08 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:40.989468 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8ae53-6407-4dd8-8085-bbaa6593fa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:40.990165 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8ae53-6407-4dd8-8085-bbaa6593fa69 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:40.990451 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8ae53-6407-4dd8-8085-bbaa6593fa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:40.990909 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8ae53-6407-4dd8-8085-bbaa6593fa69 admin admin] PATH_INFO: `/v3/projects/0fad5668932841848bff1058a4c9e2e6/users/9997a012cb2c4c43b17e37eff426e781/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:40.997305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8ae53-6407-4dd8-8085-bbaa6593fa69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fad5668932841848bff1058a4c9e2e6, user_id=9997a012cb2c4c43b17e37eff426e781, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:40.999955 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8ae53-6407-4dd8-8085-bbaa6593fa69 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:41.022312 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 837/1680] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:40 2022] PUT /identity/v3/projects/0fad5668932841848bff1058a4c9e2e6/users/9997a012cb2c4c43b17e37eff426e781/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:41.026603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0a5b2-6ae6-4bd3-b86f-21f27997cb20 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:41.027922 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0a5b2-6ae6-4bd3-b86f-21f27997cb20 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:41.028412 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0a5b2-6ae6-4bd3-b86f-21f27997cb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:41.075611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-d2e0a5b2-6ae6-4bd3-b86f-21f27997cb20 None None] MFA Rules not processed for user `9997a012cb2c4c43b17e37eff426e781`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:41.077417 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d2e0a5b2-6ae6-4bd3-b86f-21f27997cb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:41.092945 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:41.229741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 844/1681] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:41.243607 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8ae53-6407-4dd8-8085-bbaa6593fa69 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:41.245511 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d1a8ae53-6407-4dd8-8085-bbaa6593fa69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:41.355985 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8ae53-6407-4dd8-8085-bbaa6593fa69 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:41.364809 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba9009-60f4-4db5-9933-ded553e89405 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:41.366259 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba9009-60f4-4db5-9933-ded553e89405 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:41.366967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba9009-60f4-4db5-9933-ded553e89405 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:41.368903 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba9009-60f4-4db5-9933-ded553e89405 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:41.394879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba9009-60f4-4db5-9933-ded553e89405 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:41.396746 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba9009-60f4-4db5-9933-ded553e89405 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:41.405692 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:41.422921 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 838/1682] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:41.454780 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d65f7-d771-43a7-a32a-a8c052165ed7 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:41.455627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d65f7-d771-43a7-a32a-a8c052165ed7 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:41.456470 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d65f7-d771-43a7-a32a-a8c052165ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:41.525773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-2a5d65f7-d771-43a7-a32a-a8c052165ed7 None None] MFA Rules not processed for user `7c29e3dab8b444c69b8b78806e5ff376`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:41.527176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2a5d65f7-d771-43a7-a32a-a8c052165ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:41.662397 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 845/1683] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:41 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:41.917725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4ebed-559e-4d38-ac0b-acbf52e14005 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:41.918457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4ebed-559e-4d38-ac0b-acbf52e14005 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:41.918457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4ebed-559e-4d38-ac0b-acbf52e14005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:41.934899 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d65f7-d771-43a7-a32a-a8c052165ed7 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:41.937247 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2a5d65f7-d771-43a7-a32a-a8c052165ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:42.046409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-06b4ebed-559e-4d38-ac0b-acbf52e14005 None None] MFA Rules not processed for user `d89caad53e7344948b7c2e8e50f21687`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:42.053228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-06b4ebed-559e-4d38-ac0b-acbf52e14005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:42.206020 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d65f7-d771-43a7-a32a-a8c052165ed7 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:42.219416 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bd4ef-8bde-4f52-9d63-b609c2d33dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:42.221792 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bd4ef-8bde-4f52-9d63-b609c2d33dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:42.223642 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bd4ef-8bde-4f52-9d63-b609c2d33dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:42.233312 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bd4ef-8bde-4f52-9d63-b609c2d33dd6 admin admin] PATH_INFO: `/v3/projects/c3d1de53fef04cfe9f1cd215b8547398` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:42.236333 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bd4ef-8bde-4f52-9d63-b609c2d33dd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3d1de53fef04cfe9f1cd215b8547398)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:42.242756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bd4ef-8bde-4f52-9d63-b609c2d33dd6 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:42.274189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 839/1684] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:42.286194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e47ad0-1871-4bf0-9efb-6e5ea9d04345 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:42.286484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e47ad0-1871-4bf0-9efb-6e5ea9d04345 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:42.287355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e47ad0-1871-4bf0-9efb-6e5ea9d04345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:42.332309 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-31e47ad0-1871-4bf0-9efb-6e5ea9d04345 None None] MFA Rules not processed for user `d89caad53e7344948b7c2e8e50f21687`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:42.333596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-31e47ad0-1871-4bf0-9efb-6e5ea9d04345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:42.354278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 840/1685] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:42.357088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:42.369408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e47ad0-1871-4bf0-9efb-6e5ea9d04345 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:42.371852 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-31e47ad0-1871-4bf0-9efb-6e5ea9d04345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:42.422258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-db6bd4ef-8bde-4f52-9d63-b609c2d33dd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3d1de53fef04cfe9f1cd215b8547398', 'request_id': 'req-db6bd4ef-8bde-4f52-9d63-b609c2d33dd6'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:42.445340 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-db6bd4ef-8bde-4f52-9d63-b609c2d33dd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3d1de53fef04cfe9f1cd215b8547398', 'request_id': 'req-db6bd4ef-8bde-4f52-9d63-b609c2d33dd6'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:42.470098 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-db6bd4ef-8bde-4f52-9d63-b609c2d33dd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3d1de53fef04cfe9f1cd215b8547398', 'request_id': 'req-db6bd4ef-8bde-4f52-9d63-b609c2d33dd6'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:42.491219 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-db6bd4ef-8bde-4f52-9d63-b609c2d33dd6 admin admin] The token cache is being invalidate because project c3d1de53fef04cfe9f1cd215b8547398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:46:42.491553 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-db6bd4ef-8bde-4f52-9d63-b609c2d33dd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:42.504227 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-db6bd4ef-8bde-4f52-9d63-b609c2d33dd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:42.509589 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 846/1686] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:46:41 2022] DELETE /identity/v3/projects/c3d1de53fef04cfe9f1cd215b8547398 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:46:42.509589 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bd4ef-8bde-4f52-9d63-b609c2d33dd6 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:42.509589 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-db6bd4ef-8bde-4f52-9d63-b609c2d33dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:42.570515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e47ad0-1871-4bf0-9efb-6e5ea9d04345 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:42.702235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bd4ef-8bde-4f52-9d63-b609c2d33dd6 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:42.719114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc84099-d920-44b1-92d7-fca5f841459c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:42.719807 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc84099-d920-44b1-92d7-fca5f841459c service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:42.723803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc84099-d920-44b1-92d7-fca5f841459c service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:42.724085 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc84099-d920-44b1-92d7-fca5f841459c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:42.725042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518ace1-44e7-4871-8ceb-c47fe5624e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:42.726046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518ace1-44e7-4871-8ceb-c47fe5624e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:42.726574 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518ace1-44e7-4871-8ceb-c47fe5624e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:42.729348 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518ace1-44e7-4871-8ceb-c47fe5624e1a admin admin] PATH_INFO: `/v3/users/4097239580e1462c8bbab3ab9281c7bb` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:42.731244 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518ace1-44e7-4871-8ceb-c47fe5624e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4097239580e1462c8bbab3ab9281c7bb)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:42.734676 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6dc84099-d920-44b1-92d7-fca5f841459c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:42.739346 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518ace1-44e7-4871-8ceb-c47fe5624e1a admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:42.773967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:42.874628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a518ace1-44e7-4871-8ceb-c47fe5624e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4097239580e1462c8bbab3ab9281c7bb'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:42.886162 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc84099-d920-44b1-92d7-fca5f841459c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:42.888251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc84099-d920-44b1-92d7-fca5f841459c service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:42.891798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a518ace1-44e7-4871-8ceb-c47fe5624e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4097239580e1462c8bbab3ab9281c7bb'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:42.894110 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a518ace1-44e7-4871-8ceb-c47fe5624e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4097239580e1462c8bbab3ab9281c7bb'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:42.894964 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a518ace1-44e7-4871-8ceb-c47fe5624e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4097239580e1462c8bbab3ab9281c7bb'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:42.915934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a518ace1-44e7-4871-8ceb-c47fe5624e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4097239580e1462c8bbab3ab9281c7bb'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:42.940817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 841/1687] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 10:46:42.943651 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc84099-d920-44b1-92d7-fca5f841459c service nova] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:42.948779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6dc84099-d920-44b1-92d7-fca5f841459c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:42.980795 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 847/1688] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:46:42 2022] DELETE /identity/v3/users/4097239580e1462c8bbab3ab9281c7bb => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:42.982893 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518ace1-44e7-4871-8ceb-c47fe5624e1a admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:42.984602 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc84099-d920-44b1-92d7-fca5f841459c service nova] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:42.986432 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a518ace1-44e7-4871-8ceb-c47fe5624e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:43.078731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe428d-98d4-46c0-a029-2821b29b2f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:43.078731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe428d-98d4-46c0-a029-2821b29b2f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:43.079200 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe428d-98d4-46c0-a029-2821b29b2f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:43.079481 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe428d-98d4-46c0-a029-2821b29b2f03 admin admin] PATH_INFO: `/v3/projects/30304c1cfa224c9085df50ae202863b0` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:43.082464 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe428d-98d4-46c0-a029-2821b29b2f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30304c1cfa224c9085df50ae202863b0)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:43.092620 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe428d-98d4-46c0-a029-2821b29b2f03 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:43.097230 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:43.187107 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518ace1-44e7-4871-8ceb-c47fe5624e1a admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:43.222723 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cafe428d-98d4-46c0-a029-2821b29b2f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30304c1cfa224c9085df50ae202863b0', 'request_id': 'req-cafe428d-98d4-46c0-a029-2821b29b2f03'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:43.235561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cafe428d-98d4-46c0-a029-2821b29b2f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30304c1cfa224c9085df50ae202863b0', 'request_id': 'req-cafe428d-98d4-46c0-a029-2821b29b2f03'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:43.251516 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cafe428d-98d4-46c0-a029-2821b29b2f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30304c1cfa224c9085df50ae202863b0', 'request_id': 'req-cafe428d-98d4-46c0-a029-2821b29b2f03'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:43.277659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cafe428d-98d4-46c0-a029-2821b29b2f03 admin admin] The token cache is being invalidate because project 30304c1cfa224c9085df50ae202863b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:46:43.277998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cafe428d-98d4-46c0-a029-2821b29b2f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:43.279014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cafe428d-98d4-46c0-a029-2821b29b2f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:43.281540 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 842/1689] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:46:42 2022] DELETE /identity/v3/projects/30304c1cfa224c9085df50ae202863b0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:43.282354 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe428d-98d4-46c0-a029-2821b29b2f03 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:43.285601 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cafe428d-98d4-46c0-a029-2821b29b2f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:43.295292 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0b480-ee80-4dd8-a76b-9acf98aae45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:43.295947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0b480-ee80-4dd8-a76b-9acf98aae45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:43.296227 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0b480-ee80-4dd8-a76b-9acf98aae45e admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:43.296504 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0b480-ee80-4dd8-a76b-9acf98aae45e admin admin] PATH_INFO: `/v3/users/fa274374be7b47a0b00083aacee2f2f1` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:43.300115 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0b480-ee80-4dd8-a76b-9acf98aae45e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa274374be7b47a0b00083aacee2f2f1)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:43.305703 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0b480-ee80-4dd8-a76b-9acf98aae45e admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:43.320665 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe428d-98d4-46c0-a029-2821b29b2f03 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:43.330232 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2073720-678d-4f07-9376-c4bd649baefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:43.330897 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2073720-678d-4f07-9376-c4bd649baefe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:43.331179 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2073720-678d-4f07-9376-c4bd649baefe admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:43.331458 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2073720-678d-4f07-9376-c4bd649baefe admin admin] PATH_INFO: `/v3/projects/7712ef6f602d414b9ebcdf099f61c2ed` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:43.332667 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2073720-678d-4f07-9376-c4bd649baefe admin admin] RBAC: Authorizing `identity:delete_project(project_id=7712ef6f602d414b9ebcdf099f61c2ed)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:43.335016 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2073720-678d-4f07-9376-c4bd649baefe admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:43.406575 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-7df0b480-ee80-4dd8-a76b-9acf98aae45e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa274374be7b47a0b00083aacee2f2f1'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:43.406955 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:43.415465 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f2073720-678d-4f07-9376-c4bd649baefe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7712ef6f602d414b9ebcdf099f61c2ed', 'request_id': 'req-f2073720-678d-4f07-9376-c4bd649baefe'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:43.420732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-7df0b480-ee80-4dd8-a76b-9acf98aae45e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa274374be7b47a0b00083aacee2f2f1'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:43.422739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-7df0b480-ee80-4dd8-a76b-9acf98aae45e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa274374be7b47a0b00083aacee2f2f1'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:43.423587 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-7df0b480-ee80-4dd8-a76b-9acf98aae45e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa274374be7b47a0b00083aacee2f2f1'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:43.428736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f2073720-678d-4f07-9376-c4bd649baefe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7712ef6f602d414b9ebcdf099f61c2ed', 'request_id': 'req-f2073720-678d-4f07-9376-c4bd649baefe'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:43.441624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-7df0b480-ee80-4dd8-a76b-9acf98aae45e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa274374be7b47a0b00083aacee2f2f1'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:43.441836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f2073720-678d-4f07-9376-c4bd649baefe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7712ef6f602d414b9ebcdf099f61c2ed', 'request_id': 'req-f2073720-678d-4f07-9376-c4bd649baefe'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:43.469843 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f2073720-678d-4f07-9376-c4bd649baefe admin admin] The token cache is being invalidate because project 7712ef6f602d414b9ebcdf099f61c2ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:46:43.469843 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f2073720-678d-4f07-9376-c4bd649baefe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:43.469843 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f2073720-678d-4f07-9376-c4bd649baefe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:43.474832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 843/1690] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:46:43 2022] DELETE /identity/v3/projects/7712ef6f602d414b9ebcdf099f61c2ed => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:43.477723 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18facca9-97a7-4e91-a92c-e512150a366d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:43.477864 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18facca9-97a7-4e91-a92c-e512150a366d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:43.478098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18facca9-97a7-4e91-a92c-e512150a366d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:43.490597 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 848/1691] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:46:42 2022] DELETE /identity/v3/users/fa274374be7b47a0b00083aacee2f2f1 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:43.490775 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942c09e-e724-4ede-872a-912c60cfc115 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:43.491088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942c09e-e724-4ede-872a-912c60cfc115 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:43.491374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942c09e-e724-4ede-872a-912c60cfc115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:43.503579 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-18facca9-97a7-4e91-a92c-e512150a366d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:43.504902 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-18facca9-97a7-4e91-a92c-e512150a366d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:43.537712 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-4942c09e-e724-4ede-872a-912c60cfc115 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:43.539141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-4942c09e-e724-4ede-872a-912c60cfc115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:43.621231 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 844/1692] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:43.622594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b2c8b-24c4-4bf7-bcb7-e39357a1d488 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:43.622880 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b2c8b-24c4-4bf7-bcb7-e39357a1d488 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:43.626664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b2c8b-24c4-4bf7-bcb7-e39357a1d488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:43.668909 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 849/1693] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:43.675173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-796b2c8b-24c4-4bf7-bcb7-e39357a1d488 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:43.676424 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-796b2c8b-24c4-4bf7-bcb7-e39357a1d488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:43.677569 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75228231-0ff9-4951-b283-c88dabe1a580 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:43.678190 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75228231-0ff9-4951-b283-c88dabe1a580 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:43.679283 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75228231-0ff9-4951-b283-c88dabe1a580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:43.699885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 845/1694] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:43.709004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266069cf-c585-4034-a9e1-e2c99da70002 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:43.709299 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266069cf-c585-4034-a9e1-e2c99da70002 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:43.709552 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266069cf-c585-4034-a9e1-e2c99da70002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:43.717350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:43.737927 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-75228231-0ff9-4951-b283-c88dabe1a580 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:43.739449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-75228231-0ff9-4951-b283-c88dabe1a580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:43.748770 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-266069cf-c585-4034-a9e1-e2c99da70002 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:43.750345 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-266069cf-c585-4034-a9e1-e2c99da70002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:43.758089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 850/1695] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:43.761667 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a14e-d7e0-4130-9e55-0dd6d5485c46 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:43.762714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a14e-d7e0-4130-9e55-0dd6d5485c46 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:43.764158 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a14e-d7e0-4130-9e55-0dd6d5485c46 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:43.767683 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 851/1696] 10.222.0.20 () {54 vars in 921 bytes} [Sun Sep 11 10:46:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:46:43.769513 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2a14e-d7e0-4130-9e55-0dd6d5485c46 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:43.771034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 846/1697] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:46:43.776088 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266069cf-c585-4034-a9e1-e2c99da70002 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:43.803527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266069cf-c585-4034-a9e1-e2c99da70002 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:43.808279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2a14e-d7e0-4130-9e55-0dd6d5485c46 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:43.815459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7af501-7752-4567-8d81-d91d38600fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:43.816093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7af501-7752-4567-8d81-d91d38600fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:43.818766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7af501-7752-4567-8d81-d91d38600fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:43.819055 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7af501-7752-4567-8d81-d91d38600fb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:43.820041 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fb712-e696-4094-8c47-2aaccd96a485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:43.820687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fb712-e696-4094-8c47-2aaccd96a485 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:43.820963 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fb712-e696-4094-8c47-2aaccd96a485 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:43.821234 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fb712-e696-4094-8c47-2aaccd96a485 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:43.821887 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fb712-e696-4094-8c47-2aaccd96a485 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:46:43.823079 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7af501-7752-4567-8d81-d91d38600fb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:46:43.823988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7af501-7752-4567-8d81-d91d38600fb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:43.825730 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7af501-7752-4567-8d81-d91d38600fb2 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:43.826142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fb712-e696-4094-8c47-2aaccd96a485 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:43.830684 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fb712-e696-4094-8c47-2aaccd96a485 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:43.852135 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 847/1698] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:46:43.852135 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8769bf-40f3-4174-9bf0-96fd94352a30 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:43.852135 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8769bf-40f3-4174-9bf0-96fd94352a30 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:43.852135 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8769bf-40f3-4174-9bf0-96fd94352a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:43.880674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 852/1699] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:46:43.881941 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fb712-e696-4094-8c47-2aaccd96a485 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:43.885417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3f8769bf-40f3-4174-9bf0-96fd94352a30 None None] MFA Rules not processed for user `7f0211a05cca4e72b30d64eef4ba527c`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:43.886726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3f8769bf-40f3-4174-9bf0-96fd94352a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:43.917886 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fb712-e696-4094-8c47-2aaccd96a485 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:43.934430 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40934ffc-1184-413a-ac69-dad88513ac00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:43.935314 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40934ffc-1184-413a-ac69-dad88513ac00 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:43.936009 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40934ffc-1184-413a-ac69-dad88513ac00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:43.939960 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40934ffc-1184-413a-ac69-dad88513ac00 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:43.941371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40934ffc-1184-413a-ac69-dad88513ac00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:43.943492 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40934ffc-1184-413a-ac69-dad88513ac00 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:43.975132 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 848/1700] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Sep 11 10:46:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:43.976014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8769bf-40f3-4174-9bf0-96fd94352a30 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:43.995693 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8769bf-40f3-4174-9bf0-96fd94352a30 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:44.005266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83775ddb-0edd-438c-800a-6f9a4dc37572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:44.005992 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83775ddb-0edd-438c-800a-6f9a4dc37572 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:44.006630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83775ddb-0edd-438c-800a-6f9a4dc37572 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:44.007034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83775ddb-0edd-438c-800a-6f9a4dc37572 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:44.007765 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83775ddb-0edd-438c-800a-6f9a4dc37572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:44.011190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83775ddb-0edd-438c-800a-6f9a4dc37572 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:44.042117 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 853/1701] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:43 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:44.043338 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40934ffc-1184-413a-ac69-dad88513ac00 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:44.046267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-40934ffc-1184-413a-ac69-dad88513ac00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:44.066804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 849/1702] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:43 2022] POST /identity/v3/projects => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:44.071001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83775ddb-0edd-438c-800a-6f9a4dc37572 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:44.073784 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-83775ddb-0edd-438c-800a-6f9a4dc37572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:44.105173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:44.244934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83775ddb-0edd-438c-800a-6f9a4dc37572 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:44.251937 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40934ffc-1184-413a-ac69-dad88513ac00 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:44.259169 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2afcc2-d309-40a3-b442-581172513508 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0211a05cca4e72b30d64eef4ba527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:44.259807 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2afcc2-d309-40a3-b442-581172513508 service placement] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:44.260091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2afcc2-d309-40a3-b442-581172513508 service placement] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:44.260370 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2afcc2-d309-40a3-b442-581172513508 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:44.294396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2afcc2-d309-40a3-b442-581172513508 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:44.296274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2afcc2-d309-40a3-b442-581172513508 service placement] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:44.339995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 850/1703] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:44.340955 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2afcc2-d309-40a3-b442-581172513508 service placement] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:44.356403 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30381fe6-cd25-41c9-85c9-9f69d377f758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:44.357677 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30381fe6-cd25-41c9-85c9-9f69d377f758 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:44.358406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30381fe6-cd25-41c9-85c9-9f69d377f758 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:44.359086 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30381fe6-cd25-41c9-85c9-9f69d377f758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:44.474643 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30381fe6-cd25-41c9-85c9-9f69d377f758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:44.476294 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30381fe6-cd25-41c9-85c9-9f69d377f758 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:44.518603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 854/1704] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:44.521375 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30381fe6-cd25-41c9-85c9-9f69d377f758 service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:44.522871 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2afcc2-d309-40a3-b442-581172513508 service placement] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:44.544319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c999ec-c40b-423f-96d0-ac2b5976c1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:44.546219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c999ec-c40b-423f-96d0-ac2b5976c1ad admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:44.546501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c999ec-c40b-423f-96d0-ac2b5976c1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:44.546776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c999ec-c40b-423f-96d0-ac2b5976c1ad admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:44.550124 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30381fe6-cd25-41c9-85c9-9f69d377f758 service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:44.551044 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c999ec-c40b-423f-96d0-ac2b5976c1ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:44.553948 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c999ec-c40b-423f-96d0-ac2b5976c1ad admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:44.564028 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ad898-10d4-4e14-a9dc-ef80c0eb60c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:44.565268 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ad898-10d4-4e14-a9dc-ef80c0eb60c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:44.565548 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ad898-10d4-4e14-a9dc-ef80c0eb60c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:44.565815 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ad898-10d4-4e14-a9dc-ef80c0eb60c1 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:44.566457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ad898-10d4-4e14-a9dc-ef80c0eb60c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:44.568457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ad898-10d4-4e14-a9dc-ef80c0eb60c1 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:44.607337 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 851/1705] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:44 2022] POST /identity/v3/users => generated 291 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:44.609576 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7a3ce-5ba3-404f-aeba-fda37b0e6a84 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:44.609976 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7a3ce-5ba3-404f-aeba-fda37b0e6a84 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:44.610387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7a3ce-5ba3-404f-aeba-fda37b0e6a84 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:44.616143 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 852/1706] 10.222.0.20 () {54 vars in 912 bytes} [Sun Sep 11 10:46:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:46:44.623447 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7a3ce-5ba3-404f-aeba-fda37b0e6a84 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:44.630161 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 855/1707] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:44 2022] POST /identity/v3/users => generated 284 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:44.630686 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b3d99-903a-4e3b-a2a6-e60dd3108e67 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:44.630971 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b3d99-903a-4e3b-a2a6-e60dd3108e67 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:44.631247 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b3d99-903a-4e3b-a2a6-e60dd3108e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:44.652190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7a3ce-5ba3-404f-aeba-fda37b0e6a84 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:44.659971 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f753c-9bca-4937-89a9-ce6f05dbd2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:44.660673 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f753c-9bca-4937-89a9-ce6f05dbd2fe admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:44.660953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f753c-9bca-4937-89a9-ce6f05dbd2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:44.661269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f753c-9bca-4937-89a9-ce6f05dbd2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:44.661922 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f753c-9bca-4937-89a9-ce6f05dbd2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:44.664016 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f753c-9bca-4937-89a9-ce6f05dbd2fe admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:44.682263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 853/1708] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:44.683638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:44.688396 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f753c-9bca-4937-89a9-ce6f05dbd2fe admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:44.709360 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f753c-9bca-4937-89a9-ce6f05dbd2fe admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:44.713007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b603ba-eab9-461c-b9ff-89869a51a0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:44.713436 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b603ba-eab9-461c-b9ff-89869a51a0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:44.713781 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b603ba-eab9-461c-b9ff-89869a51a0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:44.714010 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b603ba-eab9-461c-b9ff-89869a51a0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:44.715076 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b603ba-eab9-461c-b9ff-89869a51a0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:44.716844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b603ba-eab9-461c-b9ff-89869a51a0c8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:44.733761 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 854/1709] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:44.734875 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b603ba-eab9-461c-b9ff-89869a51a0c8 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:44.735513 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-d50b3d99-903a-4e3b-a2a6-e60dd3108e67 None None] MFA Rules not processed for user `133c5864d9544973a30ff77866522f15`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:44.737124 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d50b3d99-903a-4e3b-a2a6-e60dd3108e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:44.750679 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b603ba-eab9-461c-b9ff-89869a51a0c8 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:44.754170 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 856/1710] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 10:46:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:44.756155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46003dfc-85f0-4101-8162-4259550cf521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:44.757758 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46003dfc-85f0-4101-8162-4259550cf521 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:44.757895 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b3d99-903a-4e3b-a2a6-e60dd3108e67 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:44.757991 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46003dfc-85f0-4101-8162-4259550cf521 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:44.757991 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46003dfc-85f0-4101-8162-4259550cf521 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:44.758150 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46003dfc-85f0-4101-8162-4259550cf521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:44.765963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46003dfc-85f0-4101-8162-4259550cf521 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:44.785704 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 855/1711] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:44.786712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af76c4-b53f-4c8b-996f-b9656a9b1e0d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:44.787006 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af76c4-b53f-4c8b-996f-b9656a9b1e0d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:44.787281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af76c4-b53f-4c8b-996f-b9656a9b1e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:44.788356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b3d99-903a-4e3b-a2a6-e60dd3108e67 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:44.795092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfe089-917e-46af-b297-14f3c599dd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:44.795868 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfe089-917e-46af-b297-14f3c599dd7b admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:44.796941 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfe089-917e-46af-b297-14f3c599dd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:44.798918 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfe089-917e-46af-b297-14f3c599dd7b admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:44.800035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dfe089-917e-46af-b297-14f3c599dd7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:44.804269 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dfe089-917e-46af-b297-14f3c599dd7b admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:44.844402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 857/1712] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:44.856030 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfe089-917e-46af-b297-14f3c599dd7b admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:44.866645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d2af76c4-b53f-4c8b-996f-b9656a9b1e0d None None] MFA Rules not processed for user `d0d2655f3c6a42898c67f82a697ef7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:44.868018 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d2af76c4-b53f-4c8b-996f-b9656a9b1e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:44.885080 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfe089-917e-46af-b297-14f3c599dd7b admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:44.899456 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b7212-b112-4e10-82b4-88809276a427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:44.900158 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b7212-b112-4e10-82b4-88809276a427 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:44.900441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b7212-b112-4e10-82b4-88809276a427 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:44.900747 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b7212-b112-4e10-82b4-88809276a427 admin admin] PATH_INFO: `/v3/projects/1c8fb5e1eb1f47b4bfa95b555f88e135/users/49b992f955c6416584ecf6ecbdbd177d/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:44.943225 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b7212-b112-4e10-82b4-88809276a427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8fb5e1eb1f47b4bfa95b555f88e135, user_id=49b992f955c6416584ecf6ecbdbd177d, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:44.946482 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b7212-b112-4e10-82b4-88809276a427 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:44.977391 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 858/1713] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:44 2022] PUT /identity/v3/projects/1c8fb5e1eb1f47b4bfa95b555f88e135/users/49b992f955c6416584ecf6ecbdbd177d/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:44.985661 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b7212-b112-4e10-82b4-88809276a427 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:45.057898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:45.104127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 856/1714] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:45.105345 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af76c4-b53f-4c8b-996f-b9656a9b1e0d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:45.125677 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af76c4-b53f-4c8b-996f-b9656a9b1e0d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:45.132697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b7212-b112-4e10-82b4-88809276a427 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:45.143227 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3748935-1d5a-4881-8cb3-8da8b471f8a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:45.144578 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3748935-1d5a-4881-8cb3-8da8b471f8a1 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:45.148779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3748935-1d5a-4881-8cb3-8da8b471f8a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:45.149066 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3748935-1d5a-4881-8cb3-8da8b471f8a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:45.174784 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3748935-1d5a-4881-8cb3-8da8b471f8a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:45.176253 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3748935-1d5a-4881-8cb3-8da8b471f8a1 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:45.205983 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 859/1715] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:45.207568 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143c2b8-84df-496a-bb9a-998b41b40833 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:45.207858 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143c2b8-84df-496a-bb9a-998b41b40833 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:45.208142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143c2b8-84df-496a-bb9a-998b41b40833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:45.293839 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd188ef8-13c7-4c5e-aac8-2db257f1e347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:45.295913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd188ef8-13c7-4c5e-aac8-2db257f1e347 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:45.296234 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd188ef8-13c7-4c5e-aac8-2db257f1e347 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:45.296564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd188ef8-13c7-4c5e-aac8-2db257f1e347 admin admin] PATH_INFO: `/v3/projects/16a1fa5fb9b74ed396e04a89d7ad1d80/users/4cc0dd61b1764f02989fd80d55117a90/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:45.304771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-4143c2b8-84df-496a-bb9a-998b41b40833 None None] MFA Rules not processed for user `49b992f955c6416584ecf6ecbdbd177d`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:45.309067 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-4143c2b8-84df-496a-bb9a-998b41b40833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:45.328947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd188ef8-13c7-4c5e-aac8-2db257f1e347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a1fa5fb9b74ed396e04a89d7ad1d80, user_id=4cc0dd61b1764f02989fd80d55117a90, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:45.336474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd188ef8-13c7-4c5e-aac8-2db257f1e347 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:45.369565 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 857/1716] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:45 2022] PUT /identity/v3/projects/16a1fa5fb9b74ed396e04a89d7ad1d80/users/4cc0dd61b1764f02989fd80d55117a90/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:45.373142 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c65ae5-bd5d-44be-8037-1bd3a60e5ea8 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:45.374610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c65ae5-bd5d-44be-8037-1bd3a60e5ea8 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:45.374929 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c65ae5-bd5d-44be-8037-1bd3a60e5ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:45.422881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-61c65ae5-bd5d-44be-8037-1bd3a60e5ea8 None None] MFA Rules not processed for user `d0d2655f3c6a42898c67f82a697ef7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:45.424209 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-61c65ae5-bd5d-44be-8037-1bd3a60e5ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:45.503217 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 860/1717] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:45.505215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143c2b8-84df-496a-bb9a-998b41b40833 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:45.513274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-4143c2b8-84df-496a-bb9a-998b41b40833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:45.544229 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143c2b8-84df-496a-bb9a-998b41b40833 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:45.639482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 858/1718] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:45.640587 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f2189-6674-4ab5-8b33-c0f9d13fa50a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:45.640946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f2189-6674-4ab5-8b33-c0f9d13fa50a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:45.641226 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f2189-6674-4ab5-8b33-c0f9d13fa50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:45.678290 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:45.709932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f244c-8e98-41e9-9e4e-8ccaf31883be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:45.710590 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f244c-8e98-41e9-9e4e-8ccaf31883be admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:45.710869 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f244c-8e98-41e9-9e4e-8ccaf31883be admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:45.711371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f244c-8e98-41e9-9e4e-8ccaf31883be admin admin] PATH_INFO: `/v3/users/cb432e5b033540b7ac1eef7bdf44e90a` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:45.714263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f244c-8e98-41e9-9e4e-8ccaf31883be admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb432e5b033540b7ac1eef7bdf44e90a)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:45.716148 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f244c-8e98-41e9-9e4e-8ccaf31883be admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:45.737766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e20f2189-6674-4ab5-8b33-c0f9d13fa50a None None] MFA Rules not processed for user `4cc0dd61b1764f02989fd80d55117a90`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:45.747831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e20f2189-6674-4ab5-8b33-c0f9d13fa50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:45.863399 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ce4f244c-8e98-41e9-9e4e-8ccaf31883be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb432e5b033540b7ac1eef7bdf44e90a'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:45.881311 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ce4f244c-8e98-41e9-9e4e-8ccaf31883be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb432e5b033540b7ac1eef7bdf44e90a'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:45.882909 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ce4f244c-8e98-41e9-9e4e-8ccaf31883be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb432e5b033540b7ac1eef7bdf44e90a'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:45.883950 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ce4f244c-8e98-41e9-9e4e-8ccaf31883be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb432e5b033540b7ac1eef7bdf44e90a'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:45.895033 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ce4f244c-8e98-41e9-9e4e-8ccaf31883be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb432e5b033540b7ac1eef7bdf44e90a'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:45.931965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 859/1719] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:45.933342 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f2189-6674-4ab5-8b33-c0f9d13fa50a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:45.935192 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e20f2189-6674-4ab5-8b33-c0f9d13fa50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:45.940882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 861/1720] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:46:45 2022] DELETE /identity/v3/users/cb432e5b033540b7ac1eef7bdf44e90a => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:45.942129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f244c-8e98-41e9-9e4e-8ccaf31883be admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:45.945330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ce4f244c-8e98-41e9-9e4e-8ccaf31883be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:45.998907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f2189-6674-4ab5-8b33-c0f9d13fa50a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:46.024717 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:46.092951 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f244c-8e98-41e9-9e4e-8ccaf31883be admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:46.099641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d1cad-80d5-49da-8156-4d5987a4fd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:46.100756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d1cad-80d5-49da-8156-4d5987a4fd20 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:46.102586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d1cad-80d5-49da-8156-4d5987a4fd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:46.102947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d1cad-80d5-49da-8156-4d5987a4fd20 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:46.103839 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d1cad-80d5-49da-8156-4d5987a4fd20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:46.109121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d1cad-80d5-49da-8156-4d5987a4fd20 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:46.195314 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 862/1721] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:45 2022] POST /identity/v3/projects => generated 379 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:46.195314 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d1cad-80d5-49da-8156-4d5987a4fd20 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:46.195980 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-269d1cad-80d5-49da-8156-4d5987a4fd20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:46.237663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1629820-7b15-49a5-ae4b-1d7c3e36fa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:46.240154 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1629820-7b15-49a5-ae4b-1d7c3e36fa87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:46.240991 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1629820-7b15-49a5-ae4b-1d7c3e36fa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:46.243332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1629820-7b15-49a5-ae4b-1d7c3e36fa87 admin admin] PATH_INFO: `/v3/projects/6e2be19bd3024443b6f9d6792cd0358c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:46.246393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1629820-7b15-49a5-ae4b-1d7c3e36fa87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e2be19bd3024443b6f9d6792cd0358c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:46.250922 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1629820-7b15-49a5-ae4b-1d7c3e36fa87 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:46.375280 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:46.426867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a1629820-7b15-49a5-ae4b-1d7c3e36fa87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e2be19bd3024443b6f9d6792cd0358c', 'request_id': 'req-a1629820-7b15-49a5-ae4b-1d7c3e36fa87'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:46.429032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d1cad-80d5-49da-8156-4d5987a4fd20 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:46.438454 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a1629820-7b15-49a5-ae4b-1d7c3e36fa87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e2be19bd3024443b6f9d6792cd0358c', 'request_id': 'req-a1629820-7b15-49a5-ae4b-1d7c3e36fa87'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:46.457662 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a1629820-7b15-49a5-ae4b-1d7c3e36fa87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e2be19bd3024443b6f9d6792cd0358c', 'request_id': 'req-a1629820-7b15-49a5-ae4b-1d7c3e36fa87'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:46.483846 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a1629820-7b15-49a5-ae4b-1d7c3e36fa87 admin admin] The token cache is being invalidate because project 6e2be19bd3024443b6f9d6792cd0358c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:46:46.484096 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a1629820-7b15-49a5-ae4b-1d7c3e36fa87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:46.485881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a1629820-7b15-49a5-ae4b-1d7c3e36fa87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:46.492108 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 860/1722] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:46:45 2022] DELETE /identity/v3/projects/6e2be19bd3024443b6f9d6792cd0358c => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:46.492863 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1629820-7b15-49a5-ae4b-1d7c3e36fa87 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:46.497111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a1629820-7b15-49a5-ae4b-1d7c3e36fa87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:46.606735 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1629820-7b15-49a5-ae4b-1d7c3e36fa87 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:46.624175 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31394eb0-a7be-4fed-804d-54845af53b5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:46.625072 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a2418-0f4c-459a-ad8e-2b91db63d3d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:46.625518 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31394eb0-a7be-4fed-804d-54845af53b5b service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:46.625822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31394eb0-a7be-4fed-804d-54845af53b5b service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:46.626153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31394eb0-a7be-4fed-804d-54845af53b5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:46.626263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a2418-0f4c-459a-ad8e-2b91db63d3d7 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:46.626598 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a2418-0f4c-459a-ad8e-2b91db63d3d7 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:46.627383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a2418-0f4c-459a-ad8e-2b91db63d3d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:46.628971 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-31394eb0-a7be-4fed-804d-54845af53b5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:46.631958 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a46a2418-0f4c-459a-ad8e-2b91db63d3d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:46.755115 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31394eb0-a7be-4fed-804d-54845af53b5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:46.758048 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31394eb0-a7be-4fed-804d-54845af53b5b service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:46.763123 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:46.788721 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 861/1723] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:46.789856 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31394eb0-a7be-4fed-804d-54845af53b5b service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:46.794705 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-31394eb0-a7be-4fed-804d-54845af53b5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:46.906562 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a2418-0f4c-459a-ad8e-2b91db63d3d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:46.909096 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a2418-0f4c-459a-ad8e-2b91db63d3d7 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:46.932576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 863/1724] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 739 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:46.933536 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a2418-0f4c-459a-ad8e-2b91db63d3d7 service nova] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:46.941585 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a46a2418-0f4c-459a-ad8e-2b91db63d3d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:47.009314 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31394eb0-a7be-4fed-804d-54845af53b5b service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:47.015947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46803e4-efc2-42a3-a5b9-11f974e66607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:47.016856 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46803e4-efc2-42a3-a5b9-11f974e66607 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:47.017368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46803e4-efc2-42a3-a5b9-11f974e66607 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:47.017851 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46803e4-efc2-42a3-a5b9-11f974e66607 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:47.018645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46803e4-efc2-42a3-a5b9-11f974e66607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:47.021107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46803e4-efc2-42a3-a5b9-11f974e66607 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:47.062155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 862/1725] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:46 2022] POST /identity/v3/users => generated 296 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:47.066225 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba70f7-5c2d-420c-a828-e779b5c3ec2b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:47.067975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba70f7-5c2d-420c-a828-e779b5c3ec2b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:47.068430 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba70f7-5c2d-420c-a828-e779b5c3ec2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:47.131567 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a2418-0f4c-459a-ad8e-2b91db63d3d7 service nova] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:47.132785 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a2ba70f7-5c2d-420c-a828-e779b5c3ec2b None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:47.139479 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a2ba70f7-5c2d-420c-a828-e779b5c3ec2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:47.148017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f74610-f91f-4277-9fda-4daa7627ae2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:47.150245 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f74610-f91f-4277-9fda-4daa7627ae2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:47.151376 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f74610-f91f-4277-9fda-4daa7627ae2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:47.151945 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f74610-f91f-4277-9fda-4daa7627ae2b admin admin] PATH_INFO: `/v3/projects/89ce7fd1a5524d36b9c4bd9a819d40be` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:47.155277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f74610-f91f-4277-9fda-4daa7627ae2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=89ce7fd1a5524d36b9c4bd9a819d40be)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:47.158831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f74610-f91f-4277-9fda-4daa7627ae2b admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:47.163359 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 863/1726] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:47.163769 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba70f7-5c2d-420c-a828-e779b5c3ec2b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:47.165178 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a2ba70f7-5c2d-420c-a828-e779b5c3ec2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:47.185757 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba70f7-5c2d-420c-a828-e779b5c3ec2b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:47.199261 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c3b0e-060c-48e3-8f5f-fc757040f8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:47.200052 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c3b0e-060c-48e3-8f5f-fc757040f8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:47.200638 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c3b0e-060c-48e3-8f5f-fc757040f8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:47.200890 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c3b0e-060c-48e3-8f5f-fc757040f8ee admin admin] PATH_INFO: `/v3/projects/1f7ca4eebd79451d894648d6e7b43074` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:47.206171 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c3b0e-060c-48e3-8f5f-fc757040f8ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f7ca4eebd79451d894648d6e7b43074)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:47.215334 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c3b0e-060c-48e3-8f5f-fc757040f8ee admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:47.257774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:47.296310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-11f74610-f91f-4277-9fda-4daa7627ae2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ce7fd1a5524d36b9c4bd9a819d40be', 'request_id': 'req-11f74610-f91f-4277-9fda-4daa7627ae2b'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:47.309782 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-11f74610-f91f-4277-9fda-4daa7627ae2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ce7fd1a5524d36b9c4bd9a819d40be', 'request_id': 'req-11f74610-f91f-4277-9fda-4daa7627ae2b'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:47.323552 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-11f74610-f91f-4277-9fda-4daa7627ae2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ce7fd1a5524d36b9c4bd9a819d40be', 'request_id': 'req-11f74610-f91f-4277-9fda-4daa7627ae2b'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:47.333983 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d85c3b0e-060c-48e3-8f5f-fc757040f8ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f7ca4eebd79451d894648d6e7b43074', 'request_id': 'req-d85c3b0e-060c-48e3-8f5f-fc757040f8ee'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:47.345736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-11f74610-f91f-4277-9fda-4daa7627ae2b admin admin] The token cache is being invalidate because project 89ce7fd1a5524d36b9c4bd9a819d40be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:46:47.346036 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-11f74610-f91f-4277-9fda-4daa7627ae2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:47.347479 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-11f74610-f91f-4277-9fda-4daa7627ae2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:47.350136 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 864/1727] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:46:46 2022] DELETE /identity/v3/projects/89ce7fd1a5524d36b9c4bd9a819d40be => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:47.351447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f74610-f91f-4277-9fda-4daa7627ae2b admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:47.354934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-11f74610-f91f-4277-9fda-4daa7627ae2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:47.355584 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d85c3b0e-060c-48e3-8f5f-fc757040f8ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f7ca4eebd79451d894648d6e7b43074', 'request_id': 'req-d85c3b0e-060c-48e3-8f5f-fc757040f8ee'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:47.376000 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d85c3b0e-060c-48e3-8f5f-fc757040f8ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f7ca4eebd79451d894648d6e7b43074', 'request_id': 'req-d85c3b0e-060c-48e3-8f5f-fc757040f8ee'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:47.401339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d85c3b0e-060c-48e3-8f5f-fc757040f8ee admin admin] The token cache is being invalidate because project 1f7ca4eebd79451d894648d6e7b43074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:46:47.401712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d85c3b0e-060c-48e3-8f5f-fc757040f8ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:47.402551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d85c3b0e-060c-48e3-8f5f-fc757040f8ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:47.404755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 864/1728] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:46:47 2022] DELETE /identity/v3/projects/1f7ca4eebd79451d894648d6e7b43074 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:47.406173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c3b0e-060c-48e3-8f5f-fc757040f8ee admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:47.409824 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d85c3b0e-060c-48e3-8f5f-fc757040f8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:47.509371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f74610-f91f-4277-9fda-4daa7627ae2b admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:47.582496 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c3b0e-060c-48e3-8f5f-fc757040f8ee admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:47.595011 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482d331-0949-4b51-93b7-7815e98581f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:47.597226 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482d331-0949-4b51-93b7-7815e98581f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:47.598623 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482d331-0949-4b51-93b7-7815e98581f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:47.599003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482d331-0949-4b51-93b7-7815e98581f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:47.599977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482d331-0949-4b51-93b7-7815e98581f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:47.606114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482d331-0949-4b51-93b7-7815e98581f5 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:47.621543 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:47.632234 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871457fb-2e27-4dc5-b584-5dc8f6eb82bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0211a05cca4e72b30d64eef4ba527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:47.633069 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871457fb-2e27-4dc5-b584-5dc8f6eb82bf service placement] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:47.633839 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871457fb-2e27-4dc5-b584-5dc8f6eb82bf service placement] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:47.634219 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871457fb-2e27-4dc5-b584-5dc8f6eb82bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:47.637659 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-871457fb-2e27-4dc5-b584-5dc8f6eb82bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:47.641948 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 865/1729] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:47.644185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e3b94-597d-4ddb-a9e1-f64e68449a59 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:47.644671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e3b94-597d-4ddb-a9e1-f64e68449a59 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:47.644997 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e3b94-597d-4ddb-a9e1-f64e68449a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:47.660920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871457fb-2e27-4dc5-b584-5dc8f6eb82bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:47.664458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871457fb-2e27-4dc5-b584-5dc8f6eb82bf service placement] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:47.671332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-8c5e3b94-597d-4ddb-a9e1-f64e68449a59 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:47.672837 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8c5e3b94-597d-4ddb-a9e1-f64e68449a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:47.685978 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 866/1730] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:47.686931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e3b94-597d-4ddb-a9e1-f64e68449a59 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:47.689863 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8c5e3b94-597d-4ddb-a9e1-f64e68449a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:47.698619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 865/1731] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:47.701249 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871457fb-2e27-4dc5-b584-5dc8f6eb82bf service placement] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:47.702779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-871457fb-2e27-4dc5-b584-5dc8f6eb82bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:47.711388 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e3b94-597d-4ddb-a9e1-f64e68449a59 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:47.718466 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871457fb-2e27-4dc5-b584-5dc8f6eb82bf service placement] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:47.723942 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fe0ae-874e-43bb-99a5-7f5b392b472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:47.724732 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fe0ae-874e-43bb-99a5-7f5b392b472c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:47.725012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fe0ae-874e-43bb-99a5-7f5b392b472c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:47.725219 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ff9b5-1507-45ae-9a11-1b815f872624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:47.725347 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fe0ae-874e-43bb-99a5-7f5b392b472c admin admin] PATH_INFO: `/v3/users/9997a012cb2c4c43b17e37eff426e781` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:47.726046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ff9b5-1507-45ae-9a11-1b815f872624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:47.726476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ff9b5-1507-45ae-9a11-1b815f872624 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:47.726948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ff9b5-1507-45ae-9a11-1b815f872624 admin admin] PATH_INFO: `/v3/users/7c29e3dab8b444c69b8b78806e5ff376` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:47.728731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fe0ae-874e-43bb-99a5-7f5b392b472c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9997a012cb2c4c43b17e37eff426e781)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:47.729052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ff9b5-1507-45ae-9a11-1b815f872624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c29e3dab8b444c69b8b78806e5ff376)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:47.732535 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ff9b5-1507-45ae-9a11-1b815f872624 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:47.733971 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fe0ae-874e-43bb-99a5-7f5b392b472c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:47.846230 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:47.853421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e17ff9b5-1507-45ae-9a11-1b815f872624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c29e3dab8b444c69b8b78806e5ff376'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:47.854105 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ad9fe0ae-874e-43bb-99a5-7f5b392b472c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9997a012cb2c4c43b17e37eff426e781'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:47.876009 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ad9fe0ae-874e-43bb-99a5-7f5b392b472c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9997a012cb2c4c43b17e37eff426e781'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:47.876792 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ad9fe0ae-874e-43bb-99a5-7f5b392b472c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9997a012cb2c4c43b17e37eff426e781'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:47.877705 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ad9fe0ae-874e-43bb-99a5-7f5b392b472c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9997a012cb2c4c43b17e37eff426e781'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:47.879668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e17ff9b5-1507-45ae-9a11-1b815f872624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c29e3dab8b444c69b8b78806e5ff376'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:47.880783 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e17ff9b5-1507-45ae-9a11-1b815f872624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c29e3dab8b444c69b8b78806e5ff376'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:47.884324 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e17ff9b5-1507-45ae-9a11-1b815f872624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c29e3dab8b444c69b8b78806e5ff376'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:47.898671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ad9fe0ae-874e-43bb-99a5-7f5b392b472c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9997a012cb2c4c43b17e37eff426e781'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:47.901415 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e17ff9b5-1507-45ae-9a11-1b815f872624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c29e3dab8b444c69b8b78806e5ff376'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:47.957420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 866/1732] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:46:47 2022] DELETE /identity/v3/users/7c29e3dab8b444c69b8b78806e5ff376 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:47.957420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ff9b5-1507-45ae-9a11-1b815f872624 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:47.963811 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 867/1733] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:46:47 2022] DELETE /identity/v3/users/9997a012cb2c4c43b17e37eff426e781 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:47.967439 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e17ff9b5-1507-45ae-9a11-1b815f872624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:47.974450 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fe0ae-874e-43bb-99a5-7f5b392b472c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:47.983850 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ad9fe0ae-874e-43bb-99a5-7f5b392b472c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:48.198094 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ff9b5-1507-45ae-9a11-1b815f872624 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:48.275583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fe0ae-874e-43bb-99a5-7f5b392b472c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:48.291351 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d84a8-beef-4f90-9ddc-3c5628c35fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:48.293250 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d84a8-beef-4f90-9ddc-3c5628c35fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:48.293533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d84a8-beef-4f90-9ddc-3c5628c35fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:48.293808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d84a8-beef-4f90-9ddc-3c5628c35fe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:48.298784 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d84a8-beef-4f90-9ddc-3c5628c35fe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:46:48.299103 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d84a8-beef-4f90-9ddc-3c5628c35fe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:48.303200 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d84a8-beef-4f90-9ddc-3c5628c35fe0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:48.338153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 868/1734] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:46:48.339827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60497e-9c90-4860-8a46-71bbe5eb9060 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:48.340112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60497e-9c90-4860-8a46-71bbe5eb9060 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:48.340386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60497e-9c90-4860-8a46-71bbe5eb9060 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:48.342050 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 869/1735] 10.222.0.20 () {54 vars in 912 bytes} [Sun Sep 11 10:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:46:48.342750 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60497e-9c90-4860-8a46-71bbe5eb9060 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:48.344513 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-aa60497e-9c90-4860-8a46-71bbe5eb9060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:48.371117 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60497e-9c90-4860-8a46-71bbe5eb9060 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:48.384278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad16bf0-a311-4dff-b86e-3c310d5b6fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:48.387159 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad16bf0-a311-4dff-b86e-3c310d5b6fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:48.387448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad16bf0-a311-4dff-b86e-3c310d5b6fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:48.387753 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad16bf0-a311-4dff-b86e-3c310d5b6fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:48.388425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad16bf0-a311-4dff-b86e-3c310d5b6fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:48.394872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad16bf0-a311-4dff-b86e-3c310d5b6fd1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:48.403052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92440f72-464a-4e69-bfa0-2fad76240c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:48.403745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92440f72-464a-4e69-bfa0-2fad76240c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:48.404401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92440f72-464a-4e69-bfa0-2fad76240c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:48.404727 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92440f72-464a-4e69-bfa0-2fad76240c03 admin admin] PATH_INFO: `/v3/projects/418b08b47b45464cb51b4c14eb585328/users/d2c11dc99b0b4651b3962923b543a95d/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:48.427930 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92440f72-464a-4e69-bfa0-2fad76240c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=418b08b47b45464cb51b4c14eb585328, user_id=d2c11dc99b0b4651b3962923b543a95d, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:48.431895 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92440f72-464a-4e69-bfa0-2fad76240c03 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:48.456062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 867/1736] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:47 2022] PUT /identity/v3/projects/418b08b47b45464cb51b4c14eb585328/users/d2c11dc99b0b4651b3962923b543a95d/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:48.457897 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac5aae-bbff-4cca-8df5-a2a4c6460176 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:48.458977 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac5aae-bbff-4cca-8df5-a2a4c6460176 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:48.459657 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac5aae-bbff-4cca-8df5-a2a4c6460176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:48.470229 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 870/1737] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:48 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:48.470229 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad16bf0-a311-4dff-b86e-3c310d5b6fd1 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:48.506986 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e7ac5aae-bbff-4cca-8df5-a2a4c6460176 None None] MFA Rules not processed for user `133c5864d9544973a30ff77866522f15`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:48.508473 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e7ac5aae-bbff-4cca-8df5-a2a4c6460176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:48.590644 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:48.607873 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:48.626541 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad16bf0-a311-4dff-b86e-3c310d5b6fd1 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:48.631700 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10676596-5655-444d-9e90-45d6d95bdb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:48.632184 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 868/1738] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 10:46:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:48.632368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10676596-5655-444d-9e90-45d6d95bdb76 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:48.633557 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10676596-5655-444d-9e90-45d6d95bdb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:48.633851 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10676596-5655-444d-9e90-45d6d95bdb76 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:48.634517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10676596-5655-444d-9e90-45d6d95bdb76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:48.636577 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac5aae-bbff-4cca-8df5-a2a4c6460176 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:48.637560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10676596-5655-444d-9e90-45d6d95bdb76 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:48.668237 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac5aae-bbff-4cca-8df5-a2a4c6460176 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:48.669993 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 871/1739] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:48.671710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b8d28-54a3-4267-b1cb-29e1fc8e2c8b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:48.673932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b8d28-54a3-4267-b1cb-29e1fc8e2c8b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:48.674746 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b8d28-54a3-4267-b1cb-29e1fc8e2c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:48.682567 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219aafe-f093-44a6-8f0b-f402dfa6c7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:48.684655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219aafe-f093-44a6-8f0b-f402dfa6c7ed admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:48.685097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219aafe-f093-44a6-8f0b-f402dfa6c7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:48.685834 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219aafe-f093-44a6-8f0b-f402dfa6c7ed admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:48.686582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219aafe-f093-44a6-8f0b-f402dfa6c7ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:48.727871 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219aafe-f093-44a6-8f0b-f402dfa6c7ed admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:48.765811 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 869/1740] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:48 2022] POST /identity/v3/users => generated 291 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:48.772702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219aafe-f093-44a6-8f0b-f402dfa6c7ed admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:48.774588 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ca3b8d28-54a3-4267-b1cb-29e1fc8e2c8b None None] MFA Rules not processed for user `2465a3ec985c4bacb213ad86ad45ab8f`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:48.776241 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ca3b8d28-54a3-4267-b1cb-29e1fc8e2c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:48.796990 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0219aafe-f093-44a6-8f0b-f402dfa6c7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:48.824873 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219aafe-f093-44a6-8f0b-f402dfa6c7ed admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:48.829173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2734d5-04ac-482d-bcf7-1dfd69766cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:48.832515 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2734d5-04ac-482d-bcf7-1dfd69766cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:48.832874 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2734d5-04ac-482d-bcf7-1dfd69766cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:48.833139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2734d5-04ac-482d-bcf7-1dfd69766cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:48.842932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2734d5-04ac-482d-bcf7-1dfd69766cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:48.845515 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2734d5-04ac-482d-bcf7-1dfd69766cd1 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:48.857241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 870/1741] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:48.867878 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2734d5-04ac-482d-bcf7-1dfd69766cd1 service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:48.898116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 872/1742] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:48.899185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b8d28-54a3-4267-b1cb-29e1fc8e2c8b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:48.900743 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ca3b8d28-54a3-4267-b1cb-29e1fc8e2c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:48.907611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2734d5-04ac-482d-bcf7-1dfd69766cd1 service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:48.915545 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b8d28-54a3-4267-b1cb-29e1fc8e2c8b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:48.920033 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3c9ad-1873-4988-b3c9-1d57211be7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:48.920340 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3c9ad-1873-4988-b3c9-1d57211be7cd admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:48.921295 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc51fa8-f3d5-48ab-a256-69c6834294e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:48.922047 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc51fa8-f3d5-48ab-a256-69c6834294e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:48.922443 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc51fa8-f3d5-48ab-a256-69c6834294e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:48.922819 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc51fa8-f3d5-48ab-a256-69c6834294e0 admin admin] PATH_INFO: `/v3/projects/fbe8ff6601984d8197cdc7c234c9a05f` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:48.924380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3c9ad-1873-4988-b3c9-1d57211be7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:48.924735 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc51fa8-f3d5-48ab-a256-69c6834294e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe8ff6601984d8197cdc7c234c9a05f)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:48.924878 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3c9ad-1873-4988-b3c9-1d57211be7cd admin admin] PATH_INFO: `/v3/projects/418b08b47b45464cb51b4c14eb585328/users/d2c11dc99b0b4651b3962923b543a95d/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:48.926825 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc51fa8-f3d5-48ab-a256-69c6834294e0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:48.927166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3c9ad-1873-4988-b3c9-1d57211be7cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=418b08b47b45464cb51b4c14eb585328, user_id=d2c11dc99b0b4651b3962923b543a95d, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:48.930123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3c9ad-1873-4988-b3c9-1d57211be7cd admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:48.951727 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 871/1743] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:48 2022] PUT /identity/v3/projects/418b08b47b45464cb51b4c14eb585328/users/d2c11dc99b0b4651b3962923b543a95d/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:48.952740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3c9ad-1873-4988-b3c9-1d57211be7cd admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:49.017227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3fc51fa8-f3d5-48ab-a256-69c6834294e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe8ff6601984d8197cdc7c234c9a05f', 'request_id': 'req-3fc51fa8-f3d5-48ab-a256-69c6834294e0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:49.024654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3fc51fa8-f3d5-48ab-a256-69c6834294e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe8ff6601984d8197cdc7c234c9a05f', 'request_id': 'req-3fc51fa8-f3d5-48ab-a256-69c6834294e0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:49.037142 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3fc51fa8-f3d5-48ab-a256-69c6834294e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe8ff6601984d8197cdc7c234c9a05f', 'request_id': 'req-3fc51fa8-f3d5-48ab-a256-69c6834294e0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:49.069009 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3fc51fa8-f3d5-48ab-a256-69c6834294e0 admin admin] The token cache is being invalidate because project fbe8ff6601984d8197cdc7c234c9a05f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:46:49.069299 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3fc51fa8-f3d5-48ab-a256-69c6834294e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:49.070237 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3fc51fa8-f3d5-48ab-a256-69c6834294e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:49.078287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 873/1744] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:46:48 2022] DELETE /identity/v3/projects/fbe8ff6601984d8197cdc7c234c9a05f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:49.079221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc51fa8-f3d5-48ab-a256-69c6834294e0 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:49.083914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3fc51fa8-f3d5-48ab-a256-69c6834294e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:49.193228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:49.202437 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3c9ad-1873-4988-b3c9-1d57211be7cd admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:49.243307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc51fa8-f3d5-48ab-a256-69c6834294e0 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:49.264383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83837c49-4864-43eb-ae1c-bbe96e70a7fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:49.265562 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83837c49-4864-43eb-ae1c-bbe96e70a7fb service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:49.265945 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83837c49-4864-43eb-ae1c-bbe96e70a7fb service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:49.266315 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83837c49-4864-43eb-ae1c-bbe96e70a7fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:49.269656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-83837c49-4864-43eb-ae1c-bbe96e70a7fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:49.317083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e371cf2-4a9d-465f-9925-2b51320e7821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:49.317083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e371cf2-4a9d-465f-9925-2b51320e7821 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:49.317376 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e371cf2-4a9d-465f-9925-2b51320e7821 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:49.317581 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e371cf2-4a9d-465f-9925-2b51320e7821 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:49.318268 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e371cf2-4a9d-465f-9925-2b51320e7821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:49.320084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e371cf2-4a9d-465f-9925-2b51320e7821 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:49.338719 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 872/1745] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:49.338719 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3c7b6-85d7-4b6a-b3a1-155e4e86c060 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:49.338719 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3c7b6-85d7-4b6a-b3a1-155e4e86c060 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:49.339080 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3c7b6-85d7-4b6a-b3a1-155e4e86c060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:49.377782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83837c49-4864-43eb-ae1c-bbe96e70a7fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:49.380120 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83837c49-4864-43eb-ae1c-bbe96e70a7fb service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:49.417854 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-edf3c7b6-85d7-4b6a-b3a1-155e4e86c060 None None] MFA Rules not processed for user `d2c11dc99b0b4651b3962923b543a95d`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:49.420414 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-edf3c7b6-85d7-4b6a-b3a1-155e4e86c060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:49.425855 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 874/1746] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:49.427380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83837c49-4864-43eb-ae1c-bbe96e70a7fb service nova] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:49.428879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-83837c49-4864-43eb-ae1c-bbe96e70a7fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:49.459294 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83837c49-4864-43eb-ae1c-bbe96e70a7fb service nova] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:49.474755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004bd64-4eeb-4b73-bdae-f22f94be4852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:49.475411 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004bd64-4eeb-4b73-bdae-f22f94be4852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:49.475689 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004bd64-4eeb-4b73-bdae-f22f94be4852 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:49.475962 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004bd64-4eeb-4b73-bdae-f22f94be4852 admin admin] PATH_INFO: `/v3/projects/0fad5668932841848bff1058a4c9e2e6` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:49.480423 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004bd64-4eeb-4b73-bdae-f22f94be4852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fad5668932841848bff1058a4c9e2e6)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:49.485398 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004bd64-4eeb-4b73-bdae-f22f94be4852 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:49.541185 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:49.595177 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 873/1747] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:49.595177 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fe265-6679-4f16-9b96-6f73ede01f4f None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:49.596251 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fe265-6679-4f16-9b96-6f73ede01f4f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:49.596851 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c004bd64-4eeb-4b73-bdae-f22f94be4852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fad5668932841848bff1058a4c9e2e6', 'request_id': 'req-c004bd64-4eeb-4b73-bdae-f22f94be4852'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:49.598090 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fe265-6679-4f16-9b96-6f73ede01f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:49.618476 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c004bd64-4eeb-4b73-bdae-f22f94be4852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fad5668932841848bff1058a4c9e2e6', 'request_id': 'req-c004bd64-4eeb-4b73-bdae-f22f94be4852'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:49.636240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c004bd64-4eeb-4b73-bdae-f22f94be4852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fad5668932841848bff1058a4c9e2e6', 'request_id': 'req-c004bd64-4eeb-4b73-bdae-f22f94be4852'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:49.652397 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-465fe265-6679-4f16-9b96-6f73ede01f4f None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:49.653775 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-465fe265-6679-4f16-9b96-6f73ede01f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:49.668981 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c004bd64-4eeb-4b73-bdae-f22f94be4852 admin admin] The token cache is being invalidate because project 0fad5668932841848bff1058a4c9e2e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:46:49.670907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c004bd64-4eeb-4b73-bdae-f22f94be4852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:49.672046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c004bd64-4eeb-4b73-bdae-f22f94be4852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:49.676681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 875/1748] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:46:49 2022] DELETE /identity/v3/projects/0fad5668932841848bff1058a4c9e2e6 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:49.677599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004bd64-4eeb-4b73-bdae-f22f94be4852 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:49.680321 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c004bd64-4eeb-4b73-bdae-f22f94be4852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:49.850132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 874/1749] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:49.857605 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fe265-6679-4f16-9b96-6f73ede01f4f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:49.857605 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-465fe265-6679-4f16-9b96-6f73ede01f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:49.906601 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004bd64-4eeb-4b73-bdae-f22f94be4852 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:49.924241 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715af740-273c-4390-ad98-9c9115602018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:49.924804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715af740-273c-4390-ad98-9c9115602018 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:49.932153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715af740-273c-4390-ad98-9c9115602018 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:49.933849 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715af740-273c-4390-ad98-9c9115602018 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:49.938661 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715af740-273c-4390-ad98-9c9115602018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:49.942497 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715af740-273c-4390-ad98-9c9115602018 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:49.970754 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 876/1750] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:49.976697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f995d-f842-4ef6-8fc5-d9e441e92c4a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:49.991179 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f995d-f842-4ef6-8fc5-d9e441e92c4a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:49.991955 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f995d-f842-4ef6-8fc5-d9e441e92c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:50.010252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:50.045877 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-fa6f995d-f842-4ef6-8fc5-d9e441e92c4a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:50.050688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fa6f995d-f842-4ef6-8fc5-d9e441e92c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:50.074409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fe265-6679-4f16-9b96-6f73ede01f4f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:50.083859 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 877/1751] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:50.086708 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bb0f4-639b-4545-b172-187e8286f5eb None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:50.088677 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bb0f4-639b-4545-b172-187e8286f5eb None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:50.101577 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bb0f4-639b-4545-b172-187e8286f5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:50.112216 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def766ad-646d-4d98-a657-d5e0399a6fd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:50.112891 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def766ad-646d-4d98-a657-d5e0399a6fd0 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:50.113172 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def766ad-646d-4d98-a657-d5e0399a6fd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:50.113444 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def766ad-646d-4d98-a657-d5e0399a6fd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:50.120989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-def766ad-646d-4d98-a657-d5e0399a6fd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:50.212826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7f8bb0f4-639b-4545-b172-187e8286f5eb None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:50.216381 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7f8bb0f4-639b-4545-b172-187e8286f5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:50.253695 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 878/1752] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:50.254589 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bb0f4-639b-4545-b172-187e8286f5eb None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:50.282622 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bb0f4-639b-4545-b172-187e8286f5eb None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:50.316700 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2293bf-1cc1-42a9-91c0-64b9e99735a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:50.317508 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2293bf-1cc1-42a9-91c0-64b9e99735a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:50.317795 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2293bf-1cc1-42a9-91c0-64b9e99735a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:50.318079 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2293bf-1cc1-42a9-91c0-64b9e99735a8 admin admin] PATH_INFO: `/v3/projects/732f0003c4c04ef9b59ba061c6ffd3b9/users/9647669de0654cab986b7336925e67c0/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:50.343127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2293bf-1cc1-42a9-91c0-64b9e99735a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=732f0003c4c04ef9b59ba061c6ffd3b9, user_id=9647669de0654cab986b7336925e67c0, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:50.347186 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2293bf-1cc1-42a9-91c0-64b9e99735a8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:50.371583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 879/1753] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:50 2022] PUT /identity/v3/projects/732f0003c4c04ef9b59ba061c6ffd3b9/users/9647669de0654cab986b7336925e67c0/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:50.372905 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b1f0d-6975-4d06-9b51-a29c7a48d8ba None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:50.373188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b1f0d-6975-4d06-9b51-a29c7a48d8ba None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:50.373606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b1f0d-6975-4d06-9b51-a29c7a48d8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:50.400336 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def766ad-646d-4d98-a657-d5e0399a6fd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:50.406574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d23b1f0d-6975-4d06-9b51-a29c7a48d8ba None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:50.407137 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def766ad-646d-4d98-a657-d5e0399a6fd0 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:50.421765 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d23b1f0d-6975-4d06-9b51-a29c7a48d8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:50.422153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 875/1754] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:50.423709 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474fd11-5695-4462-b02d-b544a16fa003 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:50.424263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474fd11-5695-4462-b02d-b544a16fa003 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:50.424732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474fd11-5695-4462-b02d-b544a16fa003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:50.461061 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e474fd11-5695-4462-b02d-b544a16fa003 None None] MFA Rules not processed for user `d0d2655f3c6a42898c67f82a697ef7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:50.465069 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e474fd11-5695-4462-b02d-b544a16fa003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:50.606332 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:50.660709 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 880/1755] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:50.661815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b1f0d-6975-4d06-9b51-a29c7a48d8ba None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:50.681228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b1f0d-6975-4d06-9b51-a29c7a48d8ba None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:50.695033 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87434e16-aa2f-45cc-a570-99f2ee4b6004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:50.695775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87434e16-aa2f-45cc-a570-99f2ee4b6004 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:50.695989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87434e16-aa2f-45cc-a570-99f2ee4b6004 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:50.696291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87434e16-aa2f-45cc-a570-99f2ee4b6004 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:50.696976 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87434e16-aa2f-45cc-a570-99f2ee4b6004 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:46:50.697301 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87434e16-aa2f-45cc-a570-99f2ee4b6004 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:50.701527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87434e16-aa2f-45cc-a570-99f2ee4b6004 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:50.724662 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 876/1756] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:50.726832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ec6f8-a8af-43c0-b621-71d3a9a8d2e5 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:50.731245 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ec6f8-a8af-43c0-b621-71d3a9a8d2e5 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:50.731780 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ec6f8-a8af-43c0-b621-71d3a9a8d2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:50.736646 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 881/1757] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:46:50.736646 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87434e16-aa2f-45cc-a570-99f2ee4b6004 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:50.858272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-a60ec6f8-a8af-43c0-b621-71d3a9a8d2e5 None None] MFA Rules not processed for user `9647669de0654cab986b7336925e67c0`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:50.864330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a60ec6f8-a8af-43c0-b621-71d3a9a8d2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:50.993895 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87434e16-aa2f-45cc-a570-99f2ee4b6004 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:50.999971 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723b303-1e73-4ec9-836f-8b323982ae46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:51.004270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723b303-1e73-4ec9-836f-8b323982ae46 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:51.005059 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723b303-1e73-4ec9-836f-8b323982ae46 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:51.007377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723b303-1e73-4ec9-836f-8b323982ae46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:51.011224 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1723b303-1e73-4ec9-836f-8b323982ae46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:51.110012 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 877/1758] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:51.112930 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ec6f8-a8af-43c0-b621-71d3a9a8d2e5 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:51.163172 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ec6f8-a8af-43c0-b621-71d3a9a8d2e5 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:51.187676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bfc4d-8d5d-4abf-b865-2fbfb9d8f29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:51.197336 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bfc4d-8d5d-4abf-b865-2fbfb9d8f29a admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:51.197745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bfc4d-8d5d-4abf-b865-2fbfb9d8f29a admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:51.198148 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bfc4d-8d5d-4abf-b865-2fbfb9d8f29a admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:51.200643 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bfc4d-8d5d-4abf-b865-2fbfb9d8f29a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:46:51.201545 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bfc4d-8d5d-4abf-b865-2fbfb9d8f29a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:51.206861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bfc4d-8d5d-4abf-b865-2fbfb9d8f29a admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:51.215895 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723b303-1e73-4ec9-836f-8b323982ae46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:51.238451 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723b303-1e73-4ec9-836f-8b323982ae46 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:51.262929 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 878/1759] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:46:51.264003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bfc4d-8d5d-4abf-b865-2fbfb9d8f29a admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:51.273174 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 882/1760] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:51.275341 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723b303-1e73-4ec9-836f-8b323982ae46 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:51.293478 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bfc4d-8d5d-4abf-b865-2fbfb9d8f29a admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:51.304325 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eacebb-3ebd-4e60-9ab9-896484b5b0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:51.306167 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eacebb-3ebd-4e60-9ab9-896484b5b0d1 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:51.306639 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eacebb-3ebd-4e60-9ab9-896484b5b0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:51.307017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eacebb-3ebd-4e60-9ab9-896484b5b0d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:51.308067 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eacebb-3ebd-4e60-9ab9-896484b5b0d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:51.310257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eacebb-3ebd-4e60-9ab9-896484b5b0d1 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:51.312682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723b303-1e73-4ec9-836f-8b323982ae46 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:51.328314 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26d083-e600-4061-a41e-69bfe768b3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:51.329189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26d083-e600-4061-a41e-69bfe768b3d6 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:51.331729 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26d083-e600-4061-a41e-69bfe768b3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:51.334697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26d083-e600-4061-a41e-69bfe768b3d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:51.335772 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26d083-e600-4061-a41e-69bfe768b3d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:51.340816 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26d083-e600-4061-a41e-69bfe768b3d6 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:51.356952 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:51.386507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 879/1761] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:51 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:51.386507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eacebb-3ebd-4e60-9ab9-896484b5b0d1 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:51.428873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 883/1762] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:51 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:51.430432 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26d083-e600-4061-a41e-69bfe768b3d6 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:51.616971 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eacebb-3ebd-4e60-9ab9-896484b5b0d1 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:51.618477 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7ecf2-ce32-435f-9fd1-d46881afebcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:51.620006 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7ecf2-ce32-435f-9fd1-d46881afebcd admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:51.620151 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26d083-e600-4061-a41e-69bfe768b3d6 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:51.620676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7ecf2-ce32-435f-9fd1-d46881afebcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:51.621633 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7ecf2-ce32-435f-9fd1-d46881afebcd admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:51.622149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7ecf2-ce32-435f-9fd1-d46881afebcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:51.625016 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7ecf2-ce32-435f-9fd1-d46881afebcd admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:51.629828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850caf2-f045-4ad0-af1c-d0af34b1761b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:51.630911 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850caf2-f045-4ad0-af1c-d0af34b1761b admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:51.631247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850caf2-f045-4ad0-af1c-d0af34b1761b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:51.631518 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850caf2-f045-4ad0-af1c-d0af34b1761b admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:51.632813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850caf2-f045-4ad0-af1c-d0af34b1761b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:51.638824 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850caf2-f045-4ad0-af1c-d0af34b1761b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:51.683906 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 880/1763] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:51 2022] POST /identity/v3/projects => generated 387 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:51.685083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7ecf2-ce32-435f-9fd1-d46881afebcd admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:51.692202 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 884/1764] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:51 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:51.700038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec3cee-5adf-4f5d-95f3-f1f8dc78c1a7 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:51.700669 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec3cee-5adf-4f5d-95f3-f1f8dc78c1a7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:51.702288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec3cee-5adf-4f5d-95f3-f1f8dc78c1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:51.747069 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:51.877387 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7ecf2-ce32-435f-9fd1-d46881afebcd admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:51.899847 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b591d7-0e1b-4f08-aaa9-a0358ca25d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:51.900483 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b591d7-0e1b-4f08-aaa9-a0358ca25d74 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:51.903976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b591d7-0e1b-4f08-aaa9-a0358ca25d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:51.904325 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b591d7-0e1b-4f08-aaa9-a0358ca25d74 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:51.905071 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b591d7-0e1b-4f08-aaa9-a0358ca25d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:51.907101 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b591d7-0e1b-4f08-aaa9-a0358ca25d74 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:51.912535 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-56ec3cee-5adf-4f5d-95f3-f1f8dc78c1a7 None None] MFA Rules not processed for user `bdc800f1d4174b5cba4f6f496207ec95`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:51.916410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-56ec3cee-5adf-4f5d-95f3-f1f8dc78c1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:51.988175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 881/1765] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:51 2022] POST /identity/v3/users => generated 298 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:51.992137 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b591d7-0e1b-4f08-aaa9-a0358ca25d74 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:52.020824 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b591d7-0e1b-4f08-aaa9-a0358ca25d74 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:52.034239 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e1317-0600-46a1-be12-7b6f295721cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:52.056619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e1317-0600-46a1-be12-7b6f295721cb admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:52.056619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e1317-0600-46a1-be12-7b6f295721cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:52.056619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e1317-0600-46a1-be12-7b6f295721cb admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:52.056619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e1317-0600-46a1-be12-7b6f295721cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:52.056619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e1317-0600-46a1-be12-7b6f295721cb admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:52.128344 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 882/1766] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:51 2022] POST /identity/v3/users => generated 294 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:52.132211 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e1317-0600-46a1-be12-7b6f295721cb admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:52.160779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 885/1767] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 10:46:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:52.162134 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec3cee-5adf-4f5d-95f3-f1f8dc78c1a7 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:52.185365 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e1317-0600-46a1-be12-7b6f295721cb admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:52.204449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec3cee-5adf-4f5d-95f3-f1f8dc78c1a7 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:52.218532 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31544d5f-76db-46ab-9353-cc9d7e9fbdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:52.219257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31544d5f-76db-46ab-9353-cc9d7e9fbdf9 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:52.219590 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31544d5f-76db-46ab-9353-cc9d7e9fbdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:52.219896 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31544d5f-76db-46ab-9353-cc9d7e9fbdf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:52.221869 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31544d5f-76db-46ab-9353-cc9d7e9fbdf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:52.225068 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31544d5f-76db-46ab-9353-cc9d7e9fbdf9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:52.229299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7b131-dde3-4cb2-9d15-078ae3affb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:52.230499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7b131-dde3-4cb2-9d15-078ae3affb14 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:52.231044 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7b131-dde3-4cb2-9d15-078ae3affb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:52.231545 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7b131-dde3-4cb2-9d15-078ae3affb14 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:52.232459 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7b131-dde3-4cb2-9d15-078ae3affb14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:52.234349 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7b131-dde3-4cb2-9d15-078ae3affb14 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:52.250379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 883/1768] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:52.252011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7b131-dde3-4cb2-9d15-078ae3affb14 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:52.263269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 886/1769] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:52.264819 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31544d5f-76db-46ab-9353-cc9d7e9fbdf9 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:52.268114 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7b131-dde3-4cb2-9d15-078ae3affb14 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:52.311966 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0cb14-90c3-4175-95fe-6a65cce67fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:52.313541 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0cb14-90c3-4175-95fe-6a65cce67fba admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:52.315691 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0cb14-90c3-4175-95fe-6a65cce67fba admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:52.316255 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0cb14-90c3-4175-95fe-6a65cce67fba admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:52.317087 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0cb14-90c3-4175-95fe-6a65cce67fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:52.321324 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0cb14-90c3-4175-95fe-6a65cce67fba admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:52.330243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31544d5f-76db-46ab-9353-cc9d7e9fbdf9 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:52.348159 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58143f8-8902-4a5a-9969-110ba740b0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:52.353142 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58143f8-8902-4a5a-9969-110ba740b0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:52.353619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58143f8-8902-4a5a-9969-110ba740b0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:52.356991 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58143f8-8902-4a5a-9969-110ba740b0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:52.360291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 884/1770] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:52.367256 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58143f8-8902-4a5a-9969-110ba740b0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:52.369257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58143f8-8902-4a5a-9969-110ba740b0b7 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:52.374978 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0cb14-90c3-4175-95fe-6a65cce67fba admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:52.419681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 887/1771] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:52.421742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58143f8-8902-4a5a-9969-110ba740b0b7 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:52.428817 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0cb14-90c3-4175-95fe-6a65cce67fba admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:52.439739 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58143f8-8902-4a5a-9969-110ba740b0b7 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:52.443939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186556dd-6f8f-4585-ab9f-a4270d762d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:52.444803 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186556dd-6f8f-4585-ab9f-a4270d762d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:52.445208 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186556dd-6f8f-4585-ab9f-a4270d762d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:52.445943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186556dd-6f8f-4585-ab9f-a4270d762d82 admin admin] PATH_INFO: `/v3/projects/a9aa60e5d5784cd98db1213f11ad58ab/users/eaf2fe48a7804c27bcd00cca3493aaa9/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:52.459700 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa86ff0-3cff-4cc1-87c9-4410efcfb437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:52.461205 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa86ff0-3cff-4cc1-87c9-4410efcfb437 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:52.461636 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa86ff0-3cff-4cc1-87c9-4410efcfb437 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:52.462044 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa86ff0-3cff-4cc1-87c9-4410efcfb437 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:52.462877 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa86ff0-3cff-4cc1-87c9-4410efcfb437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:52.465285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa86ff0-3cff-4cc1-87c9-4410efcfb437 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:52.478154 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186556dd-6f8f-4585-ab9f-a4270d762d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9aa60e5d5784cd98db1213f11ad58ab, user_id=eaf2fe48a7804c27bcd00cca3493aaa9, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:52.481406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186556dd-6f8f-4585-ab9f-a4270d762d82 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:52.499289 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 888/1772] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:52.500885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa86ff0-3cff-4cc1-87c9-4410efcfb437 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:52.504476 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-efa86ff0-3cff-4cc1-87c9-4410efcfb437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:52.541832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 885/1773] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:52 2022] PUT /identity/v3/projects/a9aa60e5d5784cd98db1213f11ad58ab/users/eaf2fe48a7804c27bcd00cca3493aaa9/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:52.542352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186556dd-6f8f-4585-ab9f-a4270d762d82 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:52.567335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:52.667244 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186556dd-6f8f-4585-ab9f-a4270d762d82 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:52.671873 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da5eaf-dcc7-426a-9c2f-d043fa267764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:52.672824 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da5eaf-dcc7-426a-9c2f-d043fa267764 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:52.673741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da5eaf-dcc7-426a-9c2f-d043fa267764 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:52.674139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da5eaf-dcc7-426a-9c2f-d043fa267764 admin admin] PATH_INFO: `/v3/projects/ec0a3ce44fd849aa8e89bb7f5f873db1/users/3094cc0f99124ebc9311ac9fe08786ef/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:52.695272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da5eaf-dcc7-426a-9c2f-d043fa267764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec0a3ce44fd849aa8e89bb7f5f873db1, user_id=3094cc0f99124ebc9311ac9fe08786ef, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:52.698816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da5eaf-dcc7-426a-9c2f-d043fa267764 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:52.728679 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 886/1774] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:52 2022] PUT /identity/v3/projects/ec0a3ce44fd849aa8e89bb7f5f873db1/users/3094cc0f99124ebc9311ac9fe08786ef/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:52.729701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da5eaf-dcc7-426a-9c2f-d043fa267764 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:52.780910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa86ff0-3cff-4cc1-87c9-4410efcfb437 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:52.811900 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:52.934638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da5eaf-dcc7-426a-9c2f-d043fa267764 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:52.947470 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ebe6a-d334-4d9b-8d34-e65a18b4a092 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ff72290fd14ddaba6ed757051e182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:52.948102 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ebe6a-d334-4d9b-8d34-e65a18b4a092 service swift] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:52.948378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ebe6a-d334-4d9b-8d34-e65a18b4a092 service swift] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:52.949251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ebe6a-d334-4d9b-8d34-e65a18b4a092 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:52.953464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184e867-cd3f-483c-ae03-69526c2f482c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:52.954166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184e867-cd3f-483c-ae03-69526c2f482c admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:52.957854 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184e867-cd3f-483c-ae03-69526c2f482c admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:52.958187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184e867-cd3f-483c-ae03-69526c2f482c admin admin] PATH_INFO: `/v3/projects/b819fbcb922045f283eea8df62a0b5ac/users/7201e5ab09ca4a569e0c7e72ec7811e7/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:53.039308 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184e867-cd3f-483c-ae03-69526c2f482c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b819fbcb922045f283eea8df62a0b5ac, user_id=7201e5ab09ca4a569e0c7e72ec7811e7, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:53.048213 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184e867-cd3f-483c-ae03-69526c2f482c admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:53.085660 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 887/1775] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:52 2022] PUT /identity/v3/projects/b819fbcb922045f283eea8df62a0b5ac/users/7201e5ab09ca4a569e0c7e72ec7811e7/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:53.088932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184e867-cd3f-483c-ae03-69526c2f482c admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:53.203740 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ebe6a-d334-4d9b-8d34-e65a18b4a092 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:53.221094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ebe6a-d334-4d9b-8d34-e65a18b4a092 service swift] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:53.256512 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 889/1776] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 10:46:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 756 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 10:46:53.259034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9c5bf-65fa-41d0-abdf-eeeb92f72471 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:53.259034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9c5bf-65fa-41d0-abdf-eeeb92f72471 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:53.260118 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9c5bf-65fa-41d0-abdf-eeeb92f72471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:53.331503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184e867-cd3f-483c-ae03-69526c2f482c admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:53.343697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe02da-48b4-4595-a3eb-8e0be67a9f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:53.344236 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe02da-48b4-4595-a3eb-8e0be67a9f22 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:53.344497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe02da-48b4-4595-a3eb-8e0be67a9f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:53.346213 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe02da-48b4-4595-a3eb-8e0be67a9f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:53.347054 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe02da-48b4-4595-a3eb-8e0be67a9f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:53.348505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe02da-48b4-4595-a3eb-8e0be67a9f22 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:53.374168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 888/1777] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:53.378653 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296a0da-b101-4a6a-a6ea-38695dad0277 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:53.378943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296a0da-b101-4a6a-a6ea-38695dad0277 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:53.379223 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296a0da-b101-4a6a-a6ea-38695dad0277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:53.455439 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-0296a0da-b101-4a6a-a6ea-38695dad0277 None None] MFA Rules not processed for user `7201e5ab09ca4a569e0c7e72ec7811e7`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:53.456377 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0296a0da-b101-4a6a-a6ea-38695dad0277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:53.474932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-18c9c5bf-65fa-41d0-abdf-eeeb92f72471 None None] MFA Rules not processed for user `3094cc0f99124ebc9311ac9fe08786ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:53.476206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-18c9c5bf-65fa-41d0-abdf-eeeb92f72471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:53.591487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:53.667772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 889/1778] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:53.668761 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296a0da-b101-4a6a-a6ea-38695dad0277 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:53.703840 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296a0da-b101-4a6a-a6ea-38695dad0277 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:53.722471 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b20235-0f89-427a-a5c0-3b521b4866d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:53.723189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b20235-0f89-427a-a5c0-3b521b4866d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:53.723447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b20235-0f89-427a-a5c0-3b521b4866d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:53.723786 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b20235-0f89-427a-a5c0-3b521b4866d4 admin admin] PATH_INFO: `/v3/projects/a9aa60e5d5784cd98db1213f11ad58ab/users/eaf2fe48a7804c27bcd00cca3493aaa9/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:53.741610 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b20235-0f89-427a-a5c0-3b521b4866d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9aa60e5d5784cd98db1213f11ad58ab, user_id=eaf2fe48a7804c27bcd00cca3493aaa9, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:53.752912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b20235-0f89-427a-a5c0-3b521b4866d4 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:53.809125 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 890/1779] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:53 2022] PUT /identity/v3/projects/a9aa60e5d5784cd98db1213f11ad58ab/users/eaf2fe48a7804c27bcd00cca3493aaa9/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:53.811408 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b20235-0f89-427a-a5c0-3b521b4866d4 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:53.812275 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 890/1780] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 555 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:53.813331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9c5bf-65fa-41d0-abdf-eeeb92f72471 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:53.828197 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9c5bf-65fa-41d0-abdf-eeeb92f72471 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:53.934915 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:54.094446 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea599f-0382-47da-b450-d6c5527a485e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:54.094781 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea599f-0382-47da-b450-d6c5527a485e admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:54.095183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea599f-0382-47da-b450-d6c5527a485e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:54.095557 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea599f-0382-47da-b450-d6c5527a485e admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:54.096048 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea599f-0382-47da-b450-d6c5527a485e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:54.106530 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea599f-0382-47da-b450-d6c5527a485e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:54.118358 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b20235-0f89-427a-a5c0-3b521b4866d4 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:54.144151 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782eff16-b67b-421f-b71e-96c8272e27e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:54.144820 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782eff16-b67b-421f-b71e-96c8272e27e0 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:54.145172 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782eff16-b67b-421f-b71e-96c8272e27e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:54.145369 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782eff16-b67b-421f-b71e-96c8272e27e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:54.146035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782eff16-b67b-421f-b71e-96c8272e27e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:54.148027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782eff16-b67b-421f-b71e-96c8272e27e0 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:54.217446 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 891/1781] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:53 2022] POST /identity/v3/projects => generated 373 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:54.218979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b3497-6f1d-4917-902d-fa6ca88bbbd5 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:54.219268 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b3497-6f1d-4917-902d-fa6ca88bbbd5 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:54.219570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b3497-6f1d-4917-902d-fa6ca88bbbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:54.264600 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 891/1782] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:53 2022] POST /identity/v3/projects => generated 383 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:54.267677 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6770ce-e035-4b1e-a748-c2de31bca319 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:54.268161 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6770ce-e035-4b1e-a748-c2de31bca319 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:54.268641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6770ce-e035-4b1e-a748-c2de31bca319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:54.321059 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-1b6770ce-e035-4b1e-a748-c2de31bca319 None None] MFA Rules not processed for user `2465a3ec985c4bacb213ad86ad45ab8f`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:54.323461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-1b6770ce-e035-4b1e-a748-c2de31bca319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:54.354648 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2c7b3497-6f1d-4917-902d-fa6ca88bbbd5 None None] MFA Rules not processed for user `eaf2fe48a7804c27bcd00cca3493aaa9`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:54.357834 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2c7b3497-6f1d-4917-902d-fa6ca88bbbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:54.499971 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 892/1783] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:54.501967 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6770ce-e035-4b1e-a748-c2de31bca319 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:54.624517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 892/1784] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:54.626176 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b3497-6f1d-4917-902d-fa6ca88bbbd5 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:54.787937 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6770ce-e035-4b1e-a748-c2de31bca319 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:54.818382 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001fcec-f99c-4a33-900d-52a15aa9cadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:54.819141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001fcec-f99c-4a33-900d-52a15aa9cadd admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:54.819426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001fcec-f99c-4a33-900d-52a15aa9cadd admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:54.819703 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001fcec-f99c-4a33-900d-52a15aa9cadd admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:54.827339 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001fcec-f99c-4a33-900d-52a15aa9cadd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:54.828586 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:54.833436 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001fcec-f99c-4a33-900d-52a15aa9cadd admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:54.904458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 893/1785] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:54 2022] POST /identity/v3/users => generated 293 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:54.907223 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001fcec-f99c-4a33-900d-52a15aa9cadd admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:54.916698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b3497-6f1d-4917-902d-fa6ca88bbbd5 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:54.930694 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfc0a1-6c82-4294-b6af-6cb8cb485c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:54.931689 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfc0a1-6c82-4294-b6af-6cb8cb485c96 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:54.932128 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfc0a1-6c82-4294-b6af-6cb8cb485c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:54.932469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfc0a1-6c82-4294-b6af-6cb8cb485c96 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:54.933602 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfc0a1-6c82-4294-b6af-6cb8cb485c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:54.943544 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfc0a1-6c82-4294-b6af-6cb8cb485c96 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:55.010657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 893/1786] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:54 2022] POST /identity/v3/users => generated 292 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:55.011981 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ac8b6-ac23-4ccb-afad-f5e0e43299ee None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:55.012261 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ac8b6-ac23-4ccb-afad-f5e0e43299ee None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:55.012529 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ac8b6-ac23-4ccb-afad-f5e0e43299ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:55.069304 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7c4ac8b6-ac23-4ccb-afad-f5e0e43299ee None None] MFA Rules not processed for user `133c5864d9544973a30ff77866522f15`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:55.071725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7c4ac8b6-ac23-4ccb-afad-f5e0e43299ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:55.113869 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:55.154363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001fcec-f99c-4a33-900d-52a15aa9cadd admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:55.165303 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051f4e1-956f-42c2-b767-0f04255634ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:55.169113 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051f4e1-956f-42c2-b767-0f04255634ec service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:55.169511 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051f4e1-956f-42c2-b767-0f04255634ec service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:55.169788 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051f4e1-956f-42c2-b767-0f04255634ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:55.206435 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051f4e1-956f-42c2-b767-0f04255634ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:55.210906 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051f4e1-956f-42c2-b767-0f04255634ec service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:55.231734 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 894/1787] 10.222.0.23 () {58 vars in 1015 bytes} [Sun Sep 11 10:46:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:55.245197 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ac8b6-ac23-4ccb-afad-f5e0e43299ee None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:55.307246 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 894/1788] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:55.316455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051f4e1-956f-42c2-b767-0f04255634ec service cinder] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:55.321703 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ac8b6-ac23-4ccb-afad-f5e0e43299ee None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:55.334294 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52898b6b-9cac-410f-8e27-020c1eab0d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:55.335502 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52898b6b-9cac-410f-8e27-020c1eab0d94 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:55.335630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52898b6b-9cac-410f-8e27-020c1eab0d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:55.335882 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52898b6b-9cac-410f-8e27-020c1eab0d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:55.338149 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52898b6b-9cac-410f-8e27-020c1eab0d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:55.344036 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051f4e1-956f-42c2-b767-0f04255634ec service cinder] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:55.346738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52898b6b-9cac-410f-8e27-020c1eab0d94 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:55.358235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c871e2c-5f91-4660-9d58-4fa3fb036f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:55.358836 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c871e2c-5f91-4660-9d58-4fa3fb036f46 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:55.359114 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c871e2c-5f91-4660-9d58-4fa3fb036f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:55.359386 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c871e2c-5f91-4660-9d58-4fa3fb036f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:55.360037 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c871e2c-5f91-4660-9d58-4fa3fb036f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:55.369906 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c871e2c-5f91-4660-9d58-4fa3fb036f46 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:55.380540 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 895/1789] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:55.386878 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52898b6b-9cac-410f-8e27-020c1eab0d94 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:55.391312 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-52898b6b-9cac-410f-8e27-020c1eab0d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:55.413564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 895/1790] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:55.415130 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c871e2c-5f91-4660-9d58-4fa3fb036f46 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:55.446184 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52898b6b-9cac-410f-8e27-020c1eab0d94 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:55.458041 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c871e2c-5f91-4660-9d58-4fa3fb036f46 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:55.459265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5efc0e-100a-483e-851b-886c6e966463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:55.459888 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5efc0e-100a-483e-851b-886c6e966463 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:55.460168 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5efc0e-100a-483e-851b-886c6e966463 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:55.460437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5efc0e-100a-483e-851b-886c6e966463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:55.481388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263d258-05c4-4ab5-8dfe-e8d1f1e2895f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:55.482077 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263d258-05c4-4ab5-8dfe-e8d1f1e2895f admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:55.482358 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263d258-05c4-4ab5-8dfe-e8d1f1e2895f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:55.485409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263d258-05c4-4ab5-8dfe-e8d1f1e2895f admin admin] PATH_INFO: `/v3/projects/ecc99ec9dd4a4385a9a46a603d39a61c/users/cc229babec0a47168b70a1834e950571/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:55.492084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5efc0e-100a-483e-851b-886c6e966463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:55.503509 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5efc0e-100a-483e-851b-886c6e966463 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:55.520276 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 896/1791] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:55.522220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5efc0e-100a-483e-851b-886c6e966463 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:55.542109 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263d258-05c4-4ab5-8dfe-e8d1f1e2895f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc99ec9dd4a4385a9a46a603d39a61c, user_id=cc229babec0a47168b70a1834e950571, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:55.558295 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263d258-05c4-4ab5-8dfe-e8d1f1e2895f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:55.594719 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5efc0e-100a-483e-851b-886c6e966463 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:55.621182 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 896/1792] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:55 2022] PUT /identity/v3/projects/ecc99ec9dd4a4385a9a46a603d39a61c/users/cc229babec0a47168b70a1834e950571/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:55.622207 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263d258-05c4-4ab5-8dfe-e8d1f1e2895f admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:55.831103 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3eb330-c87d-46d1-ac79-b1537406cb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:55.831741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3eb330-c87d-46d1-ac79-b1537406cb85 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:55.832017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3eb330-c87d-46d1-ac79-b1537406cb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:55.832285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3eb330-c87d-46d1-ac79-b1537406cb85 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:55.835378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3eb330-c87d-46d1-ac79-b1537406cb85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:55.838193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3eb330-c87d-46d1-ac79-b1537406cb85 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:55.879994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 897/1793] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:55.881199 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3eb330-c87d-46d1-ac79-b1537406cb85 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:55.883015 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cf3eb330-c87d-46d1-ac79-b1537406cb85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:56.000647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263d258-05c4-4ab5-8dfe-e8d1f1e2895f admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:56.015218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb505182-0f4e-4766-b54f-cb796048ca12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:56.016085 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb505182-0f4e-4766-b54f-cb796048ca12 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:56.016710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb505182-0f4e-4766-b54f-cb796048ca12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:56.017231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb505182-0f4e-4766-b54f-cb796048ca12 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:56.018317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb505182-0f4e-4766-b54f-cb796048ca12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:56.020152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb505182-0f4e-4766-b54f-cb796048ca12 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:56.058966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:56.065103 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 897/1794] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:56.065103 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb505182-0f4e-4766-b54f-cb796048ca12 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:56.069684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3eb330-c87d-46d1-ac79-b1537406cb85 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:56.085405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3422a1-e9c3-48ac-be4c-9c3e8c18aa83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:56.086190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3422a1-e9c3-48ac-be4c-9c3e8c18aa83 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:56.086498 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3422a1-e9c3-48ac-be4c-9c3e8c18aa83 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:56.086831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3422a1-e9c3-48ac-be4c-9c3e8c18aa83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:56.159605 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb505182-0f4e-4766-b54f-cb796048ca12 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:56.195299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923a8af-5c22-4ddf-a112-34cb68efffbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:56.196352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923a8af-5c22-4ddf-a112-34cb68efffbb admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:56.196352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923a8af-5c22-4ddf-a112-34cb68efffbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:56.196690 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923a8af-5c22-4ddf-a112-34cb68efffbb admin admin] PATH_INFO: `/v3/projects/671a35a0e71f48b298cdc355f37cc743/users/d97dc7c8f8d84ac5bd6e518f44a0bfd4/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:56.261225 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923a8af-5c22-4ddf-a112-34cb68efffbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=671a35a0e71f48b298cdc355f37cc743, user_id=d97dc7c8f8d84ac5bd6e518f44a0bfd4, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:56.264251 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923a8af-5c22-4ddf-a112-34cb68efffbb admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:56.321117 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 898/1795] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:56 2022] PUT /identity/v3/projects/671a35a0e71f48b298cdc355f37cc743/users/d97dc7c8f8d84ac5bd6e518f44a0bfd4/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:56.322156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923a8af-5c22-4ddf-a112-34cb68efffbb admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:56.337186 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3422a1-e9c3-48ac-be4c-9c3e8c18aa83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:56.341287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3422a1-e9c3-48ac-be4c-9c3e8c18aa83 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:56.411763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 898/1796] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:56.414016 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c3e98-8fb7-4347-8d73-0123c6d83de4 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:56.417642 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c3e98-8fb7-4347-8d73-0123c6d83de4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:56.418722 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c3e98-8fb7-4347-8d73-0123c6d83de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:56.555390 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9a6c3e98-8fb7-4347-8d73-0123c6d83de4 None None] MFA Rules not processed for user `d97dc7c8f8d84ac5bd6e518f44a0bfd4`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:56.558315 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9a6c3e98-8fb7-4347-8d73-0123c6d83de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:56.578560 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923a8af-5c22-4ddf-a112-34cb68efffbb admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:56.598918 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c95a5-7cf8-47b3-a6f9-6528b6452344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:56.600368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c95a5-7cf8-47b3-a6f9-6528b6452344 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:56.600712 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c95a5-7cf8-47b3-a6f9-6528b6452344 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:56.601006 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c95a5-7cf8-47b3-a6f9-6528b6452344 admin admin] PATH_INFO: `/v3/projects/ecc99ec9dd4a4385a9a46a603d39a61c/users/cc229babec0a47168b70a1834e950571/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:56.608226 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c95a5-7cf8-47b3-a6f9-6528b6452344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc99ec9dd4a4385a9a46a603d39a61c, user_id=cc229babec0a47168b70a1834e950571, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:56.624114 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c95a5-7cf8-47b3-a6f9-6528b6452344 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:56.695845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 899/1797] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:56 2022] PUT /identity/v3/projects/ecc99ec9dd4a4385a9a46a603d39a61c/users/cc229babec0a47168b70a1834e950571/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:56.717844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4acce-774a-4428-ab6d-ee2c8a4c662e None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:56.718130 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4acce-774a-4428-ab6d-ee2c8a4c662e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:56.718417 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4acce-774a-4428-ab6d-ee2c8a4c662e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:56.819032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-39b4acce-774a-4428-ab6d-ee2c8a4c662e None None] MFA Rules not processed for user `cc229babec0a47168b70a1834e950571`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:56.820294 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-39b4acce-774a-4428-ab6d-ee2c8a4c662e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:56.832092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:56.852710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 899/1798] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:56.856016 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c3e98-8fb7-4347-8d73-0123c6d83de4 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:56.898071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c3e98-8fb7-4347-8d73-0123c6d83de4 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:57.016350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 900/1799] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:57.088160 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4acce-774a-4428-ab6d-ee2c8a4c662e None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:57.103591 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57794980-dd33-4d83-bdf7-c35118d16d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:57.104226 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57794980-dd33-4d83-bdf7-c35118d16d32 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:57.104509 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57794980-dd33-4d83-bdf7-c35118d16d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:57.104811 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57794980-dd33-4d83-bdf7-c35118d16d32 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:57.109739 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57794980-dd33-4d83-bdf7-c35118d16d32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:57.120682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57794980-dd33-4d83-bdf7-c35118d16d32 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:57.193629 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 900/1800] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:46:56 2022] POST /identity/v3/projects => generated 387 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:46:57.195153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57794980-dd33-4d83-bdf7-c35118d16d32 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:57.233315 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4acce-774a-4428-ab6d-ee2c8a4c662e None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:57.248182 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:57.362908 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57794980-dd33-4d83-bdf7-c35118d16d32 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:57.382875 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51efb2e-3622-4f15-8559-a085f3eb5847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:57.386620 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51efb2e-3622-4f15-8559-a085f3eb5847 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:57.387251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51efb2e-3622-4f15-8559-a085f3eb5847 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:57.388082 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51efb2e-3622-4f15-8559-a085f3eb5847 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:57.390432 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51efb2e-3622-4f15-8559-a085f3eb5847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:57.399135 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51efb2e-3622-4f15-8559-a085f3eb5847 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:57.422486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf80e4-12a6-494b-bde6-29c741dd30b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:57.423201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf80e4-12a6-494b-bde6-29c741dd30b6 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:57.423490 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf80e4-12a6-494b-bde6-29c741dd30b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:57.423770 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf80e4-12a6-494b-bde6-29c741dd30b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:57.492925 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 901/1801] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:46:57 2022] POST /identity/v3/users => generated 300 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:46:57.497653 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51efb2e-3622-4f15-8559-a085f3eb5847 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:57.523289 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51efb2e-3622-4f15-8559-a085f3eb5847 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:57.530547 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6997e7-ed9a-48a7-b43b-aba334f69645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:57.531352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6997e7-ed9a-48a7-b43b-aba334f69645 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:57.531708 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6997e7-ed9a-48a7-b43b-aba334f69645 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:57.533930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6997e7-ed9a-48a7-b43b-aba334f69645 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:57.535020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6997e7-ed9a-48a7-b43b-aba334f69645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:57.557492 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6997e7-ed9a-48a7-b43b-aba334f69645 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:57.561252 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf80e4-12a6-494b-bde6-29c741dd30b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:57.562870 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf80e4-12a6-494b-bde6-29c741dd30b6 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:57.588980 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 902/1802] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:57.590742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6997e7-ed9a-48a7-b43b-aba334f69645 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:57.600937 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 901/1803] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 10:46:57.617321 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6997e7-ed9a-48a7-b43b-aba334f69645 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:57.630519 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3f9a6-0159-423a-b001-f06049e03581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:57.631378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3f9a6-0159-423a-b001-f06049e03581 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:57.634061 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3f9a6-0159-423a-b001-f06049e03581 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:57.634061 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3f9a6-0159-423a-b001-f06049e03581 admin admin] PATH_INFO: `/v3/projects/989344b4958b417baf658ea1ff8f63d7/users/9136fe54b40045689e6fb8cba0dda9ca/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:57.678386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3f9a6-0159-423a-b001-f06049e03581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=989344b4958b417baf658ea1ff8f63d7, user_id=9136fe54b40045689e6fb8cba0dda9ca, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:57.681387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3f9a6-0159-423a-b001-f06049e03581 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:57.721398 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 903/1804] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:57 2022] PUT /identity/v3/projects/989344b4958b417baf658ea1ff8f63d7/users/9136fe54b40045689e6fb8cba0dda9ca/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:57.725141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf80e4-12a6-494b-bde6-29c741dd30b6 service cinder] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:57.726673 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3f9a6-0159-423a-b001-f06049e03581 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:57.764664 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf80e4-12a6-494b-bde6-29c741dd30b6 service cinder] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:57.783587 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:57.822815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3f9a6-0159-423a-b001-f06049e03581 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:57.828840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9ff6c-6a1a-4a50-9e97-2c1de3a91b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:57.830220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9ff6c-6a1a-4a50-9e97-2c1de3a91b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:57.830504 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9ff6c-6a1a-4a50-9e97-2c1de3a91b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:57.830850 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9ff6c-6a1a-4a50-9e97-2c1de3a91b29 admin admin] PATH_INFO: `/v3/users/9647669de0654cab986b7336925e67c0` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:57.832226 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9ff6c-6a1a-4a50-9e97-2c1de3a91b29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9647669de0654cab986b7336925e67c0)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:57.835418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9ff6c-6a1a-4a50-9e97-2c1de3a91b29 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:57.937492 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5aa9ff6c-6a1a-4a50-9e97-2c1de3a91b29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9647669de0654cab986b7336925e67c0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:57.956589 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5aa9ff6c-6a1a-4a50-9e97-2c1de3a91b29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9647669de0654cab986b7336925e67c0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:57.957633 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5aa9ff6c-6a1a-4a50-9e97-2c1de3a91b29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9647669de0654cab986b7336925e67c0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:57.958564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5aa9ff6c-6a1a-4a50-9e97-2c1de3a91b29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9647669de0654cab986b7336925e67c0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:57.978481 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5aa9ff6c-6a1a-4a50-9e97-2c1de3a91b29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9647669de0654cab986b7336925e67c0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:58.001011 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:58.030500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 904/1805] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:46:57 2022] DELETE /identity/v3/users/9647669de0654cab986b7336925e67c0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:58.036229 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822b98c-bdef-4467-99ff-101c1d53f3f4 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:58.036618 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822b98c-bdef-4467-99ff-101c1d53f3f4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:58.036907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822b98c-bdef-4467-99ff-101c1d53f3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:58.072124 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56c552-1781-471c-9f28-bfff72d9b9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:58.074179 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56c552-1781-471c-9f28-bfff72d9b9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:58.074179 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56c552-1781-471c-9f28-bfff72d9b9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:58.074179 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56c552-1781-471c-9f28-bfff72d9b9e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:58.074179 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56c552-1781-471c-9f28-bfff72d9b9e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:58.080353 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56c552-1781-471c-9f28-bfff72d9b9e8 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:58.096657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c822b98c-bdef-4467-99ff-101c1d53f3f4 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:58.100426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c822b98c-bdef-4467-99ff-101c1d53f3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:58.111089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 902/1806] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:46:58.114352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56c552-1781-471c-9f28-bfff72d9b9e8 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:58.122781 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-cf56c552-1781-471c-9f28-bfff72d9b9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:58.175353 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56c552-1781-471c-9f28-bfff72d9b9e8 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:58.309207 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 905/1807] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:46:58.397137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822b98c-bdef-4467-99ff-101c1d53f3f4 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:58.398449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c822b98c-bdef-4467-99ff-101c1d53f3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:58.495050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446be269-cfc0-4059-97a2-22224d1d99a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:58.495751 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446be269-cfc0-4059-97a2-22224d1d99a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:58.496026 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446be269-cfc0-4059-97a2-22224d1d99a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:58.500109 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446be269-cfc0-4059-97a2-22224d1d99a2 admin admin] PATH_INFO: `/v3/projects/989344b4958b417baf658ea1ff8f63d7/users/9136fe54b40045689e6fb8cba0dda9ca/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:58.505611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446be269-cfc0-4059-97a2-22224d1d99a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=989344b4958b417baf658ea1ff8f63d7, user_id=9136fe54b40045689e6fb8cba0dda9ca, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:58.518551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446be269-cfc0-4059-97a2-22224d1d99a2 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:58.576122 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 903/1808] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:46:58 2022] PUT /identity/v3/projects/989344b4958b417baf658ea1ff8f63d7/users/9136fe54b40045689e6fb8cba0dda9ca/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:58.588631 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82636a6-a60c-4df0-b836-8c6574995fe8 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:58.589686 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82636a6-a60c-4df0-b836-8c6574995fe8 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:58.590310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82636a6-a60c-4df0-b836-8c6574995fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:58.617128 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822b98c-bdef-4467-99ff-101c1d53f3f4 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:58.741359 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e82636a6-a60c-4df0-b836-8c6574995fe8 None None] MFA Rules not processed for user `9136fe54b40045689e6fb8cba0dda9ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:58.750360 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e82636a6-a60c-4df0-b836-8c6574995fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:58.766765 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777e5c4-b14c-49ca-9331-a4790b0a0939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:58.767457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777e5c4-b14c-49ca-9331-a4790b0a0939 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:58.767742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777e5c4-b14c-49ca-9331-a4790b0a0939 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:58.768089 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777e5c4-b14c-49ca-9331-a4790b0a0939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:58.926873 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 904/1809] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:58 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:46:58.998660 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82636a6-a60c-4df0-b836-8c6574995fe8 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:59.000103 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e82636a6-a60c-4df0-b836-8c6574995fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:59.060038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777e5c4-b14c-49ca-9331-a4790b0a0939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:59.061805 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777e5c4-b14c-49ca-9331-a4790b0a0939 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:59.071279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:59.084126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:46:59.102808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 906/1810] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:59.105361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777e5c4-b14c-49ca-9331-a4790b0a0939 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:59.110030 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8777e5c4-b14c-49ca-9331-a4790b0a0939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:59.163992 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82636a6-a60c-4df0-b836-8c6574995fe8 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:59.174773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233c8da-32b7-440b-aa21-8757816f9922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:59.175747 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233c8da-32b7-440b-aa21-8757816f9922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:59.176210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233c8da-32b7-440b-aa21-8757816f9922 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:59.176690 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233c8da-32b7-440b-aa21-8757816f9922 admin admin] PATH_INFO: `/v3/users/3094cc0f99124ebc9311ac9fe08786ef` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:59.178066 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233c8da-32b7-440b-aa21-8757816f9922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3094cc0f99124ebc9311ac9fe08786ef)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:59.180206 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233c8da-32b7-440b-aa21-8757816f9922 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:59.271780 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777e5c4-b14c-49ca-9331-a4790b0a0939 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:59.288241 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508d5ea-9d1a-443c-9044-fcfeda1a603b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:59.299861 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8233c8da-32b7-440b-aa21-8757816f9922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3094cc0f99124ebc9311ac9fe08786ef'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:59.300713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508d5ea-9d1a-443c-9044-fcfeda1a603b service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:59.301463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508d5ea-9d1a-443c-9044-fcfeda1a603b service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:59.301951 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508d5ea-9d1a-443c-9044-fcfeda1a603b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:59.317346 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8233c8da-32b7-440b-aa21-8757816f9922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3094cc0f99124ebc9311ac9fe08786ef'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:59.318415 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8233c8da-32b7-440b-aa21-8757816f9922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3094cc0f99124ebc9311ac9fe08786ef'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:59.319212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8233c8da-32b7-440b-aa21-8757816f9922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3094cc0f99124ebc9311ac9fe08786ef'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:59.333409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8233c8da-32b7-440b-aa21-8757816f9922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3094cc0f99124ebc9311ac9fe08786ef'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:46:59.344171 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508d5ea-9d1a-443c-9044-fcfeda1a603b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:59.346435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508d5ea-9d1a-443c-9044-fcfeda1a603b service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:59.369735 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 907/1811] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:46:59.374729 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 905/1812] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:46:58 2022] DELETE /identity/v3/users/3094cc0f99124ebc9311ac9fe08786ef => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:46:59.377481 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deae927-afca-428d-b6aa-e6e744c1fb4f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:59.377774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deae927-afca-428d-b6aa-e6e744c1fb4f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:59.378171 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deae927-afca-428d-b6aa-e6e744c1fb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:59.434664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3deae927-afca-428d-b6aa-e6e744c1fb4f None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:59.437969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3deae927-afca-428d-b6aa-e6e744c1fb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:59.613265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 908/1813] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:46:59.672529 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233c8da-32b7-440b-aa21-8757816f9922 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:46:59.674092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8233c8da-32b7-440b-aa21-8757816f9922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:59.755025 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c4766-70d9-40d2-af28-549b1978529e None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:59.755329 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c4766-70d9-40d2-af28-549b1978529e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:59.756592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c4766-70d9-40d2-af28-549b1978529e None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:59.757195 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 909/1814] 10.222.0.20 () {54 vars in 921 bytes} [Sun Sep 11 10:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:46:59.814779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233c8da-32b7-440b-aa21-8757816f9922 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:46:59.824344 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac276112-565e-4a81-b7dd-332578452435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:46:59.825032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac276112-565e-4a81-b7dd-332578452435 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:59.825307 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac276112-565e-4a81-b7dd-332578452435 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:59.825581 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac276112-565e-4a81-b7dd-332578452435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:59.828399 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd213cc-db3c-4d75-b7b4-b4782be68fd5 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:46:59.828723 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd213cc-db3c-4d75-b7b4-b4782be68fd5 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:46:59.829039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd213cc-db3c-4d75-b7b4-b4782be68fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:46:59.845618 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac276112-565e-4a81-b7dd-332578452435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:46:59.847057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac276112-565e-4a81-b7dd-332578452435 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:46:59.884019 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-6dd213cc-db3c-4d75-b7b4-b4782be68fd5 None None] MFA Rules not processed for user `b642a1d00de940429fc1cc6131ac22b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:46:59.885357 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6dd213cc-db3c-4d75-b7b4-b4782be68fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:46:59.885491 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 906/1815] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:46:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:00.155522 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 910/1816] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Sep 11 10:46:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:47:00.495100 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771a64f-54a1-468a-820e-5176e7f928e6 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:00.495722 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771a64f-54a1-468a-820e-5176e7f928e6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:00.496145 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771a64f-54a1-468a-820e-5176e7f928e6 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:00.498340 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 907/1817] 10.222.0.20 () {54 vars in 921 bytes} [Sun Sep 11 10:47:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:47:01.089095 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb4e21-ca74-4ef5-bba7-5914554abbe0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:01.090050 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb4e21-ca74-4ef5-bba7-5914554abbe0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:01.090484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb4e21-ca74-4ef5-bba7-5914554abbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:01.230544 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3fbb4e21-ca74-4ef5-bba7-5914554abbe0 None None] MFA Rules not processed for user `b642a1d00de940429fc1cc6131ac22b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:01.240375 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3fbb4e21-ca74-4ef5-bba7-5914554abbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:01.306574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 911/1818] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Sep 11 10:47:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:01.408167 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771a64f-54a1-468a-820e-5176e7f928e6 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:01.411069 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0771a64f-54a1-468a-820e-5176e7f928e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:01.445126 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771a64f-54a1-468a-820e-5176e7f928e6 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:01.497871 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4335d5-ce62-4c38-be3e-f7911589fa7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:01.498514 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4335d5-ce62-4c38-be3e-f7911589fa7e service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:01.510381 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4335d5-ce62-4c38-be3e-f7911589fa7e service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:01.510700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4335d5-ce62-4c38-be3e-f7911589fa7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:01.550666 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4335d5-ce62-4c38-be3e-f7911589fa7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:01.553621 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4335d5-ce62-4c38-be3e-f7911589fa7e service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:01.599162 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb4e21-ca74-4ef5-bba7-5914554abbe0 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:01.601065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3fbb4e21-ca74-4ef5-bba7-5914554abbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:01.637957 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 908/1819] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:01.652057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4335d5-ce62-4c38-be3e-f7911589fa7e service nova] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:01.654992 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ab4335d5-ce62-4c38-be3e-f7911589fa7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:01.725742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4335d5-ce62-4c38-be3e-f7911589fa7e service nova] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:01.762347 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:01.789879 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68401d-ccf9-4485-991a-483901059d04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:01.790590 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68401d-ccf9-4485-991a-483901059d04 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:01.813783 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68401d-ccf9-4485-991a-483901059d04 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:01.814228 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68401d-ccf9-4485-991a-483901059d04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:01.851505 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb4e21-ca74-4ef5-bba7-5914554abbe0 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:01.857881 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68401d-ccf9-4485-991a-483901059d04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:01.858829 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a4edd-ed0b-4092-95a4-0c8e15e33f19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:01.859633 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a4edd-ed0b-4092-95a4-0c8e15e33f19 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:01.860380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68401d-ccf9-4485-991a-483901059d04 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:01.863376 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a4edd-ed0b-4092-95a4-0c8e15e33f19 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:01.864732 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a4edd-ed0b-4092-95a4-0c8e15e33f19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:01.870890 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-551a4edd-ed0b-4092-95a4-0c8e15e33f19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:01.919795 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 909/1820] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 10:47:02.027908 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a4edd-ed0b-4092-95a4-0c8e15e33f19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:02.031581 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a4edd-ed0b-4092-95a4-0c8e15e33f19 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:02.062888 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 912/1821] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 10:47:02.169598 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68401d-ccf9-4485-991a-483901059d04 service nova] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:02.171258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7e68401d-ccf9-4485-991a-483901059d04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:02.203173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68401d-ccf9-4485-991a-483901059d04 service nova] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:02.223769 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac0b17-387b-48b2-80f6-2faf2668d8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:02.224503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac0b17-387b-48b2-80f6-2faf2668d8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:02.224988 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac0b17-387b-48b2-80f6-2faf2668d8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:02.225117 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac0b17-387b-48b2-80f6-2faf2668d8e6 admin admin] PATH_INFO: `/v3/projects/732f0003c4c04ef9b59ba061c6ffd3b9` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:02.229715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac0b17-387b-48b2-80f6-2faf2668d8e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=732f0003c4c04ef9b59ba061c6ffd3b9)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:02.248123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac0b17-387b-48b2-80f6-2faf2668d8e6 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:02.305901 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:02.425651 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-7bac0b17-387b-48b2-80f6-2faf2668d8e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732f0003c4c04ef9b59ba061c6ffd3b9', 'request_id': 'req-7bac0b17-387b-48b2-80f6-2faf2668d8e6'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:02.474227 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-7bac0b17-387b-48b2-80f6-2faf2668d8e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732f0003c4c04ef9b59ba061c6ffd3b9', 'request_id': 'req-7bac0b17-387b-48b2-80f6-2faf2668d8e6'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:02.512671 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-7bac0b17-387b-48b2-80f6-2faf2668d8e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732f0003c4c04ef9b59ba061c6ffd3b9', 'request_id': 'req-7bac0b17-387b-48b2-80f6-2faf2668d8e6'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:02.575524 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-7bac0b17-387b-48b2-80f6-2faf2668d8e6 admin admin] The token cache is being invalidate because project 732f0003c4c04ef9b59ba061c6ffd3b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:02.575826 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-7bac0b17-387b-48b2-80f6-2faf2668d8e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:02.585480 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-7bac0b17-387b-48b2-80f6-2faf2668d8e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:02.596520 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 910/1822] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:02 2022] DELETE /identity/v3/projects/732f0003c4c04ef9b59ba061c6ffd3b9 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:02.600687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a4edd-ed0b-4092-95a4-0c8e15e33f19 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:02.618022 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a4edd-ed0b-4092-95a4-0c8e15e33f19 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:02.759786 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac0b17-387b-48b2-80f6-2faf2668d8e6 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:02.761283 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7bac0b17-387b-48b2-80f6-2faf2668d8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:02.812229 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e45c8f-58de-4fb2-acec-91f718da8802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:02.813201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e45c8f-58de-4fb2-acec-91f718da8802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:02.814077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e45c8f-58de-4fb2-acec-91f718da8802 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:02.814446 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e45c8f-58de-4fb2-acec-91f718da8802 admin admin] PATH_INFO: `/v3/users/eaf2fe48a7804c27bcd00cca3493aaa9` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:02.820835 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e45c8f-58de-4fb2-acec-91f718da8802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf2fe48a7804c27bcd00cca3493aaa9)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:02.827872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e45c8f-58de-4fb2-acec-91f718da8802 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:02.935917 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac0b17-387b-48b2-80f6-2faf2668d8e6 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:02.942910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a8a83-8471-49f8-bafd-4f20ce83984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:02.943791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a8a83-8471-49f8-bafd-4f20ce83984c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:02.944027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-05e45c8f-58de-4fb2-acec-91f718da8802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf2fe48a7804c27bcd00cca3493aaa9'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:02.944381 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a8a83-8471-49f8-bafd-4f20ce83984c admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:02.944829 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a8a83-8471-49f8-bafd-4f20ce83984c admin admin] PATH_INFO: `/v3/users/49b992f955c6416584ecf6ecbdbd177d` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:02.946534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a8a83-8471-49f8-bafd-4f20ce83984c admin admin] RBAC: Authorizing `identity:delete_user(user_id=49b992f955c6416584ecf6ecbdbd177d)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:02.949105 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a8a83-8471-49f8-bafd-4f20ce83984c admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:02.959910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-05e45c8f-58de-4fb2-acec-91f718da8802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf2fe48a7804c27bcd00cca3493aaa9'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:02.960859 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-05e45c8f-58de-4fb2-acec-91f718da8802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf2fe48a7804c27bcd00cca3493aaa9'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:02.964969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-05e45c8f-58de-4fb2-acec-91f718da8802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf2fe48a7804c27bcd00cca3493aaa9'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:02.977309 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-05e45c8f-58de-4fb2-acec-91f718da8802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf2fe48a7804c27bcd00cca3493aaa9'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:03.055999 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:03.067518 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 913/1823] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:02 2022] DELETE /identity/v3/users/eaf2fe48a7804c27bcd00cca3493aaa9 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:03.094912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-679a8a83-8471-49f8-bafd-4f20ce83984c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49b992f955c6416584ecf6ecbdbd177d'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:03.115658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-679a8a83-8471-49f8-bafd-4f20ce83984c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49b992f955c6416584ecf6ecbdbd177d'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:03.116439 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-679a8a83-8471-49f8-bafd-4f20ce83984c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49b992f955c6416584ecf6ecbdbd177d'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:03.117191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-679a8a83-8471-49f8-bafd-4f20ce83984c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49b992f955c6416584ecf6ecbdbd177d'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:03.163503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-679a8a83-8471-49f8-bafd-4f20ce83984c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49b992f955c6416584ecf6ecbdbd177d'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:03.178317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e45c8f-58de-4fb2-acec-91f718da8802 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:03.179875 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-05e45c8f-58de-4fb2-acec-91f718da8802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:03.197488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 911/1824] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:02 2022] DELETE /identity/v3/users/49b992f955c6416584ecf6ecbdbd177d => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:03.201686 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126705-8654-4255-a77d-544f11ef7be5 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:03.202096 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126705-8654-4255-a77d-544f11ef7be5 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:03.202488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126705-8654-4255-a77d-544f11ef7be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:03.240002 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-82126705-8654-4255-a77d-544f11ef7be5 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:03.241625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-82126705-8654-4255-a77d-544f11ef7be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:03.283185 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:03.374018 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e45c8f-58de-4fb2-acec-91f718da8802 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:03.405832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 912/1825] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:03.459785 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82126705-8654-4255-a77d-544f11ef7be5 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:03.462305 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-82126705-8654-4255-a77d-544f11ef7be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:03.571122 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcc834-1733-4941-a02a-66900f0b8e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:03.571782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcc834-1733-4941-a02a-66900f0b8e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:03.572058 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcc834-1733-4941-a02a-66900f0b8e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:03.572323 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcc834-1733-4941-a02a-66900f0b8e0c admin admin] PATH_INFO: `/v3/users/4cc0dd61b1764f02989fd80d55117a90` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:03.581472 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcc834-1733-4941-a02a-66900f0b8e0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc0dd61b1764f02989fd80d55117a90)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:03.583472 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcc834-1733-4941-a02a-66900f0b8e0c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:03.586331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82126705-8654-4255-a77d-544f11ef7be5 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:03.595447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c966dd-e45e-4a55-981f-85f3ae22a992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:03.596233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c966dd-e45e-4a55-981f-85f3ae22a992 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:03.596729 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c966dd-e45e-4a55-981f-85f3ae22a992 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:03.597123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c966dd-e45e-4a55-981f-85f3ae22a992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:03.628376 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c966dd-e45e-4a55-981f-85f3ae22a992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:03.630366 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c966dd-e45e-4a55-981f-85f3ae22a992 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:03.653292 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 913/1826] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:03.728189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-78bcc834-1733-4941-a02a-66900f0b8e0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc0dd61b1764f02989fd80d55117a90'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:03.738844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-78bcc834-1733-4941-a02a-66900f0b8e0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc0dd61b1764f02989fd80d55117a90'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:03.740043 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-78bcc834-1733-4941-a02a-66900f0b8e0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc0dd61b1764f02989fd80d55117a90'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:03.743492 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-78bcc834-1733-4941-a02a-66900f0b8e0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc0dd61b1764f02989fd80d55117a90'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:03.760196 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-78bcc834-1733-4941-a02a-66900f0b8e0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc0dd61b1764f02989fd80d55117a90'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:03.790654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 914/1827] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:03 2022] DELETE /identity/v3/users/4cc0dd61b1764f02989fd80d55117a90 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:03.794833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363bbc5-07ac-4b6d-8faf-6c7992a31ad6 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:03.795357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363bbc5-07ac-4b6d-8faf-6c7992a31ad6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:03.795803 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363bbc5-07ac-4b6d-8faf-6c7992a31ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:03.849760 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-7363bbc5-07ac-4b6d-8faf-6c7992a31ad6 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:03.853672 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7363bbc5-07ac-4b6d-8faf-6c7992a31ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:03.917187 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcc834-1733-4941-a02a-66900f0b8e0c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:03.919458 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-78bcc834-1733-4941-a02a-66900f0b8e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:04.006964 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:04.084631 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 914/1828] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:04.092828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcc834-1733-4941-a02a-66900f0b8e0c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:04.100390 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363bbc5-07ac-4b6d-8faf-6c7992a31ad6 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:04.103097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7363bbc5-07ac-4b6d-8faf-6c7992a31ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:04.109668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac5aae-8d2e-49a3-8677-ecc88cde8465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:04.110419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac5aae-8d2e-49a3-8677-ecc88cde8465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:04.110706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac5aae-8d2e-49a3-8677-ecc88cde8465 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:04.110985 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac5aae-8d2e-49a3-8677-ecc88cde8465 admin admin] PATH_INFO: `/v3/projects/ec0a3ce44fd849aa8e89bb7f5f873db1` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:04.112274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac5aae-8d2e-49a3-8677-ecc88cde8465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec0a3ce44fd849aa8e89bb7f5f873db1)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:04.114813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac5aae-8d2e-49a3-8677-ecc88cde8465 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:04.250516 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-abac5aae-8d2e-49a3-8677-ecc88cde8465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec0a3ce44fd849aa8e89bb7f5f873db1', 'request_id': 'req-abac5aae-8d2e-49a3-8677-ecc88cde8465'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:04.278715 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-abac5aae-8d2e-49a3-8677-ecc88cde8465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec0a3ce44fd849aa8e89bb7f5f873db1', 'request_id': 'req-abac5aae-8d2e-49a3-8677-ecc88cde8465'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:04.309205 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-abac5aae-8d2e-49a3-8677-ecc88cde8465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec0a3ce44fd849aa8e89bb7f5f873db1', 'request_id': 'req-abac5aae-8d2e-49a3-8677-ecc88cde8465'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:04.354555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-abac5aae-8d2e-49a3-8677-ecc88cde8465 admin admin] The token cache is being invalidate because project ec0a3ce44fd849aa8e89bb7f5f873db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:04.355122 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-abac5aae-8d2e-49a3-8677-ecc88cde8465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:04.355856 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-abac5aae-8d2e-49a3-8677-ecc88cde8465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:04.361357 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 915/1829] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:03 2022] DELETE /identity/v3/projects/ec0a3ce44fd849aa8e89bb7f5f873db1 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:47:04.362205 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac5aae-8d2e-49a3-8677-ecc88cde8465 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:04.363978 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-abac5aae-8d2e-49a3-8677-ecc88cde8465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:04.398533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363bbc5-07ac-4b6d-8faf-6c7992a31ad6 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:04.459718 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:04.538524 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac5aae-8d2e-49a3-8677-ecc88cde8465 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:04.555736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220dee77-9b0a-434c-8744-4ef8cd1952ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:04.558328 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dee77-9b0a-434c-8744-4ef8cd1952ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:04.560035 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dee77-9b0a-434c-8744-4ef8cd1952ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:04.560326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dee77-9b0a-434c-8744-4ef8cd1952ef admin admin] PATH_INFO: `/v3/users/cc229babec0a47168b70a1834e950571` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:04.566113 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220dee77-9b0a-434c-8744-4ef8cd1952ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc229babec0a47168b70a1834e950571)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:04.569467 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220dee77-9b0a-434c-8744-4ef8cd1952ef admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:04.584833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0815167-a50c-4846-bc77-50308a98c065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:04.590381 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0815167-a50c-4846-bc77-50308a98c065 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:04.591454 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0815167-a50c-4846-bc77-50308a98c065 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:04.591956 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0815167-a50c-4846-bc77-50308a98c065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:04.597105 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b0815167-a50c-4846-bc77-50308a98c065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:04.628578 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0815167-a50c-4846-bc77-50308a98c065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:04.642268 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0815167-a50c-4846-bc77-50308a98c065 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:04.669750 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 915/1830] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 10:47:04.670836 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0815167-a50c-4846-bc77-50308a98c065 service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:04.672269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-220dee77-9b0a-434c-8744-4ef8cd1952ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc229babec0a47168b70a1834e950571'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:04.677828 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b0815167-a50c-4846-bc77-50308a98c065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:04.684039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-220dee77-9b0a-434c-8744-4ef8cd1952ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc229babec0a47168b70a1834e950571'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:04.685884 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-220dee77-9b0a-434c-8744-4ef8cd1952ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc229babec0a47168b70a1834e950571'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:04.689613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-220dee77-9b0a-434c-8744-4ef8cd1952ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc229babec0a47168b70a1834e950571'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:04.711396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0815167-a50c-4846-bc77-50308a98c065 service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:04.719375 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:04.726518 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-220dee77-9b0a-434c-8744-4ef8cd1952ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc229babec0a47168b70a1834e950571'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:04.758253 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e038a30-7910-4bf4-bd6a-d04e72c4ccf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:04.758940 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e038a30-7910-4bf4-bd6a-d04e72c4ccf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:04.759241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e038a30-7910-4bf4-bd6a-d04e72c4ccf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:04.759523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e038a30-7910-4bf4-bd6a-d04e72c4ccf7 admin admin] PATH_INFO: `/v3/projects/a9aa60e5d5784cd98db1213f11ad58ab` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:04.762875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e038a30-7910-4bf4-bd6a-d04e72c4ccf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9aa60e5d5784cd98db1213f11ad58ab)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:04.770648 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e038a30-7910-4bf4-bd6a-d04e72c4ccf7 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:04.805419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 916/1831] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:04 2022] DELETE /identity/v3/users/cc229babec0a47168b70a1834e950571 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:47:04.892390 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8e038a30-7910-4bf4-bd6a-d04e72c4ccf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9aa60e5d5784cd98db1213f11ad58ab', 'request_id': 'req-8e038a30-7910-4bf4-bd6a-d04e72c4ccf7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:04.905912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8e038a30-7910-4bf4-bd6a-d04e72c4ccf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9aa60e5d5784cd98db1213f11ad58ab', 'request_id': 'req-8e038a30-7910-4bf4-bd6a-d04e72c4ccf7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:04.925609 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8e038a30-7910-4bf4-bd6a-d04e72c4ccf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9aa60e5d5784cd98db1213f11ad58ab', 'request_id': 'req-8e038a30-7910-4bf4-bd6a-d04e72c4ccf7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:04.967024 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8e038a30-7910-4bf4-bd6a-d04e72c4ccf7 admin admin] The token cache is being invalidate because project a9aa60e5d5784cd98db1213f11ad58ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:04.967321 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8e038a30-7910-4bf4-bd6a-d04e72c4ccf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:04.968024 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8e038a30-7910-4bf4-bd6a-d04e72c4ccf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:04.970194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 916/1832] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:04 2022] DELETE /identity/v3/projects/a9aa60e5d5784cd98db1213f11ad58ab => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:04.975238 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075d9ff-1087-4c90-9d5a-59716391e2ec None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:04.975477 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075d9ff-1087-4c90-9d5a-59716391e2ec None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:04.975752 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075d9ff-1087-4c90-9d5a-59716391e2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:05.013628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e075d9ff-1087-4c90-9d5a-59716391e2ec None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:05.014884 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e075d9ff-1087-4c90-9d5a-59716391e2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:05.185804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 917/1833] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:05.187540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fe164-d8b4-4223-a322-b246ce3377fc None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:05.187832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fe164-d8b4-4223-a322-b246ce3377fc None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:05.188157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fe164-d8b4-4223-a322-b246ce3377fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:05.232271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-847fe164-d8b4-4223-a322-b246ce3377fc None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:05.233569 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-847fe164-d8b4-4223-a322-b246ce3377fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:05.258802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075d9ff-1087-4c90-9d5a-59716391e2ec None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:05.272469 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 917/1834] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:05.274707 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075d9ff-1087-4c90-9d5a-59716391e2ec None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:05.281289 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29320a-3ca0-44b3-8cf2-4b33b6ac9c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:05.282106 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29320a-3ca0-44b3-8cf2-4b33b6ac9c3a admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:05.282670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29320a-3ca0-44b3-8cf2-4b33b6ac9c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:05.283489 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29320a-3ca0-44b3-8cf2-4b33b6ac9c3a admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:05.284448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29320a-3ca0-44b3-8cf2-4b33b6ac9c3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:05.284882 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29320a-3ca0-44b3-8cf2-4b33b6ac9c3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:05.287681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29320a-3ca0-44b3-8cf2-4b33b6ac9c3a admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:05.310309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fe164-d8b4-4223-a322-b246ce3377fc None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:05.328693 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 918/1835] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:47:05.337078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fe164-d8b4-4223-a322-b246ce3377fc None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:05.353745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b1c31-0206-4d36-a6f7-c3099c0f9099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:05.354553 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b1c31-0206-4d36-a6f7-c3099c0f9099 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:05.354948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b1c31-0206-4d36-a6f7-c3099c0f9099 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:05.355276 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b1c31-0206-4d36-a6f7-c3099c0f9099 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:05.356079 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b1c31-0206-4d36-a6f7-c3099c0f9099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:05.359661 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b1c31-0206-4d36-a6f7-c3099c0f9099 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:05.420320 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 918/1836] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:05 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:05.420584 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29320a-3ca0-44b3-8cf2-4b33b6ac9c3a admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:05.440810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29320a-3ca0-44b3-8cf2-4b33b6ac9c3a admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:05.493247 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b1c31-0206-4d36-a6f7-c3099c0f9099 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:05.496625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0f5b1c31-0206-4d36-a6f7-c3099c0f9099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:05.635981 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364ce29-1ae3-4952-89c7-d4c908e3a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:05.637877 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364ce29-1ae3-4952-89c7-d4c908e3a8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:05.638173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364ce29-1ae3-4952-89c7-d4c908e3a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:05.638452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364ce29-1ae3-4952-89c7-d4c908e3a8a7 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:05.639469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364ce29-1ae3-4952-89c7-d4c908e3a8a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:05.646398 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364ce29-1ae3-4952-89c7-d4c908e3a8a7 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:05.722813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 919/1837] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:05 2022] POST /identity/v3/users => generated 288 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:47:05.728943 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364ce29-1ae3-4952-89c7-d4c908e3a8a7 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:05.733931 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b1c31-0206-4d36-a6f7-c3099c0f9099 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:05.748244 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9491ed-c2b4-4498-be67-bc53e2f86db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:05.748936 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9491ed-c2b4-4498-be67-bc53e2f86db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:05.749341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9491ed-c2b4-4498-be67-bc53e2f86db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:05.749531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9491ed-c2b4-4498-be67-bc53e2f86db0 admin admin] PATH_INFO: `/v3/projects/16a1fa5fb9b74ed396e04a89d7ad1d80` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:05.761162 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364ce29-1ae3-4952-89c7-d4c908e3a8a7 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:05.769285 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9491ed-c2b4-4498-be67-bc53e2f86db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16a1fa5fb9b74ed396e04a89d7ad1d80)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:05.773445 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9491ed-c2b4-4498-be67-bc53e2f86db0 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:05.781446 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bc7af-56a9-40ae-a3de-712400addc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:05.782974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bc7af-56a9-40ae-a3de-712400addc4b admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:05.783454 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bc7af-56a9-40ae-a3de-712400addc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:05.783935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bc7af-56a9-40ae-a3de-712400addc4b admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:05.785322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bc7af-56a9-40ae-a3de-712400addc4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:05.787104 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bc7af-56a9-40ae-a3de-712400addc4b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:05.819037 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 920/1838] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:05.821183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bc7af-56a9-40ae-a3de-712400addc4b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:05.847022 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bc7af-56a9-40ae-a3de-712400addc4b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:05.851953 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:05.867039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa2460-d49a-4d39-9159-90ce14200918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:05.870363 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa2460-d49a-4d39-9159-90ce14200918 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:05.870948 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa2460-d49a-4d39-9159-90ce14200918 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:05.871651 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa2460-d49a-4d39-9159-90ce14200918 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:05.872490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa2460-d49a-4d39-9159-90ce14200918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:05.875159 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa2460-d49a-4d39-9159-90ce14200918 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:05.910068 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0a9491ed-c2b4-4498-be67-bc53e2f86db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a1fa5fb9b74ed396e04a89d7ad1d80', 'request_id': 'req-0a9491ed-c2b4-4498-be67-bc53e2f86db0'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:05.910849 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 921/1839] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:05.911905 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa2460-d49a-4d39-9159-90ce14200918 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:05.917830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0a9491ed-c2b4-4498-be67-bc53e2f86db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a1fa5fb9b74ed396e04a89d7ad1d80', 'request_id': 'req-0a9491ed-c2b4-4498-be67-bc53e2f86db0'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:05.935747 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0a9491ed-c2b4-4498-be67-bc53e2f86db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a1fa5fb9b74ed396e04a89d7ad1d80', 'request_id': 'req-0a9491ed-c2b4-4498-be67-bc53e2f86db0'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:05.937587 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa2460-d49a-4d39-9159-90ce14200918 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:05.957419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0a9491ed-c2b4-4498-be67-bc53e2f86db0 admin admin] The token cache is being invalidate because project 16a1fa5fb9b74ed396e04a89d7ad1d80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:05.958007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0a9491ed-c2b4-4498-be67-bc53e2f86db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:05.958921 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0a9491ed-c2b4-4498-be67-bc53e2f86db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:05.961683 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 919/1840] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:05 2022] DELETE /identity/v3/projects/16a1fa5fb9b74ed396e04a89d7ad1d80 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:47:05.966955 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38683888-3d37-4f0b-8560-2f30c3b6bd4a None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:05.967363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38683888-3d37-4f0b-8560-2f30c3b6bd4a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:05.967738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38683888-3d37-4f0b-8560-2f30c3b6bd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:06.008982 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:06.009837 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-38683888-3d37-4f0b-8560-2f30c3b6bd4a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:06.012068 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-38683888-3d37-4f0b-8560-2f30c3b6bd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:06.093821 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcd4ee-ed21-4d1e-a2b8-91fd24b62ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:06.094543 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcd4ee-ed21-4d1e-a2b8-91fd24b62ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:06.095328 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcd4ee-ed21-4d1e-a2b8-91fd24b62ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:06.095617 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcd4ee-ed21-4d1e-a2b8-91fd24b62ed9 admin admin] PATH_INFO: `/v3/projects/2e9fab16579a421ab162c2c30797e071/users/844b80b769494dceaf3ce10da6c39bee/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:06.160817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcd4ee-ed21-4d1e-a2b8-91fd24b62ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e9fab16579a421ab162c2c30797e071, user_id=844b80b769494dceaf3ce10da6c39bee, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:06.175093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcd4ee-ed21-4d1e-a2b8-91fd24b62ed9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:06.194789 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 920/1841] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:06.206525 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb994b5-e22b-4651-98ff-83921acea172 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:06.206928 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb994b5-e22b-4651-98ff-83921acea172 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:06.209012 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb994b5-e22b-4651-98ff-83921acea172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:06.216165 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 922/1842] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:05 2022] PUT /identity/v3/projects/2e9fab16579a421ab162c2c30797e071/users/844b80b769494dceaf3ce10da6c39bee/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:06.229015 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6356960-a3ce-4113-a22e-d4ce57d7bd6b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:06.229469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6356960-a3ce-4113-a22e-d4ce57d7bd6b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:06.229901 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6356960-a3ce-4113-a22e-d4ce57d7bd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:06.268834 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-7cb994b5-e22b-4651-98ff-83921acea172 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:06.268834 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7cb994b5-e22b-4651-98ff-83921acea172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:06.331567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d6356960-a3ce-4113-a22e-d4ce57d7bd6b None None] MFA Rules not processed for user `844b80b769494dceaf3ce10da6c39bee`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:06.334712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d6356960-a3ce-4113-a22e-d4ce57d7bd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:06.466032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 921/1843] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:06.470653 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb994b5-e22b-4651-98ff-83921acea172 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:06.484618 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb994b5-e22b-4651-98ff-83921acea172 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:06.502934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435ab8d-5e24-40ad-a1e9-94544bd69079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:06.503784 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435ab8d-5e24-40ad-a1e9-94544bd69079 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:06.504003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435ab8d-5e24-40ad-a1e9-94544bd69079 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:06.504346 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435ab8d-5e24-40ad-a1e9-94544bd69079 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:06.505111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435ab8d-5e24-40ad-a1e9-94544bd69079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:06.505474 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435ab8d-5e24-40ad-a1e9-94544bd69079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:06.507984 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435ab8d-5e24-40ad-a1e9-94544bd69079 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:06.530582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 922/1844] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:47:06.531674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435ab8d-5e24-40ad-a1e9-94544bd69079 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:06.545659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 923/1845] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:06.546255 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435ab8d-5e24-40ad-a1e9-94544bd69079 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:06.546838 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6356960-a3ce-4113-a22e-d4ce57d7bd6b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:06.549692 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d6356960-a3ce-4113-a22e-d4ce57d7bd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:06.552226 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373739e4-17dd-498a-a35b-83eb91356bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:06.552983 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373739e4-17dd-498a-a35b-83eb91356bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:06.553376 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373739e4-17dd-498a-a35b-83eb91356bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:06.553786 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373739e4-17dd-498a-a35b-83eb91356bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:06.554691 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373739e4-17dd-498a-a35b-83eb91356bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:06.556603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373739e4-17dd-498a-a35b-83eb91356bf4 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:06.576161 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6356960-a3ce-4113-a22e-d4ce57d7bd6b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:06.583879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248b28d-c8bf-4898-92e3-d562af88cb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:06.584628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248b28d-c8bf-4898-92e3-d562af88cb65 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:06.584979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248b28d-c8bf-4898-92e3-d562af88cb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:06.585386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248b28d-c8bf-4898-92e3-d562af88cb65 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:06.586163 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248b28d-c8bf-4898-92e3-d562af88cb65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:06.588209 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248b28d-c8bf-4898-92e3-d562af88cb65 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:06.593267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 923/1846] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:06 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:06.595170 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373739e4-17dd-498a-a35b-83eb91356bf4 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:06.617708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:06.658958 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 924/1847] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:06 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:06.660039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248b28d-c8bf-4898-92e3-d562af88cb65 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:06.675637 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373739e4-17dd-498a-a35b-83eb91356bf4 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:06.762554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3197e-3e03-467b-9d1c-a11a33ef977a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:06.763273 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3197e-3e03-467b-9d1c-a11a33ef977a admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:06.763488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3197e-3e03-467b-9d1c-a11a33ef977a admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:06.763698 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3197e-3e03-467b-9d1c-a11a33ef977a admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:06.764341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3197e-3e03-467b-9d1c-a11a33ef977a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:06.766296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3197e-3e03-467b-9d1c-a11a33ef977a admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:06.796310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 924/1848] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:06 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:06.802658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3197e-3e03-467b-9d1c-a11a33ef977a admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:06.825751 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3197e-3e03-467b-9d1c-a11a33ef977a admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:06.826047 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248b28d-c8bf-4898-92e3-d562af88cb65 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:06.838577 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356f2bd-b559-4d2f-ae57-0d30d58aa193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:06.839500 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e714a5-fc6d-41d3-affd-b6cd8a670788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:06.839631 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356f2bd-b559-4d2f-ae57-0d30d58aa193 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:06.839820 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356f2bd-b559-4d2f-ae57-0d30d58aa193 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:06.840061 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356f2bd-b559-4d2f-ae57-0d30d58aa193 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:06.840896 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e714a5-fc6d-41d3-affd-b6cd8a670788 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:06.842014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356f2bd-b559-4d2f-ae57-0d30d58aa193 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:06.842833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e714a5-fc6d-41d3-affd-b6cd8a670788 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:06.844610 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e714a5-fc6d-41d3-affd-b6cd8a670788 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:06.845605 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e714a5-fc6d-41d3-affd-b6cd8a670788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:06.848065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356f2bd-b559-4d2f-ae57-0d30d58aa193 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:06.849418 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e714a5-fc6d-41d3-affd-b6cd8a670788 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:06.891877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 925/1849] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:06.895867 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e714a5-fc6d-41d3-affd-b6cd8a670788 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:06.903103 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-93e714a5-fc6d-41d3-affd-b6cd8a670788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:06.931483 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e714a5-fc6d-41d3-affd-b6cd8a670788 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:06.932388 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 925/1850] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:06 2022] POST /identity/v3/users => generated 288 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:06.933589 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356f2bd-b559-4d2f-ae57-0d30d58aa193 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:06.936125 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6091912-140f-4452-b30f-563fa6384a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:06.936854 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6091912-140f-4452-b30f-563fa6384a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:06.937196 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6091912-140f-4452-b30f-563fa6384a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:06.937463 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6091912-140f-4452-b30f-563fa6384a13 admin admin] PATH_INFO: `/v3/projects/1c8fb5e1eb1f47b4bfa95b555f88e135` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:06.938677 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6091912-140f-4452-b30f-563fa6384a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c8fb5e1eb1f47b4bfa95b555f88e135)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:06.940908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6091912-140f-4452-b30f-563fa6384a13 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:06.979334 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356f2bd-b559-4d2f-ae57-0d30d58aa193 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:06.997160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6e0d5-9c67-494e-acbc-2c2bc9fc9cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:06.997948 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6e0d5-9c67-494e-acbc-2c2bc9fc9cdb admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:06.999393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6e0d5-9c67-494e-acbc-2c2bc9fc9cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:06.999750 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6e0d5-9c67-494e-acbc-2c2bc9fc9cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:07.000419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6e0d5-9c67-494e-acbc-2c2bc9fc9cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:07.009804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6e0d5-9c67-494e-acbc-2c2bc9fc9cdb admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:07.038097 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:07.073001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 926/1851] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:07.073001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6e0d5-9c67-494e-acbc-2c2bc9fc9cdb admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:07.108303 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b6091912-140f-4452-b30f-563fa6384a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8fb5e1eb1f47b4bfa95b555f88e135', 'request_id': 'req-b6091912-140f-4452-b30f-563fa6384a13'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:07.122130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6e0d5-9c67-494e-acbc-2c2bc9fc9cdb admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:07.132739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b6091912-140f-4452-b30f-563fa6384a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8fb5e1eb1f47b4bfa95b555f88e135', 'request_id': 'req-b6091912-140f-4452-b30f-563fa6384a13'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:07.151329 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b6091912-140f-4452-b30f-563fa6384a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8fb5e1eb1f47b4bfa95b555f88e135', 'request_id': 'req-b6091912-140f-4452-b30f-563fa6384a13'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:07.180148 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b6091912-140f-4452-b30f-563fa6384a13 admin admin] The token cache is being invalidate because project 1c8fb5e1eb1f47b4bfa95b555f88e135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:07.181840 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b6091912-140f-4452-b30f-563fa6384a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:07.183527 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b6091912-140f-4452-b30f-563fa6384a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:07.187708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 926/1852] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:06 2022] DELETE /identity/v3/projects/1c8fb5e1eb1f47b4bfa95b555f88e135 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:07.189589 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6091912-140f-4452-b30f-563fa6384a13 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:07.194964 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b6091912-140f-4452-b30f-563fa6384a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:07.270589 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:07.303536 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a85bb-6adc-4825-81cb-0f84bbea20b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:07.304599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a85bb-6adc-4825-81cb-0f84bbea20b3 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:07.305161 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a85bb-6adc-4825-81cb-0f84bbea20b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:07.305737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a85bb-6adc-4825-81cb-0f84bbea20b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:07.306767 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a85bb-6adc-4825-81cb-0f84bbea20b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:07.309168 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a85bb-6adc-4825-81cb-0f84bbea20b3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:07.331060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 927/1853] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:07.332460 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a85bb-6adc-4825-81cb-0f84bbea20b3 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:07.336418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ea9a85bb-6adc-4825-81cb-0f84bbea20b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:07.337317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6091912-140f-4452-b30f-563fa6384a13 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:07.344224 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be942f-0d15-4773-b51d-fc7c07483eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:07.345816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be942f-0d15-4773-b51d-fc7c07483eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:07.346309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be942f-0d15-4773-b51d-fc7c07483eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:07.346800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be942f-0d15-4773-b51d-fc7c07483eb7 admin admin] PATH_INFO: `/v3/projects/57036e2e717e4242ae6b13cfa4ccf973/users/e46dfe87ca5f4620a23a400adf671c9f/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:07.362899 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a85bb-6adc-4825-81cb-0f84bbea20b3 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:07.369336 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b986c0-e47c-489b-821a-34375024e28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:07.370926 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b986c0-e47c-489b-821a-34375024e28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:07.372060 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be942f-0d15-4773-b51d-fc7c07483eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57036e2e717e4242ae6b13cfa4ccf973, user_id=e46dfe87ca5f4620a23a400adf671c9f, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:07.372806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b986c0-e47c-489b-821a-34375024e28a admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:07.374018 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b986c0-e47c-489b-821a-34375024e28a admin admin] PATH_INFO: `/v3/users/d2c11dc99b0b4651b3962923b543a95d` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:07.375623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be942f-0d15-4773-b51d-fc7c07483eb7 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:07.386174 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b986c0-e47c-489b-821a-34375024e28a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2c11dc99b0b4651b3962923b543a95d)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:07.389427 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b986c0-e47c-489b-821a-34375024e28a admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:07.405834 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 927/1854] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:07 2022] PUT /identity/v3/projects/57036e2e717e4242ae6b13cfa4ccf973/users/e46dfe87ca5f4620a23a400adf671c9f/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:07.405834 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be942f-0d15-4773-b51d-fc7c07483eb7 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:07.409094 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-91be942f-0d15-4773-b51d-fc7c07483eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:07.531602 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-13b986c0-e47c-489b-821a-34375024e28a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2c11dc99b0b4651b3962923b543a95d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:07.548455 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-13b986c0-e47c-489b-821a-34375024e28a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2c11dc99b0b4651b3962923b543a95d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:07.550125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-13b986c0-e47c-489b-821a-34375024e28a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2c11dc99b0b4651b3962923b543a95d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:07.553076 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-13b986c0-e47c-489b-821a-34375024e28a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2c11dc99b0b4651b3962923b543a95d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:07.587473 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-13b986c0-e47c-489b-821a-34375024e28a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2c11dc99b0b4651b3962923b543a95d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:07.587810 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be942f-0d15-4773-b51d-fc7c07483eb7 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:07.596723 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea094d03-e9f5-43cc-a422-dca317c188de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:07.598399 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea094d03-e9f5-43cc-a422-dca317c188de admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:07.600823 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea094d03-e9f5-43cc-a422-dca317c188de admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:07.601508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea094d03-e9f5-43cc-a422-dca317c188de admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:07.603867 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea094d03-e9f5-43cc-a422-dca317c188de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:07.605523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea094d03-e9f5-43cc-a422-dca317c188de admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:07.619743 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 928/1855] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:07 2022] DELETE /identity/v3/users/d2c11dc99b0b4651b3962923b543a95d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:07.623886 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 928/1856] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:07.624332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b986c0-e47c-489b-821a-34375024e28a admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:07.625616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37c4d7-5c08-470e-b374-61c3ee4b3e2e None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:07.626565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37c4d7-5c08-470e-b374-61c3ee4b3e2e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:07.626846 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37c4d7-5c08-470e-b374-61c3ee4b3e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:07.627246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-13b986c0-e47c-489b-821a-34375024e28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:07.662285 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-ab37c4d7-5c08-470e-b374-61c3ee4b3e2e None None] MFA Rules not processed for user `e46dfe87ca5f4620a23a400adf671c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:07.663738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ab37c4d7-5c08-470e-b374-61c3ee4b3e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:07.748872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b986c0-e47c-489b-821a-34375024e28a admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:07.769783 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7e09d-ff20-4dc9-8e26-97769c6c5d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:07.770441 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7e09d-ff20-4dc9-8e26-97769c6c5d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:07.770719 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7e09d-ff20-4dc9-8e26-97769c6c5d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:07.770989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7e09d-ff20-4dc9-8e26-97769c6c5d4b admin admin] PATH_INFO: `/v3/projects/ecc99ec9dd4a4385a9a46a603d39a61c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:07.773399 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7e09d-ff20-4dc9-8e26-97769c6c5d4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc99ec9dd4a4385a9a46a603d39a61c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:07.775296 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7e09d-ff20-4dc9-8e26-97769c6c5d4b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:07.791745 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:07.799424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 929/1857] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:07.800609 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37c4d7-5c08-470e-b374-61c3ee4b3e2e None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:07.802421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ab37c4d7-5c08-470e-b374-61c3ee4b3e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:07.832042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37c4d7-5c08-470e-b374-61c3ee4b3e2e None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:07.841892 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098592a6-a88b-45da-9f36-43c6a72fd1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:07.842292 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098592a6-a88b-45da-9f36-43c6a72fd1a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:07.842582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098592a6-a88b-45da-9f36-43c6a72fd1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:07.842860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098592a6-a88b-45da-9f36-43c6a72fd1a3 admin admin] PATH_INFO: `/v3/projects/3b759c22ce444f4fb00f7a8243a2f166/users/2b3476491b1f4e4ab1edc3eba33b0cf4/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:07.863328 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-69c7e09d-ff20-4dc9-8e26-97769c6c5d4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc99ec9dd4a4385a9a46a603d39a61c', 'request_id': 'req-69c7e09d-ff20-4dc9-8e26-97769c6c5d4b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:07.871071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-69c7e09d-ff20-4dc9-8e26-97769c6c5d4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc99ec9dd4a4385a9a46a603d39a61c', 'request_id': 'req-69c7e09d-ff20-4dc9-8e26-97769c6c5d4b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:07.871249 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098592a6-a88b-45da-9f36-43c6a72fd1a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b759c22ce444f4fb00f7a8243a2f166, user_id=2b3476491b1f4e4ab1edc3eba33b0cf4, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:07.874399 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098592a6-a88b-45da-9f36-43c6a72fd1a3 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:07.880400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-69c7e09d-ff20-4dc9-8e26-97769c6c5d4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc99ec9dd4a4385a9a46a603d39a61c', 'request_id': 'req-69c7e09d-ff20-4dc9-8e26-97769c6c5d4b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:07.892380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 930/1858] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:07 2022] PUT /identity/v3/projects/3b759c22ce444f4fb00f7a8243a2f166/users/2b3476491b1f4e4ab1edc3eba33b0cf4/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:07.892590 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-69c7e09d-ff20-4dc9-8e26-97769c6c5d4b admin admin] The token cache is being invalidate because project ecc99ec9dd4a4385a9a46a603d39a61c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:07.892590 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-69c7e09d-ff20-4dc9-8e26-97769c6c5d4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:07.892751 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098592a6-a88b-45da-9f36-43c6a72fd1a3 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:07.893336 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-69c7e09d-ff20-4dc9-8e26-97769c6c5d4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:07.894329 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-098592a6-a88b-45da-9f36-43c6a72fd1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:07.894998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 929/1859] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:07 2022] DELETE /identity/v3/projects/ecc99ec9dd4a4385a9a46a603d39a61c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:07.899152 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7e09d-ff20-4dc9-8e26-97769c6c5d4b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:07.900583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-69c7e09d-ff20-4dc9-8e26-97769c6c5d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:07.911811 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:07.969696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7e09d-ff20-4dc9-8e26-97769c6c5d4b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:07.974516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098592a6-a88b-45da-9f36-43c6a72fd1a3 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:07.979055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ae240-38a9-4b95-98a6-c7264ee65d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:07.979658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ae240-38a9-4b95-98a6-c7264ee65d34 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:07.979938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ae240-38a9-4b95-98a6-c7264ee65d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:07.980560 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ae240-38a9-4b95-98a6-c7264ee65d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:07.980934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ae240-38a9-4b95-98a6-c7264ee65d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:07.982819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ae240-38a9-4b95-98a6-c7264ee65d34 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:08.019543 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 931/1860] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:07 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:08.019543 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18029e2e-1063-4e86-bff6-242432c005e9 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:08.019543 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18029e2e-1063-4e86-bff6-242432c005e9 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:08.019543 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18029e2e-1063-4e86-bff6-242432c005e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:08.032668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1390223-ae14-4e92-95dd-ded757625c12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:08.033386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1390223-ae14-4e92-95dd-ded757625c12 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:08.033725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1390223-ae14-4e92-95dd-ded757625c12 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:08.034079 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1390223-ae14-4e92-95dd-ded757625c12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:08.036339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d1390223-ae14-4e92-95dd-ded757625c12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:08.041602 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-18029e2e-1063-4e86-bff6-242432c005e9 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:08.042809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-18029e2e-1063-4e86-bff6-242432c005e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:08.108322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1390223-ae14-4e92-95dd-ded757625c12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:08.111094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1390223-ae14-4e92-95dd-ded757625c12 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:08.122929 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 932/1861] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:08.124203 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3019e-f918-43ac-bde3-91abdae49ba7 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:08.124486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3019e-f918-43ac-bde3-91abdae49ba7 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:08.124817 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3019e-f918-43ac-bde3-91abdae49ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:08.133477 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 930/1862] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:08.135197 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1390223-ae14-4e92-95dd-ded757625c12 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:08.137406 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d1390223-ae14-4e92-95dd-ded757625c12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:08.161664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1390223-ae14-4e92-95dd-ded757625c12 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:08.162747 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-2af3019e-f918-43ac-bde3-91abdae49ba7 None None] MFA Rules not processed for user `2b3476491b1f4e4ab1edc3eba33b0cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:08.163959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2af3019e-f918-43ac-bde3-91abdae49ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:08.174913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcc20a-7c0b-46d9-bcbd-c13e0f9791c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:08.176614 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcc20a-7c0b-46d9-bcbd-c13e0f9791c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:08.177085 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcc20a-7c0b-46d9-bcbd-c13e0f9791c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:08.177546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcc20a-7c0b-46d9-bcbd-c13e0f9791c0 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:08.179355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcc20a-7c0b-46d9-bcbd-c13e0f9791c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:08.183470 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcc20a-7c0b-46d9-bcbd-c13e0f9791c0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:08.196572 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:08.214628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 931/1863] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:08 2022] POST /identity/v3/users => generated 295 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:08.217539 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde34d78-6b70-41f1-8c72-cb344dc237af None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:08.218062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde34d78-6b70-41f1-8c72-cb344dc237af None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:08.219094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde34d78-6b70-41f1-8c72-cb344dc237af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:08.278106 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-dde34d78-6b70-41f1-8c72-cb344dc237af None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:08.280727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-dde34d78-6b70-41f1-8c72-cb344dc237af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:08.302618 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 932/1864] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:08.304432 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde34d78-6b70-41f1-8c72-cb344dc237af None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:08.305646 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 933/1865] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:08.310189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3019e-f918-43ac-bde3-91abdae49ba7 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:08.329669 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3019e-f918-43ac-bde3-91abdae49ba7 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:08.329918 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde34d78-6b70-41f1-8c72-cb344dc237af None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:08.345737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7726c8b-57ec-4abe-9191-f71e5d347678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:08.346824 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb551e-314c-429c-a377-b824a9a2e722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:08.347923 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb551e-314c-429c-a377-b824a9a2e722 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:08.349469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7726c8b-57ec-4abe-9191-f71e5d347678 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:08.349822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7726c8b-57ec-4abe-9191-f71e5d347678 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:08.350571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb551e-314c-429c-a377-b824a9a2e722 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:08.350868 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb551e-314c-429c-a377-b824a9a2e722 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:08.351236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7726c8b-57ec-4abe-9191-f71e5d347678 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:08.351969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7726c8b-57ec-4abe-9191-f71e5d347678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:08.353590 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb551e-314c-429c-a377-b824a9a2e722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:08.353906 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb551e-314c-429c-a377-b824a9a2e722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:08.357000 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7726c8b-57ec-4abe-9191-f71e5d347678 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:08.358924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb551e-314c-429c-a377-b824a9a2e722 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:08.403288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 933/1866] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:08.403288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7726c8b-57ec-4abe-9191-f71e5d347678 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:08.403583 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 934/1867] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:47:08.403583 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb551e-314c-429c-a377-b824a9a2e722 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:08.405174 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d7726c8b-57ec-4abe-9191-f71e5d347678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:08.422015 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7726c8b-57ec-4abe-9191-f71e5d347678 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:08.430195 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93749d1-4ac5-4a56-aec2-9901fee9d45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:08.430825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb551e-314c-429c-a377-b824a9a2e722 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:08.431192 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93749d1-4ac5-4a56-aec2-9901fee9d45e admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:08.431546 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93749d1-4ac5-4a56-aec2-9901fee9d45e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:08.431952 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93749d1-4ac5-4a56-aec2-9901fee9d45e admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:08.433102 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93749d1-4ac5-4a56-aec2-9901fee9d45e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:08.436005 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93749d1-4ac5-4a56-aec2-9901fee9d45e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:08.437610 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cafd5-115d-4f08-83de-dc9284f62d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:08.438398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cafd5-115d-4f08-83de-dc9284f62d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:08.438682 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cafd5-115d-4f08-83de-dc9284f62d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:08.438957 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cafd5-115d-4f08-83de-dc9284f62d95 admin admin] PATH_INFO: `/v3/projects/a7ad4f5130654c5f8d6681bfb402e850/users/3d54c2b613f84454996b6cd12739dce7/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:08.450131 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:08.463670 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cafd5-115d-4f08-83de-dc9284f62d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ad4f5130654c5f8d6681bfb402e850, user_id=3d54c2b613f84454996b6cd12739dce7, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:08.469648 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cafd5-115d-4f08-83de-dc9284f62d95 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:08.510621 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 934/1869] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:08 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:08.512798 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93749d1-4ac5-4a56-aec2-9901fee9d45e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:08.514882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 935/1869] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:08 2022] PUT /identity/v3/projects/a7ad4f5130654c5f8d6681bfb402e850/users/3d54c2b613f84454996b6cd12739dce7/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:08.516112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cafd5-115d-4f08-83de-dc9284f62d95 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:08.518554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-5b6cafd5-115d-4f08-83de-dc9284f62d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:08.672351 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93749d1-4ac5-4a56-aec2-9901fee9d45e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:08.689404 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b90c2-6b89-427b-8370-988399392545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:08.697601 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cafd5-115d-4f08-83de-dc9284f62d95 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:08.704151 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20184ab-8afb-4217-9c9c-fe747eb86a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:08.710116 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20184ab-8afb-4217-9c9c-fe747eb86a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:08.710116 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20184ab-8afb-4217-9c9c-fe747eb86a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:08.710116 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20184ab-8afb-4217-9c9c-fe747eb86a1c admin admin] PATH_INFO: `/v3/projects/418b08b47b45464cb51b4c14eb585328` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:08.710116 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20184ab-8afb-4217-9c9c-fe747eb86a1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=418b08b47b45464cb51b4c14eb585328)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:08.710544 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b90c2-6b89-427b-8370-988399392545 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:08.710544 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b90c2-6b89-427b-8370-988399392545 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:08.710544 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b90c2-6b89-427b-8370-988399392545 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:08.710860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20184ab-8afb-4217-9c9c-fe747eb86a1c admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:08.710946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b90c2-6b89-427b-8370-988399392545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:08.716166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b90c2-6b89-427b-8370-988399392545 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:08.806028 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 935/1870] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:08 2022] POST /identity/v3/projects => generated 355 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:08.806028 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b90c2-6b89-427b-8370-988399392545 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:08.811293 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d20184ab-8afb-4217-9c9c-fe747eb86a1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '418b08b47b45464cb51b4c14eb585328', 'request_id': 'req-d20184ab-8afb-4217-9c9c-fe747eb86a1c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:08.822690 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d20184ab-8afb-4217-9c9c-fe747eb86a1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '418b08b47b45464cb51b4c14eb585328', 'request_id': 'req-d20184ab-8afb-4217-9c9c-fe747eb86a1c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:08.842153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d20184ab-8afb-4217-9c9c-fe747eb86a1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '418b08b47b45464cb51b4c14eb585328', 'request_id': 'req-d20184ab-8afb-4217-9c9c-fe747eb86a1c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:08.855347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d20184ab-8afb-4217-9c9c-fe747eb86a1c admin admin] The token cache is being invalidate because project 418b08b47b45464cb51b4c14eb585328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:08.855784 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d20184ab-8afb-4217-9c9c-fe747eb86a1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:08.856738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d20184ab-8afb-4217-9c9c-fe747eb86a1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:08.861989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 936/1871] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:08 2022] DELETE /identity/v3/projects/418b08b47b45464cb51b4c14eb585328 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:08.861989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20184ab-8afb-4217-9c9c-fe747eb86a1c admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:08.862757 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d20184ab-8afb-4217-9c9c-fe747eb86a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:08.927637 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b90c2-6b89-427b-8370-988399392545 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:08.937212 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a18bb3-96ee-4023-ab76-643e5e40ebad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:08.937212 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a18bb3-96ee-4023-ab76-643e5e40ebad admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:08.937212 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a18bb3-96ee-4023-ab76-643e5e40ebad admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:08.937212 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a18bb3-96ee-4023-ab76-643e5e40ebad admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:08.937548 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a18bb3-96ee-4023-ab76-643e5e40ebad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:08.940379 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a18bb3-96ee-4023-ab76-643e5e40ebad admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:08.977270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 936/1872] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:08 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:08.978474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a18bb3-96ee-4023-ab76-643e5e40ebad admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:08.980834 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-57a18bb3-96ee-4023-ab76-643e5e40ebad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:08.998297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20184ab-8afb-4217-9c9c-fe747eb86a1c admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:08.998448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a18bb3-96ee-4023-ab76-643e5e40ebad admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:09.003569 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24501aa5-711c-4750-8492-37e82c273977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:09.003730 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb16bcc-e6e5-44bb-8c8c-18074310e64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:09.004272 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb16bcc-e6e5-44bb-8c8c-18074310e64b admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.004577 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb16bcc-e6e5-44bb-8c8c-18074310e64b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.004854 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb16bcc-e6e5-44bb-8c8c-18074310e64b admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.005002 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24501aa5-711c-4750-8492-37e82c273977 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.005408 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24501aa5-711c-4750-8492-37e82c273977 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.005523 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb16bcc-e6e5-44bb-8c8c-18074310e64b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:09.005924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24501aa5-711c-4750-8492-37e82c273977 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.006781 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24501aa5-711c-4750-8492-37e82c273977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:09.007384 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb16bcc-e6e5-44bb-8c8c-18074310e64b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:09.009227 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24501aa5-711c-4750-8492-37e82c273977 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:09.027203 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 937/1873] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:09.033024 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9815811-d812-423f-ac8a-e33232f4bc8b None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.033411 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9815811-d812-423f-ac8a-e33232f4bc8b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.033806 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9815811-d812-423f-ac8a-e33232f4bc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.054321 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 937/1874] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:08 2022] POST /identity/v3/users => generated 278 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:09.055211 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb16bcc-e6e5-44bb-8c8c-18074310e64b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:09.057922 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1cb16bcc-e6e5-44bb-8c8c-18074310e64b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:09.067379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e9815811-d812-423f-ac8a-e33232f4bc8b None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:09.071147 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e9815811-d812-423f-ac8a-e33232f4bc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:09.072140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb16bcc-e6e5-44bb-8c8c-18074310e64b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:09.077569 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09a634-d5dd-4e00-bb10-687adfde8011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:09.078216 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09a634-d5dd-4e00-bb10-687adfde8011 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.078532 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09a634-d5dd-4e00-bb10-687adfde8011 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.078866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09a634-d5dd-4e00-bb10-687adfde8011 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.080956 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09a634-d5dd-4e00-bb10-687adfde8011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:09.084023 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09a634-d5dd-4e00-bb10-687adfde8011 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:09.087537 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 938/1875] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:09.088211 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9815811-d812-423f-ac8a-e33232f4bc8b None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:09.096705 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 938/1876] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:09.097593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09a634-d5dd-4e00-bb10-687adfde8011 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:09.101311 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9815811-d812-423f-ac8a-e33232f4bc8b None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:09.104694 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:INSERT=10,keystone:SELECT=90 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:09.106705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90739670-9c1b-4c23-b7da-e06475894465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:09.107424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90739670-9c1b-4c23-b7da-e06475894465 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.107703 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90739670-9c1b-4c23-b7da-e06475894465 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.107974 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90739670-9c1b-4c23-b7da-e06475894465 admin admin] PATH_INFO: `/v3/projects/a7ad4f5130654c5f8d6681bfb402e850/users/3d54c2b613f84454996b6cd12739dce7/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.108882 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09a634-d5dd-4e00-bb10-687adfde8011 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:09.109944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90739670-9c1b-4c23-b7da-e06475894465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ad4f5130654c5f8d6681bfb402e850, user_id=3d54c2b613f84454996b6cd12739dce7, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:09.113266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90739670-9c1b-4c23-b7da-e06475894465 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:09.115863 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:09.117743 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fe2e7-32a5-466d-b92c-6d8282ab44a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:09.118399 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fe2e7-32a5-466d-b92c-6d8282ab44a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.118620 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fe2e7-32a5-466d-b92c-6d8282ab44a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.118886 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fe2e7-32a5-466d-b92c-6d8282ab44a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.119555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fe2e7-32a5-466d-b92c-6d8282ab44a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:09.121311 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fe2e7-32a5-466d-b92c-6d8282ab44a1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:09.127446 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 939/1877] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:09 2022] PUT /identity/v3/projects/a7ad4f5130654c5f8d6681bfb402e850/users/3d54c2b613f84454996b6cd12739dce7/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:09.130322 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90677a0a-92de-4a30-b7f1-20983b80a3a4 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.130776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90677a0a-92de-4a30-b7f1-20983b80a3a4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.131259 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90677a0a-92de-4a30-b7f1-20983b80a3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.136057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 939/1878] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:09.137822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fe2e7-32a5-466d-b92c-6d8282ab44a1 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:09.151153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fe2e7-32a5-466d-b92c-6d8282ab44a1 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:09.155034 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-90677a0a-92de-4a30-b7f1-20983b80a3a4 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:09.156787 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-90677a0a-92de-4a30-b7f1-20983b80a3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:09.212712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5e0d3-54b8-4210-a00a-c5fc433d14a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:09.213650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5e0d3-54b8-4210-a00a-c5fc433d14a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.213890 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5e0d3-54b8-4210-a00a-c5fc433d14a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.214160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5e0d3-54b8-4210-a00a-c5fc433d14a4 admin admin] PATH_INFO: `/v3/projects/4c19538b52b0438081790878024a8531/users/939beab5464e492089e70eac961d2eb9/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.228596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 940/1879] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:09.229125 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90677a0a-92de-4a30-b7f1-20983b80a3a4 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:09.234587 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5e0d3-54b8-4210-a00a-c5fc433d14a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c19538b52b0438081790878024a8531, user_id=939beab5464e492089e70eac961d2eb9, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:09.237725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5e0d3-54b8-4210-a00a-c5fc433d14a4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:09.239485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90677a0a-92de-4a30-b7f1-20983b80a3a4 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:09.246030 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b30f83-e992-480d-845d-4b378022ba84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:09.247101 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b30f83-e992-480d-845d-4b378022ba84 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.247746 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b30f83-e992-480d-845d-4b378022ba84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.248327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b30f83-e992-480d-845d-4b378022ba84 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.250235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b30f83-e992-480d-845d-4b378022ba84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:09.251763 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b30f83-e992-480d-845d-4b378022ba84 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:09.255985 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 940/1880] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:09 2022] PUT /identity/v3/projects/4c19538b52b0438081790878024a8531/users/939beab5464e492089e70eac961d2eb9/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:09.255985 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d800578-68bc-455f-a77e-997d9ad4eaf5 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.255985 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d800578-68bc-455f-a77e-997d9ad4eaf5 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.255985 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d800578-68bc-455f-a77e-997d9ad4eaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.267316 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 941/1881] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:09.267316 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b30f83-e992-480d-845d-4b378022ba84 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:09.277305 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b30f83-e992-480d-845d-4b378022ba84 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:09.291227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4d800578-68bc-455f-a77e-997d9ad4eaf5 None None] MFA Rules not processed for user `3d54c2b613f84454996b6cd12739dce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:09.292587 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4d800578-68bc-455f-a77e-997d9ad4eaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:09.345185 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21175531-0caa-4c9a-a23a-e37568693b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:09.345795 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21175531-0caa-4c9a-a23a-e37568693b4e admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.346074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21175531-0caa-4c9a-a23a-e37568693b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.346346 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21175531-0caa-4c9a-a23a-e37568693b4e admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.346986 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21175531-0caa-4c9a-a23a-e37568693b4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:09.347288 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21175531-0caa-4c9a-a23a-e37568693b4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:09.348982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21175531-0caa-4c9a-a23a-e37568693b4e admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:09.362950 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 942/1882] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:47:09.363870 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21175531-0caa-4c9a-a23a-e37568693b4e admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:09.372214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 941/1883] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:09.373194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d800578-68bc-455f-a77e-997d9ad4eaf5 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:09.375025 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21175531-0caa-4c9a-a23a-e37568693b4e admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:09.380866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b18df-b446-4bb3-ab95-6fa395f8167b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:09.381462 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b18df-b446-4bb3-ab95-6fa395f8167b admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.381749 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b18df-b446-4bb3-ab95-6fa395f8167b admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.382077 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b18df-b446-4bb3-ab95-6fa395f8167b admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.382797 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b18df-b446-4bb3-ab95-6fa395f8167b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:09.384525 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b18df-b446-4bb3-ab95-6fa395f8167b admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:09.389220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d800578-68bc-455f-a77e-997d9ad4eaf5 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:09.394093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa259c-e7d4-4080-88eb-b92e228c5d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:09.394839 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa259c-e7d4-4080-88eb-b92e228c5d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.395188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa259c-e7d4-4080-88eb-b92e228c5d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.395285 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 943/1884] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:09.395469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa259c-e7d4-4080-88eb-b92e228c5d97 admin admin] PATH_INFO: `/v3/projects/40ae8b10c2d14a08a15e87fd18205b2e/users/e47b29049c704d11a9c4072a174f92ae/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.396113 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b18df-b446-4bb3-ab95-6fa395f8167b admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:09.405994 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b18df-b446-4bb3-ab95-6fa395f8167b admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:09.413336 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b6499-b981-4fe8-b34c-2dd0078da855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:09.413562 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa259c-e7d4-4080-88eb-b92e228c5d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ae8b10c2d14a08a15e87fd18205b2e, user_id=e47b29049c704d11a9c4072a174f92ae, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:09.414404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6499-b981-4fe8-b34c-2dd0078da855 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.414404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6499-b981-4fe8-b34c-2dd0078da855 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.414583 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6499-b981-4fe8-b34c-2dd0078da855 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.415064 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b6499-b981-4fe8-b34c-2dd0078da855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:09.416429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa259c-e7d4-4080-88eb-b92e228c5d97 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:09.417129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b6499-b981-4fe8-b34c-2dd0078da855 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:09.430531 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 942/1885] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:09 2022] PUT /identity/v3/projects/40ae8b10c2d14a08a15e87fd18205b2e/users/e47b29049c704d11a9c4072a174f92ae/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:09.431347 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa259c-e7d4-4080-88eb-b92e228c5d97 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:09.441019 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-17aa259c-e7d4-4080-88eb-b92e228c5d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:09.448853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 944/1886] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:09 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:09.449739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b6499-b981-4fe8-b34c-2dd0078da855 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:09.478569 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:09.495409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:09.503742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa259c-e7d4-4080-88eb-b92e228c5d97 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:09.512423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b6499-b981-4fe8-b34c-2dd0078da855 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:09.517132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45640338-581a-481f-b85d-3728c50d53cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:09.517798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45640338-581a-481f-b85d-3728c50d53cb admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.518096 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45640338-581a-481f-b85d-3728c50d53cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.518395 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45640338-581a-481f-b85d-3728c50d53cb admin admin] PATH_INFO: `/v3/projects/4c19538b52b0438081790878024a8531/users/939beab5464e492089e70eac961d2eb9/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.520276 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45640338-581a-481f-b85d-3728c50d53cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c19538b52b0438081790878024a8531, user_id=939beab5464e492089e70eac961d2eb9, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:09.522923 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45640338-581a-481f-b85d-3728c50d53cb admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:09.533653 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 945/1887] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:09 2022] PUT /identity/v3/projects/4c19538b52b0438081790878024a8531/users/939beab5464e492089e70eac961d2eb9/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:09.534955 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1232c-aa85-4450-a66d-cc0de36d30ad None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.535215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1232c-aa85-4450-a66d-cc0de36d30ad None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.535493 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1232c-aa85-4450-a66d-cc0de36d30ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.556853 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6b811-c59b-43bc-8af7-87355496cb30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:09.557058 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6b811-c59b-43bc-8af7-87355496cb30 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.557304 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6b811-c59b-43bc-8af7-87355496cb30 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.557571 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6b811-c59b-43bc-8af7-87355496cb30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.559281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5de6b811-c59b-43bc-8af7-87355496cb30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:09.564185 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e4c1232c-aa85-4450-a66d-cc0de36d30ad None None] MFA Rules not processed for user `e47b29049c704d11a9c4072a174f92ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:09.565388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e4c1232c-aa85-4450-a66d-cc0de36d30ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:09.620814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6b811-c59b-43bc-8af7-87355496cb30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:09.622810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6b811-c59b-43bc-8af7-87355496cb30 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:09.633420 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 943/1888] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:09.633859 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6b811-c59b-43bc-8af7-87355496cb30 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:09.637156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 946/1889] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:09.638736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ad151-2d03-4a10-9954-2ea5b07f64db None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.639139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ad151-2d03-4a10-9954-2ea5b07f64db None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.639509 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ad151-2d03-4a10-9954-2ea5b07f64db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.645558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6b811-c59b-43bc-8af7-87355496cb30 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:09.675674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-614ad151-2d03-4a10-9954-2ea5b07f64db None None] MFA Rules not processed for user `939beab5464e492089e70eac961d2eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:09.677990 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-614ad151-2d03-4a10-9954-2ea5b07f64db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:09.727303 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d02665-6059-4144-8056-f6ba6b38d4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:09.728212 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d02665-6059-4144-8056-f6ba6b38d4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.728603 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d02665-6059-4144-8056-f6ba6b38d4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.728957 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d02665-6059-4144-8056-f6ba6b38d4f8 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.729692 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d02665-6059-4144-8056-f6ba6b38d4f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:09.732043 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d02665-6059-4144-8056-f6ba6b38d4f8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:09.762612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 944/1890] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:09 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:09.762612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d02665-6059-4144-8056-f6ba6b38d4f8 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:09.775083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d02665-6059-4144-8056-f6ba6b38d4f8 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:09.776627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 947/1891] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:09.780833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ad151-2d03-4a10-9954-2ea5b07f64db None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:09.789878 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52c25a-c1ef-4cce-82f1-3c0ea746747e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:09.790527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52c25a-c1ef-4cce-82f1-3c0ea746747e admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.790637 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ad151-2d03-4a10-9954-2ea5b07f64db None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:09.790799 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52c25a-c1ef-4cce-82f1-3c0ea746747e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.791074 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52c25a-c1ef-4cce-82f1-3c0ea746747e admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.791719 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52c25a-c1ef-4cce-82f1-3c0ea746747e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:09.793691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52c25a-c1ef-4cce-82f1-3c0ea746747e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:09.796191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca007f-5b5a-40aa-bfcc-8f2187766680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:09.796948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca007f-5b5a-40aa-bfcc-8f2187766680 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.797213 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca007f-5b5a-40aa-bfcc-8f2187766680 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.798023 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca007f-5b5a-40aa-bfcc-8f2187766680 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.798768 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca007f-5b5a-40aa-bfcc-8f2187766680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:09.818052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca007f-5b5a-40aa-bfcc-8f2187766680 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:09.836482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 945/1892] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:09 2022] POST /identity/v3/projects => generated 355 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:09.837394 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52c25a-c1ef-4cce-82f1-3c0ea746747e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:09.845339 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 948/1893] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:09.845522 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9b52c25a-c1ef-4cce-82f1-3c0ea746747e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:09.845629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca007f-5b5a-40aa-bfcc-8f2187766680 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:09.857584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca007f-5b5a-40aa-bfcc-8f2187766680 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:09.874197 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:09.912165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:09.946975 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c0e39-af35-43fa-ac4c-1091f449adf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:09.947597 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c0e39-af35-43fa-ac4c-1091f449adf9 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:09.948043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c0e39-af35-43fa-ac4c-1091f449adf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:09.948437 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c0e39-af35-43fa-ac4c-1091f449adf9 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:09.949948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c0e39-af35-43fa-ac4c-1091f449adf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:09.952164 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c0e39-af35-43fa-ac4c-1091f449adf9 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:09.982436 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52c25a-c1ef-4cce-82f1-3c0ea746747e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:09.992370 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 949/1894] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:09 2022] POST /identity/v3/users => generated 284 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:09.994897 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c0e39-af35-43fa-ac4c-1091f449adf9 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:10.003377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcec7fe-09c2-4268-abed-889f36d5fd46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:10.004604 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcec7fe-09c2-4268-abed-889f36d5fd46 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:10.007332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcec7fe-09c2-4268-abed-889f36d5fd46 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:10.007760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcec7fe-09c2-4268-abed-889f36d5fd46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:10.011811 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c0e39-af35-43fa-ac4c-1091f449adf9 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:10.012415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2fcec7fe-09c2-4268-abed-889f36d5fd46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:10.022061 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6d9ed-f004-40de-a17c-b27160a1e0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:10.022817 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6d9ed-f004-40de-a17c-b27160a1e0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:10.023099 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6d9ed-f004-40de-a17c-b27160a1e0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:10.023370 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6d9ed-f004-40de-a17c-b27160a1e0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:10.024122 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6d9ed-f004-40de-a17c-b27160a1e0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:10.035042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6d9ed-f004-40de-a17c-b27160a1e0d2 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:10.056372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 950/1895] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:10.057497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6d9ed-f004-40de-a17c-b27160a1e0d2 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:10.072910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6d9ed-f004-40de-a17c-b27160a1e0d2 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:10.083526 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb2d10-4a62-47c5-a327-c6295c3ae6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:10.084239 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb2d10-4a62-47c5-a327-c6295c3ae6ed admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:10.084644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb2d10-4a62-47c5-a327-c6295c3ae6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:10.084993 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb2d10-4a62-47c5-a327-c6295c3ae6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:10.085720 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb2d10-4a62-47c5-a327-c6295c3ae6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:10.087462 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb2d10-4a62-47c5-a327-c6295c3ae6ed admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:10.138172 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 951/1896] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:10.138172 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb2d10-4a62-47c5-a327-c6295c3ae6ed admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:10.162289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb2d10-4a62-47c5-a327-c6295c3ae6ed admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:10.176235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f27489-89c4-47ff-b45c-7b816747f5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:10.182096 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcec7fe-09c2-4268-abed-889f36d5fd46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:10.183696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcec7fe-09c2-4268-abed-889f36d5fd46 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:10.193096 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f27489-89c4-47ff-b45c-7b816747f5c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:10.193452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f27489-89c4-47ff-b45c-7b816747f5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:10.193740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f27489-89c4-47ff-b45c-7b816747f5c9 admin admin] PATH_INFO: `/v3/projects/368d8aa60f9e4ea39a0d7f9c9bb19c86/users/9f579339d3ef4f60b40d0d86d49c8086/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:10.204140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 946/1897] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:10.205915 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcec7fe-09c2-4268-abed-889f36d5fd46 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:10.235536 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcec7fe-09c2-4268-abed-889f36d5fd46 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:10.243526 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f27489-89c4-47ff-b45c-7b816747f5c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=368d8aa60f9e4ea39a0d7f9c9bb19c86, user_id=9f579339d3ef4f60b40d0d86d49c8086, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:10.248085 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f27489-89c4-47ff-b45c-7b816747f5c9 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:10.252238 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383fb24-6a1a-4ed5-8864-e376f0ea1a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:10.252981 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383fb24-6a1a-4ed5-8864-e376f0ea1a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:10.253252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383fb24-6a1a-4ed5-8864-e376f0ea1a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:10.253535 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383fb24-6a1a-4ed5-8864-e376f0ea1a06 admin admin] PATH_INFO: `/v3/projects/2ff38722bd834e47a2b6b9fc0d69c4a0/users/27493d2933054192bc1b7b93d659f9a6/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:10.279573 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 952/1898] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:10 2022] PUT /identity/v3/projects/368d8aa60f9e4ea39a0d7f9c9bb19c86/users/9f579339d3ef4f60b40d0d86d49c8086/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:10.286757 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383fb24-6a1a-4ed5-8864-e376f0ea1a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff38722bd834e47a2b6b9fc0d69c4a0, user_id=27493d2933054192bc1b7b93d659f9a6, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:10.291170 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266ef5f-3862-4387-8b6b-c85096e941af None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:10.291521 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266ef5f-3862-4387-8b6b-c85096e941af None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:10.291633 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383fb24-6a1a-4ed5-8864-e376f0ea1a06 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:10.297174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266ef5f-3862-4387-8b6b-c85096e941af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:10.314148 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 947/1899] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:10 2022] PUT /identity/v3/projects/2ff38722bd834e47a2b6b9fc0d69c4a0/users/27493d2933054192bc1b7b93d659f9a6/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:10.318141 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383fb24-6a1a-4ed5-8864-e376f0ea1a06 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:10.402080 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-b266ef5f-3862-4387-8b6b-c85096e941af None None] MFA Rules not processed for user `9f579339d3ef4f60b40d0d86d49c8086`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:10.405845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b266ef5f-3862-4387-8b6b-c85096e941af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:10.500376 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383fb24-6a1a-4ed5-8864-e376f0ea1a06 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:10.511139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533aa887-3b5b-4f43-951c-90b07e105ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:10.511776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aa887-3b5b-4f43-951c-90b07e105ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:10.512589 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aa887-3b5b-4f43-951c-90b07e105ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:10.512983 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aa887-3b5b-4f43-951c-90b07e105ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:10.515364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533aa887-3b5b-4f43-951c-90b07e105ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:10.517664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533aa887-3b5b-4f43-951c-90b07e105ce0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:10.554721 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 948/1900] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:10.563921 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533aa887-3b5b-4f43-951c-90b07e105ce0 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:10.576270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 953/1901] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:10.579402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266ef5f-3862-4387-8b6b-c85096e941af None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:10.592110 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533aa887-3b5b-4f43-951c-90b07e105ce0 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:10.595141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266ef5f-3862-4387-8b6b-c85096e941af None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:10.601077 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b697d4-cc2e-4b83-b6d3-99a044517c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:10.601705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b697d4-cc2e-4b83-b6d3-99a044517c99 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:10.601992 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b697d4-cc2e-4b83-b6d3-99a044517c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:10.602327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b697d4-cc2e-4b83-b6d3-99a044517c99 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:10.602991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b697d4-cc2e-4b83-b6d3-99a044517c99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:10.605117 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b697d4-cc2e-4b83-b6d3-99a044517c99 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:10.609297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7791636-5122-4c05-921f-a3cbd26ad804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:10.610800 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7791636-5122-4c05-921f-a3cbd26ad804 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:10.611086 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7791636-5122-4c05-921f-a3cbd26ad804 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:10.611356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7791636-5122-4c05-921f-a3cbd26ad804 admin admin] PATH_INFO: `/v3/projects/2ff38722bd834e47a2b6b9fc0d69c4a0/users/27493d2933054192bc1b7b93d659f9a6/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:10.616380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7791636-5122-4c05-921f-a3cbd26ad804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff38722bd834e47a2b6b9fc0d69c4a0, user_id=27493d2933054192bc1b7b93d659f9a6, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:10.620668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7791636-5122-4c05-921f-a3cbd26ad804 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:10.672977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 949/1902] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:10 2022] PUT /identity/v3/projects/2ff38722bd834e47a2b6b9fc0d69c4a0/users/27493d2933054192bc1b7b93d659f9a6/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:10.673581 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 954/1903] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:10 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:10.681311 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7791636-5122-4c05-921f-a3cbd26ad804 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:10.687239 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289c167-6edb-407e-8f29-ccbb40a85346 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:10.687539 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289c167-6edb-407e-8f29-ccbb40a85346 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:10.687820 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289c167-6edb-407e-8f29-ccbb40a85346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:10.762440 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:10.796371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-a289c167-6edb-407e-8f29-ccbb40a85346 None None] MFA Rules not processed for user `27493d2933054192bc1b7b93d659f9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:10.798806 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a289c167-6edb-407e-8f29-ccbb40a85346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:10.855755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7791636-5122-4c05-921f-a3cbd26ad804 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:10.898514 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:10.940967 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 955/1904] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:10.955084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289c167-6edb-407e-8f29-ccbb40a85346 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:11.020045 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0bf09-1b75-4d3b-896e-b98c5ee9bf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:11.020705 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0bf09-1b75-4d3b-896e-b98c5ee9bf2c admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:11.020982 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0bf09-1b75-4d3b-896e-b98c5ee9bf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:11.021256 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0bf09-1b75-4d3b-896e-b98c5ee9bf2c admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:11.023207 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0bf09-1b75-4d3b-896e-b98c5ee9bf2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:11.025632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0bf09-1b75-4d3b-896e-b98c5ee9bf2c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:11.058170 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 950/1905] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:10 2022] POST /identity/v3/users => generated 290 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:11.065258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0bf09-1b75-4d3b-896e-b98c5ee9bf2c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:11.082805 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289c167-6edb-407e-8f29-ccbb40a85346 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:11.083358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0bf09-1b75-4d3b-896e-b98c5ee9bf2c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:11.088895 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3b5ce-9fb5-430e-9d64-2155178cf060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:11.089491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2884492-f062-48d6-b35b-f6cf7329b1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:11.090199 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2884492-f062-48d6-b35b-f6cf7329b1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:11.090488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2884492-f062-48d6-b35b-f6cf7329b1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:11.090786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2884492-f062-48d6-b35b-f6cf7329b1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:11.091768 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3b5ce-9fb5-430e-9d64-2155178cf060 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:11.091984 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2884492-f062-48d6-b35b-f6cf7329b1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:11.092135 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3b5ce-9fb5-430e-9d64-2155178cf060 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:11.092404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3b5ce-9fb5-430e-9d64-2155178cf060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:11.093779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2884492-f062-48d6-b35b-f6cf7329b1b1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:11.110094 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3b5ce-9fb5-430e-9d64-2155178cf060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:11.111702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3b5ce-9fb5-430e-9d64-2155178cf060 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:11.118400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 951/1906] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:11.122860 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2884492-f062-48d6-b35b-f6cf7329b1b1 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:11.134419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2884492-f062-48d6-b35b-f6cf7329b1b1 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:11.136709 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 956/1907] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:10 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 10:47:11.147464 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589616c2-45a7-48aa-927b-1df6efddaac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:11.148077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589616c2-45a7-48aa-927b-1df6efddaac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:11.148491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589616c2-45a7-48aa-927b-1df6efddaac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:11.148743 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589616c2-45a7-48aa-927b-1df6efddaac9 admin admin] PATH_INFO: `/v3/projects/bd3eb66805bb4b12bc11ba2b54801bf8/users/f85f286a087244afa48df6efc20af409/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:11.180129 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589616c2-45a7-48aa-927b-1df6efddaac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd3eb66805bb4b12bc11ba2b54801bf8, user_id=f85f286a087244afa48df6efc20af409, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:11.182797 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589616c2-45a7-48aa-927b-1df6efddaac9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:11.186870 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3b5ce-9fb5-430e-9d64-2155178cf060 service cinder] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:11.188600 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-12f3b5ce-9fb5-430e-9d64-2155178cf060 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:11.200652 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 952/1908] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:11 2022] PUT /identity/v3/projects/bd3eb66805bb4b12bc11ba2b54801bf8/users/f85f286a087244afa48df6efc20af409/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:11.203594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589616c2-45a7-48aa-927b-1df6efddaac9 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:11.223355 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3b5ce-9fb5-430e-9d64-2155178cf060 service cinder] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:11.331444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589616c2-45a7-48aa-927b-1df6efddaac9 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:11.336656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239324f-a83c-435a-8ca6-69b9c42adc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:11.337291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239324f-a83c-435a-8ca6-69b9c42adc7c admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:11.337575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239324f-a83c-435a-8ca6-69b9c42adc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:11.338079 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239324f-a83c-435a-8ca6-69b9c42adc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:11.338859 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239324f-a83c-435a-8ca6-69b9c42adc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:11.340463 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f1c4a-1709-4e22-9838-32809cd42120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:11.340899 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239324f-a83c-435a-8ca6-69b9c42adc7c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:11.341892 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1c4a-1709-4e22-9838-32809cd42120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:11.342381 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1c4a-1709-4e22-9838-32809cd42120 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:11.343022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1c4a-1709-4e22-9838-32809cd42120 admin admin] PATH_INFO: `/v3/users/7201e5ab09ca4a569e0c7e72ec7811e7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:11.345673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f1c4a-1709-4e22-9838-32809cd42120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7201e5ab09ca4a569e0c7e72ec7811e7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:11.348420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f1c4a-1709-4e22-9838-32809cd42120 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:11.360599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 953/1909] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:11.360599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239324f-a83c-435a-8ca6-69b9c42adc7c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:11.397867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:11.454656 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-328f1c4a-1709-4e22-9838-32809cd42120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7201e5ab09ca4a569e0c7e72ec7811e7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:11.459895 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239324f-a83c-435a-8ca6-69b9c42adc7c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:11.468072 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-328f1c4a-1709-4e22-9838-32809cd42120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7201e5ab09ca4a569e0c7e72ec7811e7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:11.469755 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-328f1c4a-1709-4e22-9838-32809cd42120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7201e5ab09ca4a569e0c7e72ec7811e7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:11.470725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-328f1c4a-1709-4e22-9838-32809cd42120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7201e5ab09ca4a569e0c7e72ec7811e7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:11.473137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723f1b8-6f9b-4f7b-932e-0931482fec1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:11.473751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f1b8-6f9b-4f7b-932e-0931482fec1a service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:11.474514 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f1b8-6f9b-4f7b-932e-0931482fec1a service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:11.474514 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f1b8-6f9b-4f7b-932e-0931482fec1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:11.476664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2723f1b8-6f9b-4f7b-932e-0931482fec1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:11.481811 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-328f1c4a-1709-4e22-9838-32809cd42120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7201e5ab09ca4a569e0c7e72ec7811e7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:11.498503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:11.509963 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 957/1910] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:11 2022] DELETE /identity/v3/users/7201e5ab09ca4a569e0c7e72ec7811e7 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:11.510874 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f1c4a-1709-4e22-9838-32809cd42120 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:11.512331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-328f1c4a-1709-4e22-9838-32809cd42120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:11.584421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f1c4a-1709-4e22-9838-32809cd42120 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:11.589013 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6e673-7461-4cf6-9a1a-4380f6efc5c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:11.590034 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6e673-7461-4cf6-9a1a-4380f6efc5c6 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:11.590479 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6e673-7461-4cf6-9a1a-4380f6efc5c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:11.590857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6e673-7461-4cf6-9a1a-4380f6efc5c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:11.593686 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-15b6e673-7461-4cf6-9a1a-4380f6efc5c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:11.619475 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723f1b8-6f9b-4f7b-932e-0931482fec1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:11.621305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723f1b8-6f9b-4f7b-932e-0931482fec1a service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:11.635976 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 954/1911] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:11.638685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723f1b8-6f9b-4f7b-932e-0931482fec1a service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:11.642142 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2723f1b8-6f9b-4f7b-932e-0931482fec1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:11.664977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723f1b8-6f9b-4f7b-932e-0931482fec1a service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:11.740660 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6e673-7461-4cf6-9a1a-4380f6efc5c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:11.743829 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6e673-7461-4cf6-9a1a-4380f6efc5c6 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:11.757625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d5044-01a6-462e-8ebb-d04632d6f61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:11.758307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d5044-01a6-462e-8ebb-d04632d6f61d admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:11.758591 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d5044-01a6-462e-8ebb-d04632d6f61d admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:11.758861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d5044-01a6-462e-8ebb-d04632d6f61d admin admin] PATH_INFO: `/v3/projects/bd3eb66805bb4b12bc11ba2b54801bf8/users/f85f286a087244afa48df6efc20af409/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:11.761587 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d5044-01a6-462e-8ebb-d04632d6f61d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd3eb66805bb4b12bc11ba2b54801bf8, user_id=f85f286a087244afa48df6efc20af409, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:11.764781 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d5044-01a6-462e-8ebb-d04632d6f61d admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:11.768614 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 958/1912] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:11.770499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8e04e-cbbc-47d2-8216-f21728a65875 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:11.770935 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8e04e-cbbc-47d2-8216-f21728a65875 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:11.771619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8e04e-cbbc-47d2-8216-f21728a65875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:11.793362 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 955/1913] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:11 2022] PUT /identity/v3/projects/bd3eb66805bb4b12bc11ba2b54801bf8/users/f85f286a087244afa48df6efc20af409/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:11.800039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c173c3-7482-4a75-956b-8dc4a979117d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:11.800431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c173c3-7482-4a75-956b-8dc4a979117d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:11.800738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c173c3-7482-4a75-956b-8dc4a979117d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:11.801367 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-d8e8e04e-cbbc-47d2-8216-f21728a65875 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:11.802753 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d8e8e04e-cbbc-47d2-8216-f21728a65875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:11.856322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d1c173c3-7482-4a75-956b-8dc4a979117d None None] MFA Rules not processed for user `f85f286a087244afa48df6efc20af409`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:11.857659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d1c173c3-7482-4a75-956b-8dc4a979117d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:11.982713 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 959/1914] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:11.998761 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:11.999891 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8e04e-cbbc-47d2-8216-f21728a65875 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:12.002990 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d8e8e04e-cbbc-47d2-8216-f21728a65875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:12.029432 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 956/1915] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:12.054617 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c173c3-7482-4a75-956b-8dc4a979117d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:12.113159 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8e04e-cbbc-47d2-8216-f21728a65875 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:12.121275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a024a-f8f9-4284-a78b-7a3f2e7c0da5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:12.123227 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a024a-f8f9-4284-a78b-7a3f2e7c0da5 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:12.124215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a024a-f8f9-4284-a78b-7a3f2e7c0da5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:12.124998 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a024a-f8f9-4284-a78b-7a3f2e7c0da5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:12.137112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:12.142653 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c173c3-7482-4a75-956b-8dc4a979117d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:12.145938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a024a-f8f9-4284-a78b-7a3f2e7c0da5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:12.149491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ac06c-9b02-4cbf-b12e-ffc821b1e9c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:12.149662 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a024a-f8f9-4284-a78b-7a3f2e7c0da5 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:12.151168 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ac06c-9b02-4cbf-b12e-ffc821b1e9c7 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:12.151623 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ac06c-9b02-4cbf-b12e-ffc821b1e9c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:12.152090 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ac06c-9b02-4cbf-b12e-ffc821b1e9c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:12.170910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ac06c-9b02-4cbf-b12e-ffc821b1e9c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:12.173089 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ac06c-9b02-4cbf-b12e-ffc821b1e9c7 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:12.181508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 960/1916] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:12.203371 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 957/1917] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:12.262652 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a024a-f8f9-4284-a78b-7a3f2e7c0da5 service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:12.265422 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-539a024a-f8f9-4284-a78b-7a3f2e7c0da5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:12.282383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a024a-f8f9-4284-a78b-7a3f2e7c0da5 service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:12.292645 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b667406-9cb2-4a44-a9c5-4155cd80f8bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:12.294681 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b667406-9cb2-4a44-a9c5-4155cd80f8bd service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:12.296522 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b667406-9cb2-4a44-a9c5-4155cd80f8bd service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:12.297006 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b667406-9cb2-4a44-a9c5-4155cd80f8bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:12.303318 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-5b667406-9cb2-4a44-a9c5-4155cd80f8bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:12.452371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b667406-9cb2-4a44-a9c5-4155cd80f8bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:12.454253 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b667406-9cb2-4a44-a9c5-4155cd80f8bd service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:12.484134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 961/1918] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:12.603037 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ac06c-9b02-4cbf-b12e-ffc821b1e9c7 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:12.604720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-671ac06c-9b02-4cbf-b12e-ffc821b1e9c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:12.625944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ac06c-9b02-4cbf-b12e-ffc821b1e9c7 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:12.633331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0040cf-e450-43b6-a9da-7f2d81b9172e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:12.633331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0040cf-e450-43b6-a9da-7f2d81b9172e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:12.633331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0040cf-e450-43b6-a9da-7f2d81b9172e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:12.633669 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0040cf-e450-43b6-a9da-7f2d81b9172e admin admin] PATH_INFO: `/v3/projects/b819fbcb922045f283eea8df62a0b5ac` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:12.634829 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0040cf-e450-43b6-a9da-7f2d81b9172e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b819fbcb922045f283eea8df62a0b5ac)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:12.636933 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0040cf-e450-43b6-a9da-7f2d81b9172e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:12.754062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3d0040cf-e450-43b6-a9da-7f2d81b9172e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b819fbcb922045f283eea8df62a0b5ac', 'request_id': 'req-3d0040cf-e450-43b6-a9da-7f2d81b9172e'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:12.763397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3d0040cf-e450-43b6-a9da-7f2d81b9172e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b819fbcb922045f283eea8df62a0b5ac', 'request_id': 'req-3d0040cf-e450-43b6-a9da-7f2d81b9172e'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:12.784129 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3d0040cf-e450-43b6-a9da-7f2d81b9172e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b819fbcb922045f283eea8df62a0b5ac', 'request_id': 'req-3d0040cf-e450-43b6-a9da-7f2d81b9172e'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:12.786163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b667406-9cb2-4a44-a9c5-4155cd80f8bd service cinder] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:12.796072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3d0040cf-e450-43b6-a9da-7f2d81b9172e admin admin] The token cache is being invalidate because project b819fbcb922045f283eea8df62a0b5ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:12.796455 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3d0040cf-e450-43b6-a9da-7f2d81b9172e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:12.797310 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3d0040cf-e450-43b6-a9da-7f2d81b9172e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:12.799617 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 958/1919] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:12 2022] DELETE /identity/v3/projects/b819fbcb922045f283eea8df62a0b5ac => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:12.801778 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b667406-9cb2-4a44-a9c5-4155cd80f8bd service cinder] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:12.803866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0040cf-e450-43b6-a9da-7f2d81b9172e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:12.805165 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3d0040cf-e450-43b6-a9da-7f2d81b9172e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:12.919420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6a377-e80b-40bb-9f35-423da39569d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:12.920204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6a377-e80b-40bb-9f35-423da39569d0 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:12.920483 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6a377-e80b-40bb-9f35-423da39569d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:12.920972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6a377-e80b-40bb-9f35-423da39569d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:12.923335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c8d6a377-e80b-40bb-9f35-423da39569d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:12.925831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0040cf-e450-43b6-a9da-7f2d81b9172e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:12.942873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb588bc-f474-40c9-911b-c250e1b88229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:12.943539 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb588bc-f474-40c9-911b-c250e1b88229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:12.943912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb588bc-f474-40c9-911b-c250e1b88229 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:12.944116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb588bc-f474-40c9-911b-c250e1b88229 admin admin] PATH_INFO: `/v3/users/d97dc7c8f8d84ac5bd6e518f44a0bfd4` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:12.945751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb588bc-f474-40c9-911b-c250e1b88229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97dc7c8f8d84ac5bd6e518f44a0bfd4)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:12.948894 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb588bc-f474-40c9-911b-c250e1b88229 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:13.004417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:13.057458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6a377-e80b-40bb-9f35-423da39569d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:13.059175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6a377-e80b-40bb-9f35-423da39569d0 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:13.074110 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7eb588bc-f474-40c9-911b-c250e1b88229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97dc7c8f8d84ac5bd6e518f44a0bfd4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:13.078284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 962/1920] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:13.085796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7eb588bc-f474-40c9-911b-c250e1b88229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97dc7c8f8d84ac5bd6e518f44a0bfd4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:13.088138 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7eb588bc-f474-40c9-911b-c250e1b88229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97dc7c8f8d84ac5bd6e518f44a0bfd4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:13.089467 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7eb588bc-f474-40c9-911b-c250e1b88229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97dc7c8f8d84ac5bd6e518f44a0bfd4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:13.109017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfab99-cd1a-41c2-b0d9-c4add2eab42b None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:13.109512 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfab99-cd1a-41c2-b0d9-c4add2eab42b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:13.110691 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfab99-cd1a-41c2-b0d9-c4add2eab42b None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:13.113463 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 963/1921] 10.222.0.20 () {54 vars in 921 bytes} [Sun Sep 11 10:47:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 10:47:13.118243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7eb588bc-f474-40c9-911b-c250e1b88229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97dc7c8f8d84ac5bd6e518f44a0bfd4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:13.136003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9a6a4-9674-44ed-ac60-2058c098f1af None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:13.136402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9a6a4-9674-44ed-ac60-2058c098f1af None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:13.136713 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9a6a4-9674-44ed-ac60-2058c098f1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:13.171993 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 959/1922] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:12 2022] DELETE /identity/v3/users/d97dc7c8f8d84ac5bd6e518f44a0bfd4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:13.172227 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-a7d9a6a4-9674-44ed-ac60-2058c098f1af None None] MFA Rules not processed for user `b642a1d00de940429fc1cc6131ac22b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:13.180365 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a7d9a6a4-9674-44ed-ac60-2058c098f1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:13.254261 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:13.310341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 964/1923] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Sep 11 10:47:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:13.344071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb588bc-f474-40c9-911b-c250e1b88229 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:13.346815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7eb588bc-f474-40c9-911b-c250e1b88229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:13.387330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb588bc-f474-40c9-911b-c250e1b88229 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:13.405691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b03698-0cb4-42dc-848e-8bf8b38ae8a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:13.406978 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b03698-0cb4-42dc-848e-8bf8b38ae8a5 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:13.407271 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b03698-0cb4-42dc-848e-8bf8b38ae8a5 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:13.407556 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b03698-0cb4-42dc-848e-8bf8b38ae8a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:13.427716 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b03698-0cb4-42dc-848e-8bf8b38ae8a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:13.429521 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b03698-0cb4-42dc-848e-8bf8b38ae8a5 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:13.485320 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 960/1924] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:13.726515 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9a6a4-9674-44ed-ac60-2058c098f1af None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:13.728183 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a7d9a6a4-9674-44ed-ac60-2058c098f1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:13.809959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9a6a4-9674-44ed-ac60-2058c098f1af None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:13.816302 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce761e-39af-4b03-a53b-254a8875b746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:13.816976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce761e-39af-4b03-a53b-254a8875b746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:13.817262 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce761e-39af-4b03-a53b-254a8875b746 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:13.817533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce761e-39af-4b03-a53b-254a8875b746 admin admin] PATH_INFO: `/v3/projects/671a35a0e71f48b298cdc355f37cc743` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:13.818667 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce761e-39af-4b03-a53b-254a8875b746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=671a35a0e71f48b298cdc355f37cc743)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:13.820608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce761e-39af-4b03-a53b-254a8875b746 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:13.873882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-fdce761e-39af-4b03-a53b-254a8875b746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671a35a0e71f48b298cdc355f37cc743', 'request_id': 'req-fdce761e-39af-4b03-a53b-254a8875b746'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:13.881202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-fdce761e-39af-4b03-a53b-254a8875b746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671a35a0e71f48b298cdc355f37cc743', 'request_id': 'req-fdce761e-39af-4b03-a53b-254a8875b746'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:13.900949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-fdce761e-39af-4b03-a53b-254a8875b746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671a35a0e71f48b298cdc355f37cc743', 'request_id': 'req-fdce761e-39af-4b03-a53b-254a8875b746'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:13.904448 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-fdce761e-39af-4b03-a53b-254a8875b746 admin admin] The token cache is being invalidate because project 671a35a0e71f48b298cdc355f37cc743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:13.904775 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-fdce761e-39af-4b03-a53b-254a8875b746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:13.905562 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-fdce761e-39af-4b03-a53b-254a8875b746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:13.908107 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 965/1925] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:13 2022] DELETE /identity/v3/projects/671a35a0e71f48b298cdc355f37cc743 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:13.911922 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b03698-0cb4-42dc-848e-8bf8b38ae8a5 service nova] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:13.923245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b03698-0cb4-42dc-848e-8bf8b38ae8a5 service nova] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:14.009463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69558171-914e-4419-90d4-dc527f94fa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:14.010135 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69558171-914e-4419-90d4-dc527f94fa45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:14.010633 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69558171-914e-4419-90d4-dc527f94fa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:14.012127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69558171-914e-4419-90d4-dc527f94fa45 admin admin] PATH_INFO: `/v3/users/9136fe54b40045689e6fb8cba0dda9ca` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:14.017733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69558171-914e-4419-90d4-dc527f94fa45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9136fe54b40045689e6fb8cba0dda9ca)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:14.020748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69558171-914e-4419-90d4-dc527f94fa45 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:14.062406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce761e-39af-4b03-a53b-254a8875b746 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:14.067084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fdce761e-39af-4b03-a53b-254a8875b746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:14.104635 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-69558171-914e-4419-90d4-dc527f94fa45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9136fe54b40045689e6fb8cba0dda9ca'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:14.114995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-69558171-914e-4419-90d4-dc527f94fa45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9136fe54b40045689e6fb8cba0dda9ca'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:14.123152 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-69558171-914e-4419-90d4-dc527f94fa45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9136fe54b40045689e6fb8cba0dda9ca'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:14.124017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-69558171-914e-4419-90d4-dc527f94fa45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9136fe54b40045689e6fb8cba0dda9ca'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:14.142406 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-69558171-914e-4419-90d4-dc527f94fa45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9136fe54b40045689e6fb8cba0dda9ca'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:14.166665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce761e-39af-4b03-a53b-254a8875b746 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:14.172942 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 961/1926] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:13 2022] DELETE /identity/v3/users/9136fe54b40045689e6fb8cba0dda9ca => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:14.197175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4affb9-2c9c-4a40-a42c-f9ed8ef17d74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:14.197175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4affb9-2c9c-4a40-a42c-f9ed8ef17d74 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:14.197175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4affb9-2c9c-4a40-a42c-f9ed8ef17d74 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:14.197175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4affb9-2c9c-4a40-a42c-f9ed8ef17d74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:14.197740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8b4affb9-2c9c-4a40-a42c-f9ed8ef17d74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:14.251027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:14.317097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4affb9-2c9c-4a40-a42c-f9ed8ef17d74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:14.318545 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4affb9-2c9c-4a40-a42c-f9ed8ef17d74 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:14.340922 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 966/1927] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:14.665980 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69558171-914e-4419-90d4-dc527f94fa45 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:14.667526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-69558171-914e-4419-90d4-dc527f94fa45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:14.682893 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:14.889249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69558171-914e-4419-90d4-dc527f94fa45 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:14.907431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a44d44-3d1e-4782-abf8-a29be7e35352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:14.913361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a44d44-3d1e-4782-abf8-a29be7e35352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:14.913875 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a44d44-3d1e-4782-abf8-a29be7e35352 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:14.919907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a44d44-3d1e-4782-abf8-a29be7e35352 admin admin] PATH_INFO: `/v3/projects/989344b4958b417baf658ea1ff8f63d7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:14.922776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a44d44-3d1e-4782-abf8-a29be7e35352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=989344b4958b417baf658ea1ff8f63d7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:14.927969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a44d44-3d1e-4782-abf8-a29be7e35352 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:15.024879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b5a44d44-3d1e-4782-abf8-a29be7e35352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '989344b4958b417baf658ea1ff8f63d7', 'request_id': 'req-b5a44d44-3d1e-4782-abf8-a29be7e35352'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:15.033603 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b5a44d44-3d1e-4782-abf8-a29be7e35352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '989344b4958b417baf658ea1ff8f63d7', 'request_id': 'req-b5a44d44-3d1e-4782-abf8-a29be7e35352'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:15.062589 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b5a44d44-3d1e-4782-abf8-a29be7e35352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '989344b4958b417baf658ea1ff8f63d7', 'request_id': 'req-b5a44d44-3d1e-4782-abf8-a29be7e35352'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:15.085335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b5a44d44-3d1e-4782-abf8-a29be7e35352 admin admin] The token cache is being invalidate because project 989344b4958b417baf658ea1ff8f63d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:15.085633 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b5a44d44-3d1e-4782-abf8-a29be7e35352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:15.086299 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b5a44d44-3d1e-4782-abf8-a29be7e35352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:15.093472 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 962/1928] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:14 2022] DELETE /identity/v3/projects/989344b4958b417baf658ea1ff8f63d7 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:15.095720 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de82da9-63df-4675-85e9-3d261a1ce8d3 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:15.096169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de82da9-63df-4675-85e9-3d261a1ce8d3 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:15.096268 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de82da9-63df-4675-85e9-3d261a1ce8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:15.125930 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-0de82da9-63df-4675-85e9-3d261a1ce8d3 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:15.127516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0de82da9-63df-4675-85e9-3d261a1ce8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:15.142282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a44d44-3d1e-4782-abf8-a29be7e35352 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:15.144594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b5a44d44-3d1e-4782-abf8-a29be7e35352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:15.236651 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 967/1929] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:15.245773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22429551-7557-46fa-aa53-07966aadfdd5 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:15.246068 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22429551-7557-46fa-aa53-07966aadfdd5 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:15.246350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22429551-7557-46fa-aa53-07966aadfdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:15.278110 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-22429551-7557-46fa-aa53-07966aadfdd5 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:15.279566 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-22429551-7557-46fa-aa53-07966aadfdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:15.293099 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 968/1930] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:15.294153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22429551-7557-46fa-aa53-07966aadfdd5 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:15.304045 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22429551-7557-46fa-aa53-07966aadfdd5 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:15.312092 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a44d44-3d1e-4782-abf8-a29be7e35352 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:15.314519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e34c7-2752-4921-b203-79733585b92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:15.315683 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e34c7-2752-4921-b203-79733585b92f admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:15.315975 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e34c7-2752-4921-b203-79733585b92f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:15.316321 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e34c7-2752-4921-b203-79733585b92f admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:15.317171 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e34c7-2752-4921-b203-79733585b92f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:15.317394 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e34c7-2752-4921-b203-79733585b92f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:15.319048 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7629e-8151-434b-aac0-b4d3e78b51d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:15.319187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e34c7-2752-4921-b203-79733585b92f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:15.319884 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7629e-8151-434b-aac0-b4d3e78b51d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:15.320265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7629e-8151-434b-aac0-b4d3e78b51d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:15.320654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7629e-8151-434b-aac0-b4d3e78b51d2 admin admin] PATH_INFO: `/v3/users/e46dfe87ca5f4620a23a400adf671c9f` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:15.325724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7629e-8151-434b-aac0-b4d3e78b51d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46dfe87ca5f4620a23a400adf671c9f)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:15.327928 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7629e-8151-434b-aac0-b4d3e78b51d2 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:15.334469 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 969/1931] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:47:15.339772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e34c7-2752-4921-b203-79733585b92f admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:15.353548 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e34c7-2752-4921-b203-79733585b92f admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:15.361070 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafbbe5-25e9-4c48-8c07-52db795c5bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:15.362093 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafbbe5-25e9-4c48-8c07-52db795c5bdf admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:15.362394 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafbbe5-25e9-4c48-8c07-52db795c5bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:15.362656 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafbbe5-25e9-4c48-8c07-52db795c5bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:15.363301 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafbbe5-25e9-4c48-8c07-52db795c5bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:15.366533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafbbe5-25e9-4c48-8c07-52db795c5bdf admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:15.391374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:15.408311 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-74e7629e-8151-434b-aac0-b4d3e78b51d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46dfe87ca5f4620a23a400adf671c9f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:15.409582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 970/1932] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:15 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:47:15.410934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafbbe5-25e9-4c48-8c07-52db795c5bdf admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:15.420291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-74e7629e-8151-434b-aac0-b4d3e78b51d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46dfe87ca5f4620a23a400adf671c9f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:15.421202 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-74e7629e-8151-434b-aac0-b4d3e78b51d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46dfe87ca5f4620a23a400adf671c9f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:15.422059 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-74e7629e-8151-434b-aac0-b4d3e78b51d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46dfe87ca5f4620a23a400adf671c9f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:15.432373 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-74e7629e-8151-434b-aac0-b4d3e78b51d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46dfe87ca5f4620a23a400adf671c9f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:15.457234 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 963/1933] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:15 2022] DELETE /identity/v3/users/e46dfe87ca5f4620a23a400adf671c9f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:47:15.461669 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f0f1a-8dad-4e4b-9eaf-f6e7c471dc80 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:15.461960 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f0f1a-8dad-4e4b-9eaf-f6e7c471dc80 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:15.462239 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f0f1a-8dad-4e4b-9eaf-f6e7c471dc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:15.487883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9e3f0f1a-8dad-4e4b-9eaf-f6e7c471dc80 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:15.489198 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9e3f0f1a-8dad-4e4b-9eaf-f6e7c471dc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:15.511110 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafbbe5-25e9-4c48-8c07-52db795c5bdf admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:15.546786 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:15.565177 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 964/1934] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:47:15.579832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f0f1a-8dad-4e4b-9eaf-f6e7c471dc80 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:15.581912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9e3f0f1a-8dad-4e4b-9eaf-f6e7c471dc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:15.629948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27430d27-80af-4b97-baaf-5bf5790ca884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:15.631351 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27430d27-80af-4b97-baaf-5bf5790ca884 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:15.631706 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27430d27-80af-4b97-baaf-5bf5790ca884 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:15.631993 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27430d27-80af-4b97-baaf-5bf5790ca884 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:15.632777 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27430d27-80af-4b97-baaf-5bf5790ca884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:15.635789 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27430d27-80af-4b97-baaf-5bf5790ca884 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:15.673974 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 971/1935] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:15 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:15.676257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27430d27-80af-4b97-baaf-5bf5790ca884 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:15.679306 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-27430d27-80af-4b97-baaf-5bf5790ca884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:15.696695 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27430d27-80af-4b97-baaf-5bf5790ca884 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:15.713610 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62355e-6b56-4dac-a74b-347573396f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:15.715667 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62355e-6b56-4dac-a74b-347573396f5d admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:15.716070 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62355e-6b56-4dac-a74b-347573396f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:15.716829 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62355e-6b56-4dac-a74b-347573396f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:15.717180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62355e-6b56-4dac-a74b-347573396f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:15.718746 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62355e-6b56-4dac-a74b-347573396f5d admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:15.744763 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 972/1936] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:15.746580 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62355e-6b56-4dac-a74b-347573396f5d admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:15.750881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f0f1a-8dad-4e4b-9eaf-f6e7c471dc80 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:15.761023 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62355e-6b56-4dac-a74b-347573396f5d admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:15.762306 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c98cb-e87d-458a-b712-54e770c31091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:15.763020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c98cb-e87d-458a-b712-54e770c31091 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:15.763282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c98cb-e87d-458a-b712-54e770c31091 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:15.763573 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c98cb-e87d-458a-b712-54e770c31091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:15.768191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472aed8b-cc3b-4ea0-b291-11019759d6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:15.768980 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aed8b-cc3b-4ea0-b291-11019759d6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:15.769406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aed8b-cc3b-4ea0-b291-11019759d6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:15.769753 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aed8b-cc3b-4ea0-b291-11019759d6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:15.770475 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472aed8b-cc3b-4ea0-b291-11019759d6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:15.773142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472aed8b-cc3b-4ea0-b291-11019759d6f5 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:15.780772 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c98cb-e87d-458a-b712-54e770c31091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:15.783313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c98cb-e87d-458a-b712-54e770c31091 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:15.788814 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 973/1937] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:15.792809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472aed8b-cc3b-4ea0-b291-11019759d6f5 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:15.817553 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472aed8b-cc3b-4ea0-b291-11019759d6f5 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:15.820901 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 965/1938] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:15.829903 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9c4c9-0405-4357-bb81-bbb836da4598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:15.830664 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9c4c9-0405-4357-bb81-bbb836da4598 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:15.831014 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9c4c9-0405-4357-bb81-bbb836da4598 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:15.831432 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9c4c9-0405-4357-bb81-bbb836da4598 admin admin] PATH_INFO: `/v3/projects/bb14e58692514ebab2c0ce85e5662808/users/7644231eb09441e98ceef239723fa09e/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:15.862584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9c4c9-0405-4357-bb81-bbb836da4598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb14e58692514ebab2c0ce85e5662808, user_id=7644231eb09441e98ceef239723fa09e, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:15.865552 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9c4c9-0405-4357-bb81-bbb836da4598 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:15.883269 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 974/1939] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:15 2022] PUT /identity/v3/projects/bb14e58692514ebab2c0ce85e5662808/users/7644231eb09441e98ceef239723fa09e/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:15.906378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d91e-e455-4868-803b-58e37dd0a55a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:15.907374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d91e-e455-4868-803b-58e37dd0a55a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:15.907796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d91e-e455-4868-803b-58e37dd0a55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:15.972505 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-5676d91e-e455-4868-803b-58e37dd0a55a None None] MFA Rules not processed for user `7644231eb09441e98ceef239723fa09e`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:15.974395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5676d91e-e455-4868-803b-58e37dd0a55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:16.084639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:16.132694 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 966/1940] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:16.137187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9c4c9-0405-4357-bb81-bbb836da4598 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:16.256892 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9c4c9-0405-4357-bb81-bbb836da4598 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:16.262239 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b182692-c885-47d8-9c4e-4023dd52ff1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:16.262836 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b182692-c885-47d8-9c4e-4023dd52ff1f admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:16.263122 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b182692-c885-47d8-9c4e-4023dd52ff1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:16.263437 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b182692-c885-47d8-9c4e-4023dd52ff1f admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:16.264438 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b182692-c885-47d8-9c4e-4023dd52ff1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:16.266815 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b182692-c885-47d8-9c4e-4023dd52ff1f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:16.313313 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 975/1941] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:16 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:16.316377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676d91e-e455-4868-803b-58e37dd0a55a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:16.346860 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676d91e-e455-4868-803b-58e37dd0a55a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:16.411675 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b182692-c885-47d8-9c4e-4023dd52ff1f admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:16.413635 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6b182692-c885-47d8-9c4e-4023dd52ff1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:16.453058 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23839b-b599-45d3-b675-979a14939265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:16.453891 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23839b-b599-45d3-b675-979a14939265 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:16.454245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23839b-b599-45d3-b675-979a14939265 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:16.454561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23839b-b599-45d3-b675-979a14939265 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:16.455350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23839b-b599-45d3-b675-979a14939265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:16.457580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23839b-b599-45d3-b675-979a14939265 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:16.498361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 967/1942] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:16 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:16.499585 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23839b-b599-45d3-b675-979a14939265 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:16.502215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:16.511807 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23839b-b599-45d3-b675-979a14939265 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:16.523531 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f162d-2c9f-430b-b6ee-93be00156fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:16.524340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f162d-2c9f-430b-b6ee-93be00156fcf admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:16.524823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f162d-2c9f-430b-b6ee-93be00156fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:16.525296 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f162d-2c9f-430b-b6ee-93be00156fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:16.527062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f162d-2c9f-430b-b6ee-93be00156fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:16.529836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f162d-2c9f-430b-b6ee-93be00156fcf admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:16.538785 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b182692-c885-47d8-9c4e-4023dd52ff1f admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:16.547662 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 968/1943] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:16.553338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f162d-2c9f-430b-b6ee-93be00156fcf admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:16.558006 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fe757-10a8-40ff-8d95-34248a6d0eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:16.558668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fe757-10a8-40ff-8d95-34248a6d0eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:16.558949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fe757-10a8-40ff-8d95-34248a6d0eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:16.560522 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fe757-10a8-40ff-8d95-34248a6d0eb4 admin admin] PATH_INFO: `/v3/projects/57036e2e717e4242ae6b13cfa4ccf973` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:16.564015 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fe757-10a8-40ff-8d95-34248a6d0eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57036e2e717e4242ae6b13cfa4ccf973)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:16.569058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fe757-10a8-40ff-8d95-34248a6d0eb4 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:16.572879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f162d-2c9f-430b-b6ee-93be00156fcf admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:16.585202 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4886e8-3547-4a5f-8c5e-280baaa08c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:16.586001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4886e8-3547-4a5f-8c5e-280baaa08c08 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:16.586511 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4886e8-3547-4a5f-8c5e-280baaa08c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:16.586855 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4886e8-3547-4a5f-8c5e-280baaa08c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:16.596456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4886e8-3547-4a5f-8c5e-280baaa08c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:16.600162 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4886e8-3547-4a5f-8c5e-280baaa08c08 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:16.635918 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 969/1944] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:16.637867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4886e8-3547-4a5f-8c5e-280baaa08c08 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:16.639317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8a4886e8-3547-4a5f-8c5e-280baaa08c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:16.656730 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4886e8-3547-4a5f-8c5e-280baaa08c08 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:16.681364 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6a3fe757-10a8-40ff-8d95-34248a6d0eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57036e2e717e4242ae6b13cfa4ccf973', 'request_id': 'req-6a3fe757-10a8-40ff-8d95-34248a6d0eb4'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:16.696700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6a3fe757-10a8-40ff-8d95-34248a6d0eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57036e2e717e4242ae6b13cfa4ccf973', 'request_id': 'req-6a3fe757-10a8-40ff-8d95-34248a6d0eb4'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:16.710659 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6a3fe757-10a8-40ff-8d95-34248a6d0eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57036e2e717e4242ae6b13cfa4ccf973', 'request_id': 'req-6a3fe757-10a8-40ff-8d95-34248a6d0eb4'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:16.754234 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6a3fe757-10a8-40ff-8d95-34248a6d0eb4 admin admin] The token cache is being invalidate because project 57036e2e717e4242ae6b13cfa4ccf973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:16.754646 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6a3fe757-10a8-40ff-8d95-34248a6d0eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:16.755729 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6a3fe757-10a8-40ff-8d95-34248a6d0eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:16.758463 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 976/1945] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:16 2022] DELETE /identity/v3/projects/57036e2e717e4242ae6b13cfa4ccf973 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:47:16.759167 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fe757-10a8-40ff-8d95-34248a6d0eb4 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:16.760722 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6a3fe757-10a8-40ff-8d95-34248a6d0eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:16.770870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775efbda-48b0-4d49-bf87-b29cb3f56395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:16.772243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775efbda-48b0-4d49-bf87-b29cb3f56395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:16.772748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775efbda-48b0-4d49-bf87-b29cb3f56395 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:16.773210 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775efbda-48b0-4d49-bf87-b29cb3f56395 admin admin] PATH_INFO: `/v3/users/9f579339d3ef4f60b40d0d86d49c8086` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:16.774756 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775efbda-48b0-4d49-bf87-b29cb3f56395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f579339d3ef4f60b40d0d86d49c8086)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:16.778443 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775efbda-48b0-4d49-bf87-b29cb3f56395 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:16.785970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fe757-10a8-40ff-8d95-34248a6d0eb4 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:16.799303 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397de44-90d9-4cae-93cb-c97d95d3a0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:16.800108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397de44-90d9-4cae-93cb-c97d95d3a0fa admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:16.800458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397de44-90d9-4cae-93cb-c97d95d3a0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:16.800825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397de44-90d9-4cae-93cb-c97d95d3a0fa admin admin] PATH_INFO: `/v3/projects/19b4c5bb3e384b16bafe43f0aecda666/users/2d22ec0cd6e6463ab86b058ec07cb9c7/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:16.835614 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397de44-90d9-4cae-93cb-c97d95d3a0fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b4c5bb3e384b16bafe43f0aecda666, user_id=2d22ec0cd6e6463ab86b058ec07cb9c7, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:16.840671 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397de44-90d9-4cae-93cb-c97d95d3a0fa admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:16.871864 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 977/1946] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:16 2022] PUT /identity/v3/projects/19b4c5bb3e384b16bafe43f0aecda666/users/2d22ec0cd6e6463ab86b058ec07cb9c7/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:16.871864 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397de44-90d9-4cae-93cb-c97d95d3a0fa admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:16.872156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-775efbda-48b0-4d49-bf87-b29cb3f56395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f579339d3ef4f60b40d0d86d49c8086'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:16.874523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-1397de44-90d9-4cae-93cb-c97d95d3a0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:16.883668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-775efbda-48b0-4d49-bf87-b29cb3f56395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f579339d3ef4f60b40d0d86d49c8086'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:16.884499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-775efbda-48b0-4d49-bf87-b29cb3f56395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f579339d3ef4f60b40d0d86d49c8086'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:16.885599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-775efbda-48b0-4d49-bf87-b29cb3f56395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f579339d3ef4f60b40d0d86d49c8086'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:16.891216 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:16.906363 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-775efbda-48b0-4d49-bf87-b29cb3f56395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f579339d3ef4f60b40d0d86d49c8086'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:16.959528 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 970/1947] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:16 2022] DELETE /identity/v3/users/9f579339d3ef4f60b40d0d86d49c8086 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:16.961691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17af5ce-b906-4157-8006-edd2710b80f9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:16.962489 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17af5ce-b906-4157-8006-edd2710b80f9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:16.962966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17af5ce-b906-4157-8006-edd2710b80f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:16.988020 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397de44-90d9-4cae-93cb-c97d95d3a0fa admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:17.025320 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d17af5ce-b906-4157-8006-edd2710b80f9 None None] MFA Rules not processed for user `2d22ec0cd6e6463ab86b058ec07cb9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:17.027453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d17af5ce-b906-4157-8006-edd2710b80f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:17.100524 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed78a02-daf6-4ec1-a3cc-4568bd9c6f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:17.102152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed78a02-daf6-4ec1-a3cc-4568bd9c6f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:17.102531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed78a02-daf6-4ec1-a3cc-4568bd9c6f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:17.102890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed78a02-daf6-4ec1-a3cc-4568bd9c6f14 admin admin] PATH_INFO: `/v3/users/3d54c2b613f84454996b6cd12739dce7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:17.104576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed78a02-daf6-4ec1-a3cc-4568bd9c6f14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d54c2b613f84454996b6cd12739dce7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:17.106811 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed78a02-daf6-4ec1-a3cc-4568bd9c6f14 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:17.118011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:17.181038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 971/1948] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:17.186574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bc830-3fab-45c9-885c-93825cfc8334 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:17.188486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bc830-3fab-45c9-885c-93825cfc8334 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:17.190028 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bc830-3fab-45c9-885c-93825cfc8334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:17.213666 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9ed78a02-daf6-4ec1-a3cc-4568bd9c6f14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d54c2b613f84454996b6cd12739dce7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:17.233327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9ed78a02-daf6-4ec1-a3cc-4568bd9c6f14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d54c2b613f84454996b6cd12739dce7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:17.235713 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9ed78a02-daf6-4ec1-a3cc-4568bd9c6f14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d54c2b613f84454996b6cd12739dce7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:17.240516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9ed78a02-daf6-4ec1-a3cc-4568bd9c6f14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d54c2b613f84454996b6cd12739dce7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:17.249228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3e5bc830-3fab-45c9-885c-93825cfc8334 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:17.250943 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3e5bc830-3fab-45c9-885c-93825cfc8334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:17.251350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9ed78a02-daf6-4ec1-a3cc-4568bd9c6f14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d54c2b613f84454996b6cd12739dce7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:17.296302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 972/1949] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:17.297553 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bc830-3fab-45c9-885c-93825cfc8334 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:17.299365 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3e5bc830-3fab-45c9-885c-93825cfc8334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:17.315824 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bc830-3fab-45c9-885c-93825cfc8334 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:17.322083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 978/1950] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:16 2022] DELETE /identity/v3/users/3d54c2b613f84454996b6cd12739dce7 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:17.327052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed78a02-daf6-4ec1-a3cc-4568bd9c6f14 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:17.327052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9ed78a02-daf6-4ec1-a3cc-4568bd9c6f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:17.410048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed78a02-daf6-4ec1-a3cc-4568bd9c6f14 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:17.418626 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0823c6-19d7-42b8-a145-595118926e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:17.420591 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0823c6-19d7-42b8-a145-595118926e70 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:17.421654 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0823c6-19d7-42b8-a145-595118926e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:17.422860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0823c6-19d7-42b8-a145-595118926e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:17.455666 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ab754-7459-4908-8195-085738acdcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:17.456923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ab754-7459-4908-8195-085738acdcec admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:17.457290 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ab754-7459-4908-8195-085738acdcec admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:17.457569 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ab754-7459-4908-8195-085738acdcec admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:17.459084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ab754-7459-4908-8195-085738acdcec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:17.461658 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ab754-7459-4908-8195-085738acdcec admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:17.538516 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 973/1951] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:17 2022] POST /identity/v3/projects => generated 377 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:17.540954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0823c6-19d7-42b8-a145-595118926e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:17.542609 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0823c6-19d7-42b8-a145-595118926e70 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:17.543263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ab754-7459-4908-8195-085738acdcec admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:17.555064 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 979/1952] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:17.685583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:17.723086 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ab754-7459-4908-8195-085738acdcec admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:17.749943 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513552c2-ce29-44f5-8c17-e0c01bba137b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:17.750708 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513552c2-ce29-44f5-8c17-e0c01bba137b admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:17.751112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513552c2-ce29-44f5-8c17-e0c01bba137b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:17.751766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513552c2-ce29-44f5-8c17-e0c01bba137b admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:17.752102 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513552c2-ce29-44f5-8c17-e0c01bba137b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:17.756313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513552c2-ce29-44f5-8c17-e0c01bba137b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:17.818206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 974/1953] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:17 2022] POST /identity/v3/users => generated 295 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:17.821945 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0823c6-19d7-42b8-a145-595118926e70 service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:17.844898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0823c6-19d7-42b8-a145-595118926e70 service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:17.853482 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb7918-5818-4b3f-8c38-511799a13e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:17.854540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb7918-5818-4b3f-8c38-511799a13e6f admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:17.855159 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb7918-5818-4b3f-8c38-511799a13e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:17.855669 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb7918-5818-4b3f-8c38-511799a13e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:17.858141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb7918-5818-4b3f-8c38-511799a13e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:17.862702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb7918-5818-4b3f-8c38-511799a13e6f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:17.883584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 980/1954] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:17.887412 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513552c2-ce29-44f5-8c17-e0c01bba137b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:17.894661 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb7918-5818-4b3f-8c38-511799a13e6f admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:17.904932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9abb7918-5818-4b3f-8c38-511799a13e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:17.905962 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513552c2-ce29-44f5-8c17-e0c01bba137b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:17.918678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcc4aa-943c-496f-b044-44310067060b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:17.919503 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcc4aa-943c-496f-b044-44310067060b admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:17.919620 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcc4aa-943c-496f-b044-44310067060b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:17.919895 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcc4aa-943c-496f-b044-44310067060b admin admin] PATH_INFO: `/v3/projects/9795c664b7214ae5a675bc09238f4439/users/38f41ced37f842acb3e7004c0c1b0e7b/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:17.923945 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb7918-5818-4b3f-8c38-511799a13e6f admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:17.934547 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0c5b2-ec54-4850-929d-0acfbcd3456e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:17.935396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0c5b2-ec54-4850-929d-0acfbcd3456e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:17.935678 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0c5b2-ec54-4850-929d-0acfbcd3456e admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:17.935954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0c5b2-ec54-4850-929d-0acfbcd3456e admin admin] PATH_INFO: `/v3/projects/a7ad4f5130654c5f8d6681bfb402e850` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:17.938311 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0c5b2-ec54-4850-929d-0acfbcd3456e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ad4f5130654c5f8d6681bfb402e850)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:17.940586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0c5b2-ec54-4850-929d-0acfbcd3456e admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:17.955429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdcc4aa-943c-496f-b044-44310067060b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9795c664b7214ae5a675bc09238f4439, user_id=38f41ced37f842acb3e7004c0c1b0e7b, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:17.958318 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdcc4aa-943c-496f-b044-44310067060b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:17.990603 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 975/1955] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:17 2022] PUT /identity/v3/projects/9795c664b7214ae5a675bc09238f4439/users/38f41ced37f842acb3e7004c0c1b0e7b/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:17.994578 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcc4aa-943c-496f-b044-44310067060b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:18.004135 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:18.056884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a3a0c5b2-ec54-4850-929d-0acfbcd3456e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ad4f5130654c5f8d6681bfb402e850', 'request_id': 'req-a3a0c5b2-ec54-4850-929d-0acfbcd3456e'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:18.074515 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a3a0c5b2-ec54-4850-929d-0acfbcd3456e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ad4f5130654c5f8d6681bfb402e850', 'request_id': 'req-a3a0c5b2-ec54-4850-929d-0acfbcd3456e'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:18.086722 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a3a0c5b2-ec54-4850-929d-0acfbcd3456e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ad4f5130654c5f8d6681bfb402e850', 'request_id': 'req-a3a0c5b2-ec54-4850-929d-0acfbcd3456e'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:18.109404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a3a0c5b2-ec54-4850-929d-0acfbcd3456e admin admin] The token cache is being invalidate because project a7ad4f5130654c5f8d6681bfb402e850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:18.110166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a3a0c5b2-ec54-4850-929d-0acfbcd3456e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:18.110871 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a3a0c5b2-ec54-4850-929d-0acfbcd3456e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:18.113776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcc4aa-943c-496f-b044-44310067060b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:18.120317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 981/1956] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:17 2022] DELETE /identity/v3/projects/a7ad4f5130654c5f8d6681bfb402e850 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:18.122429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0c5b2-ec54-4850-929d-0acfbcd3456e admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:18.124321 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a3a0c5b2-ec54-4850-929d-0acfbcd3456e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:18.248776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c1b8f-4cce-4de2-b406-cf2016e24a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:18.248776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c1b8f-4cce-4de2-b406-cf2016e24a32 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:18.248776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c1b8f-4cce-4de2-b406-cf2016e24a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:18.248776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c1b8f-4cce-4de2-b406-cf2016e24a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:18.249668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c1b8f-4cce-4de2-b406-cf2016e24a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:18.249668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c1b8f-4cce-4de2-b406-cf2016e24a32 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:18.267086 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 976/1957] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:18.271265 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082476fe-921d-4a86-a148-acbdb62dbc3b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:18.272288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082476fe-921d-4a86-a148-acbdb62dbc3b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:18.273802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082476fe-921d-4a86-a148-acbdb62dbc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:18.319138 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-082476fe-921d-4a86-a148-acbdb62dbc3b None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:18.322203 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0c5b2-ec54-4850-929d-0acfbcd3456e admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:18.323634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-082476fe-921d-4a86-a148-acbdb62dbc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:18.330249 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3503bbf-276c-442d-bbe1-20ef9f52c088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:18.331061 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3503bbf-276c-442d-bbe1-20ef9f52c088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:18.331446 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3503bbf-276c-442d-bbe1-20ef9f52c088 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:18.331880 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3503bbf-276c-442d-bbe1-20ef9f52c088 admin admin] PATH_INFO: `/v3/projects/368d8aa60f9e4ea39a0d7f9c9bb19c86` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:18.333570 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3503bbf-276c-442d-bbe1-20ef9f52c088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=368d8aa60f9e4ea39a0d7f9c9bb19c86)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:18.336848 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3503bbf-276c-442d-bbe1-20ef9f52c088 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:18.346753 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 977/1958] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:18.348024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082476fe-921d-4a86-a148-acbdb62dbc3b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:18.352064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-082476fe-921d-4a86-a148-acbdb62dbc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:18.383581 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082476fe-921d-4a86-a148-acbdb62dbc3b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:18.397224 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3752d-34b4-4dbb-b70c-c9a2c70a482c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:18.398152 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3752d-34b4-4dbb-b70c-c9a2c70a482c admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:18.398501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3752d-34b4-4dbb-b70c-c9a2c70a482c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:18.398913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3752d-34b4-4dbb-b70c-c9a2c70a482c admin admin] PATH_INFO: `/v3/projects/9795c664b7214ae5a675bc09238f4439/users/38f41ced37f842acb3e7004c0c1b0e7b/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:18.401935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3752d-34b4-4dbb-b70c-c9a2c70a482c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9795c664b7214ae5a675bc09238f4439, user_id=38f41ced37f842acb3e7004c0c1b0e7b, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:18.404783 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3752d-34b4-4dbb-b70c-c9a2c70a482c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:18.410612 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e3503bbf-276c-442d-bbe1-20ef9f52c088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '368d8aa60f9e4ea39a0d7f9c9bb19c86', 'request_id': 'req-e3503bbf-276c-442d-bbe1-20ef9f52c088'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:18.421227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 978/1959] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:18 2022] PUT /identity/v3/projects/9795c664b7214ae5a675bc09238f4439/users/38f41ced37f842acb3e7004c0c1b0e7b/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:18.422786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e198c-3ff5-4582-b2fd-5fae50e87a08 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:18.423909 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e198c-3ff5-4582-b2fd-5fae50e87a08 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:18.424255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e198c-3ff5-4582-b2fd-5fae50e87a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:18.429245 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e3503bbf-276c-442d-bbe1-20ef9f52c088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '368d8aa60f9e4ea39a0d7f9c9bb19c86', 'request_id': 'req-e3503bbf-276c-442d-bbe1-20ef9f52c088'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:18.448984 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e3503bbf-276c-442d-bbe1-20ef9f52c088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '368d8aa60f9e4ea39a0d7f9c9bb19c86', 'request_id': 'req-e3503bbf-276c-442d-bbe1-20ef9f52c088'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:18.456766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-357e198c-3ff5-4582-b2fd-5fae50e87a08 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:18.457887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-357e198c-3ff5-4582-b2fd-5fae50e87a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:18.473790 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e3503bbf-276c-442d-bbe1-20ef9f52c088 admin admin] The token cache is being invalidate because project 368d8aa60f9e4ea39a0d7f9c9bb19c86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:18.474160 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e3503bbf-276c-442d-bbe1-20ef9f52c088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:18.478784 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e3503bbf-276c-442d-bbe1-20ef9f52c088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:18.483820 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 982/1960] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:18 2022] DELETE /identity/v3/projects/368d8aa60f9e4ea39a0d7f9c9bb19c86 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:47:18.486556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e6d2e-d703-405d-8dab-12c66368534b None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:18.486935 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e6d2e-d703-405d-8dab-12c66368534b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:18.487111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e6d2e-d703-405d-8dab-12c66368534b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:18.534914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:18.571176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-fe5e6d2e-d703-405d-8dab-12c66368534b None None] MFA Rules not processed for user `38f41ced37f842acb3e7004c0c1b0e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:18.572600 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fe5e6d2e-d703-405d-8dab-12c66368534b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:18.606194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 979/1961] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:18.611082 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e198c-3ff5-4582-b2fd-5fae50e87a08 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:18.612439 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-357e198c-3ff5-4582-b2fd-5fae50e87a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:18.615133 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:18.629324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e198c-3ff5-4582-b2fd-5fae50e87a08 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:18.635040 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba8dbd-3e4c-4a23-a3ef-640bf484cc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:18.636213 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba8dbd-3e4c-4a23-a3ef-640bf484cc58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:18.636530 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba8dbd-3e4c-4a23-a3ef-640bf484cc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:18.636802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba8dbd-3e4c-4a23-a3ef-640bf484cc58 admin admin] PATH_INFO: `/v3/users/f85f286a087244afa48df6efc20af409` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:18.638333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba8dbd-3e4c-4a23-a3ef-640bf484cc58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f85f286a087244afa48df6efc20af409)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:18.640256 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba8dbd-3e4c-4a23-a3ef-640bf484cc58 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:18.694391 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 983/1962] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:18.695394 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e6d2e-d703-405d-8dab-12c66368534b None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:18.698869 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0aba8dbd-3e4c-4a23-a3ef-640bf484cc58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f85f286a087244afa48df6efc20af409'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:18.707636 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e6d2e-d703-405d-8dab-12c66368534b None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:18.709764 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0aba8dbd-3e4c-4a23-a3ef-640bf484cc58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f85f286a087244afa48df6efc20af409'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:18.710895 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0aba8dbd-3e4c-4a23-a3ef-640bf484cc58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f85f286a087244afa48df6efc20af409'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:18.712721 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb26a8a-5121-4d16-93a7-c11c5a46c69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:18.713040 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0aba8dbd-3e4c-4a23-a3ef-640bf484cc58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f85f286a087244afa48df6efc20af409'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:18.713343 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb26a8a-5121-4d16-93a7-c11c5a46c69e admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:18.713626 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb26a8a-5121-4d16-93a7-c11c5a46c69e admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:18.713969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb26a8a-5121-4d16-93a7-c11c5a46c69e admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:18.715341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb26a8a-5121-4d16-93a7-c11c5a46c69e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:18.715644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb26a8a-5121-4d16-93a7-c11c5a46c69e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:18.717301 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb26a8a-5121-4d16-93a7-c11c5a46c69e admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:18.725862 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0aba8dbd-3e4c-4a23-a3ef-640bf484cc58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f85f286a087244afa48df6efc20af409'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:18.731453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 984/1963] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:47:18.732528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb26a8a-5121-4d16-93a7-c11c5a46c69e admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:18.735466 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9fb26a8a-5121-4d16-93a7-c11c5a46c69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:18.753870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 980/1964] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:18 2022] DELETE /identity/v3/users/f85f286a087244afa48df6efc20af409 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:18.755183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba8dbd-3e4c-4a23-a3ef-640bf484cc58 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:18.757488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0aba8dbd-3e4c-4a23-a3ef-640bf484cc58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:18.840004 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb26a8a-5121-4d16-93a7-c11c5a46c69e admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:18.876142 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba8dbd-3e4c-4a23-a3ef-640bf484cc58 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:18.895537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b7571-7ab8-4d58-b425-0b675a933e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:18.896168 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b7571-7ab8-4d58-b425-0b675a933e2e admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:18.896434 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b7571-7ab8-4d58-b425-0b675a933e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:18.897477 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b7571-7ab8-4d58-b425-0b675a933e2e admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:18.898282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b7571-7ab8-4d58-b425-0b675a933e2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:18.901893 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b7571-7ab8-4d58-b425-0b675a933e2e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:18.958943 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 981/1965] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:18 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:18.962845 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b7571-7ab8-4d58-b425-0b675a933e2e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:18.963077 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b07b1-4f4a-49ec-835e-f14c060ef64b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:18.963602 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b07b1-4f4a-49ec-835e-f14c060ef64b service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:18.963874 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b07b1-4f4a-49ec-835e-f14c060ef64b service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:18.965165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b07b1-4f4a-49ec-835e-f14c060ef64b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:18.967335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fd6b07b1-4f4a-49ec-835e-f14c060ef64b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:19.004607 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:19.049817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b7571-7ab8-4d58-b425-0b675a933e2e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:19.052441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b07b1-4f4a-49ec-835e-f14c060ef64b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:19.054003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b07b1-4f4a-49ec-835e-f14c060ef64b service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:19.055349 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a826b25-7ad1-4847-a5ce-00ce768145ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:19.056034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a826b25-7ad1-4847-a5ce-00ce768145ca admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:19.056425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a826b25-7ad1-4847-a5ce-00ce768145ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:19.056713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a826b25-7ad1-4847-a5ce-00ce768145ca admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:19.057347 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a826b25-7ad1-4847-a5ce-00ce768145ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:19.060009 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a826b25-7ad1-4847-a5ce-00ce768145ca admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:19.064092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 985/1966] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:19.091642 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 982/1967] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:18 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:47:19.092854 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b07b1-4f4a-49ec-835e-f14c060ef64b service cinder] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:19.107153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b07b1-4f4a-49ec-835e-f14c060ef64b service cinder] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:19.113011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fbf8e-41ce-48c7-93d7-6ddf69f18768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:19.113621 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fbf8e-41ce-48c7-93d7-6ddf69f18768 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:19.113906 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fbf8e-41ce-48c7-93d7-6ddf69f18768 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:19.114182 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fbf8e-41ce-48c7-93d7-6ddf69f18768 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:19.114939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fbf8e-41ce-48c7-93d7-6ddf69f18768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:19.115873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a826b25-7ad1-4847-a5ce-00ce768145ca admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:19.116932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fbf8e-41ce-48c7-93d7-6ddf69f18768 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:19.117949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6a826b25-7ad1-4847-a5ce-00ce768145ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:19.134375 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 986/1968] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 10:47:19.134375 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fbf8e-41ce-48c7-93d7-6ddf69f18768 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:19.134697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0c9fbf8e-41ce-48c7-93d7-6ddf69f18768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:19.145516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:19.150522 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fbf8e-41ce-48c7-93d7-6ddf69f18768 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:19.158383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2aed01-ed95-4382-bf66-0eaac9ddbc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:19.159006 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2aed01-ed95-4382-bf66-0eaac9ddbc23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:19.159298 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2aed01-ed95-4382-bf66-0eaac9ddbc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:19.160291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2aed01-ed95-4382-bf66-0eaac9ddbc23 admin admin] PATH_INFO: `/v3/projects/bd3eb66805bb4b12bc11ba2b54801bf8` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:19.160865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2aed01-ed95-4382-bf66-0eaac9ddbc23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd3eb66805bb4b12bc11ba2b54801bf8)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:19.162769 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2aed01-ed95-4382-bf66-0eaac9ddbc23 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:19.182934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a826b25-7ad1-4847-a5ce-00ce768145ca admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:19.187017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a1271-e38b-4b1b-b787-08c1bc16226f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:19.188424 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a1271-e38b-4b1b-b787-08c1bc16226f service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:19.188742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a1271-e38b-4b1b-b787-08c1bc16226f service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:19.189018 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a1271-e38b-4b1b-b787-08c1bc16226f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:19.191012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d14a1271-e38b-4b1b-b787-08c1bc16226f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:19.215045 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9f2aed01-ed95-4382-bf66-0eaac9ddbc23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd3eb66805bb4b12bc11ba2b54801bf8', 'request_id': 'req-9f2aed01-ed95-4382-bf66-0eaac9ddbc23'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:19.223545 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9f2aed01-ed95-4382-bf66-0eaac9ddbc23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd3eb66805bb4b12bc11ba2b54801bf8', 'request_id': 'req-9f2aed01-ed95-4382-bf66-0eaac9ddbc23'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:19.232101 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9f2aed01-ed95-4382-bf66-0eaac9ddbc23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd3eb66805bb4b12bc11ba2b54801bf8', 'request_id': 'req-9f2aed01-ed95-4382-bf66-0eaac9ddbc23'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:19.251536 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9f2aed01-ed95-4382-bf66-0eaac9ddbc23 admin admin] The token cache is being invalidate because project bd3eb66805bb4b12bc11ba2b54801bf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:19.251833 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9f2aed01-ed95-4382-bf66-0eaac9ddbc23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:19.252516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9f2aed01-ed95-4382-bf66-0eaac9ddbc23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:19.254718 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 987/1969] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:19 2022] DELETE /identity/v3/projects/bd3eb66805bb4b12bc11ba2b54801bf8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:19.255676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2aed01-ed95-4382-bf66-0eaac9ddbc23 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:19.258244 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9f2aed01-ed95-4382-bf66-0eaac9ddbc23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:19.300703 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a1271-e38b-4b1b-b787-08c1bc16226f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:19.302501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a1271-e38b-4b1b-b787-08c1bc16226f service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:19.312489 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 983/1970] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:19.325263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d91493-b5ac-45ae-b16b-85979a1b3c7e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:19.325583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d91493-b5ac-45ae-b16b-85979a1b3c7e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:19.325813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d91493-b5ac-45ae-b16b-85979a1b3c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:19.357611 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-51d91493-b5ac-45ae-b16b-85979a1b3c7e None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:19.359040 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-51d91493-b5ac-45ae-b16b-85979a1b3c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:19.360270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2aed01-ed95-4382-bf66-0eaac9ddbc23 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:19.369679 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a81d3f-527f-4dee-9bcf-a0d2cc26b4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:19.369855 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 984/1971] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:19.370805 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d91493-b5ac-45ae-b16b-85979a1b3c7e None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:19.371150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a81d3f-527f-4dee-9bcf-a0d2cc26b4ae admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:19.371704 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a81d3f-527f-4dee-9bcf-a0d2cc26b4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:19.372166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a81d3f-527f-4dee-9bcf-a0d2cc26b4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:19.373141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a81d3f-527f-4dee-9bcf-a0d2cc26b4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:19.375341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a81d3f-527f-4dee-9bcf-a0d2cc26b4ae admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:19.378130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-51d91493-b5ac-45ae-b16b-85979a1b3c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:19.392083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 988/1972] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:19.393453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d91493-b5ac-45ae-b16b-85979a1b3c7e None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:19.393577 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85d9de-3e13-4f66-b061-2bc6c027d4d6 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:19.393916 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85d9de-3e13-4f66-b061-2bc6c027d4d6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:19.394328 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85d9de-3e13-4f66-b061-2bc6c027d4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:19.399113 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05802c-c812-4c78-bdfd-229ad0337b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:19.399813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05802c-c812-4c78-bdfd-229ad0337b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:19.400100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05802c-c812-4c78-bdfd-229ad0337b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:19.400393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05802c-c812-4c78-bdfd-229ad0337b22 admin admin] PATH_INFO: `/v3/users/844b80b769494dceaf3ce10da6c39bee` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:19.401568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05802c-c812-4c78-bdfd-229ad0337b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=844b80b769494dceaf3ce10da6c39bee)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:19.403523 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05802c-c812-4c78-bdfd-229ad0337b22 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:19.415299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-2f85d9de-3e13-4f66-b061-2bc6c027d4d6 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:19.417186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2f85d9de-3e13-4f66-b061-2bc6c027d4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:19.429998 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 989/1973] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:19.429998 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85d9de-3e13-4f66-b061-2bc6c027d4d6 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:19.438430 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85d9de-3e13-4f66-b061-2bc6c027d4d6 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:19.443542 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366f92d-bdd9-46ea-8e07-11966d5c0f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:19.444213 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366f92d-bdd9-46ea-8e07-11966d5c0f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:19.444514 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366f92d-bdd9-46ea-8e07-11966d5c0f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:19.444902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366f92d-bdd9-46ea-8e07-11966d5c0f4f admin admin] PATH_INFO: `/v3/projects/656f2f597c524752a41d41de94a5b0f8/users/88b533e1338c4f53a1d2da5281e98542/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:19.460864 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ea05802c-c812-4c78-bdfd-229ad0337b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '844b80b769494dceaf3ce10da6c39bee'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:19.462243 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366f92d-bdd9-46ea-8e07-11966d5c0f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=656f2f597c524752a41d41de94a5b0f8, user_id=88b533e1338c4f53a1d2da5281e98542, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:19.465332 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366f92d-bdd9-46ea-8e07-11966d5c0f4f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:19.471750 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ea05802c-c812-4c78-bdfd-229ad0337b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '844b80b769494dceaf3ce10da6c39bee'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:19.472406 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ea05802c-c812-4c78-bdfd-229ad0337b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '844b80b769494dceaf3ce10da6c39bee'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:19.473229 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ea05802c-c812-4c78-bdfd-229ad0337b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '844b80b769494dceaf3ce10da6c39bee'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:19.481221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:19.481964 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 990/1974] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:19 2022] PUT /identity/v3/projects/656f2f597c524752a41d41de94a5b0f8/users/88b533e1338c4f53a1d2da5281e98542/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:19.483337 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366f92d-bdd9-46ea-8e07-11966d5c0f4f admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:19.485092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2366f92d-bdd9-46ea-8e07-11966d5c0f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:19.494085 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ea05802c-c812-4c78-bdfd-229ad0337b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '844b80b769494dceaf3ce10da6c39bee'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:19.519616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 985/1975] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:19 2022] DELETE /identity/v3/users/844b80b769494dceaf3ce10da6c39bee => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:19.523794 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca6012-4a65-4c8e-b7a4-bc5e16ce574c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:19.524378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca6012-4a65-4c8e-b7a4-bc5e16ce574c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:19.524688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca6012-4a65-4c8e-b7a4-bc5e16ce574c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:19.548748 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:19.567404 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-edca6012-4a65-4c8e-b7a4-bc5e16ce574c None None] MFA Rules not processed for user `88b533e1338c4f53a1d2da5281e98542`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:19.574267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-edca6012-4a65-4c8e-b7a4-bc5e16ce574c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:19.576022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366f92d-bdd9-46ea-8e07-11966d5c0f4f admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:19.696055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d1cd4-fe41-4d70-b3fd-44177e743952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:19.696055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d1cd4-fe41-4d70-b3fd-44177e743952 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:19.696055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d1cd4-fe41-4d70-b3fd-44177e743952 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:19.696055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d1cd4-fe41-4d70-b3fd-44177e743952 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:19.696448 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d1cd4-fe41-4d70-b3fd-44177e743952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:19.696448 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d1cd4-fe41-4d70-b3fd-44177e743952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:19.696448 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d1cd4-fe41-4d70-b3fd-44177e743952 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:19.700257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 986/1976] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:19.701773 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6b37a-d036-4ebd-a1e3-bdaead4da7f6 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:19.702515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6b37a-d036-4ebd-a1e3-bdaead4da7f6 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:19.703006 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6b37a-d036-4ebd-a1e3-bdaead4da7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:19.725166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 991/1977] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:47:19.735285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2bb6b37a-d036-4ebd-a1e3-bdaead4da7f6 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:19.736761 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2bb6b37a-d036-4ebd-a1e3-bdaead4da7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:19.742728 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d1cd4-fe41-4d70-b3fd-44177e743952 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:19.744938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-181d1cd4-fe41-4d70-b3fd-44177e743952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:19.750841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 987/1978] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:19.751940 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6b37a-d036-4ebd-a1e3-bdaead4da7f6 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:19.768308 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6b37a-d036-4ebd-a1e3-bdaead4da7f6 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:19.773259 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d1cd4-fe41-4d70-b3fd-44177e743952 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:19.773977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0946a6f-6fe7-464d-a704-f83dba1623a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:19.774622 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0946a6f-6fe7-464d-a704-f83dba1623a0 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:19.774902 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0946a6f-6fe7-464d-a704-f83dba1623a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:19.775173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0946a6f-6fe7-464d-a704-f83dba1623a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:19.775834 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0946a6f-6fe7-464d-a704-f83dba1623a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:19.777771 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0946a6f-6fe7-464d-a704-f83dba1623a0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:19.792763 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08f7b9-6795-4d37-be3d-a5d50d536dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:19.793299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08f7b9-6795-4d37-be3d-a5d50d536dbf admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:19.793735 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08f7b9-6795-4d37-be3d-a5d50d536dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:19.794145 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08f7b9-6795-4d37-be3d-a5d50d536dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:19.796823 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08f7b9-6795-4d37-be3d-a5d50d536dbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:19.799774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08f7b9-6795-4d37-be3d-a5d50d536dbf admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:19.833831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 988/1979] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:19 2022] POST /identity/v3/projects => generated 399 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:19.833831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0946a6f-6fe7-464d-a704-f83dba1623a0 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:19.833831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b0946a6f-6fe7-464d-a704-f83dba1623a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:19.860280 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 992/1980] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:19 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:19.862572 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08f7b9-6795-4d37-be3d-a5d50d536dbf admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:19.923671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0946a6f-6fe7-464d-a704-f83dba1623a0 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:20.002310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08f7b9-6795-4d37-be3d-a5d50d536dbf admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:20.024268 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2c849-9e46-43f7-ae4f-965e64c573b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:20.024728 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bed530-e2a8-4342-a568-501593c3ee8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:20.024989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2c849-9e46-43f7-ae4f-965e64c573b4 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:20.025286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2c849-9e46-43f7-ae4f-965e64c573b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:20.025556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2c849-9e46-43f7-ae4f-965e64c573b4 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:20.026113 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bed530-e2a8-4342-a568-501593c3ee8d service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:20.026521 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2c849-9e46-43f7-ae4f-965e64c573b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:20.026729 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bed530-e2a8-4342-a568-501593c3ee8d service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:20.027425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bed530-e2a8-4342-a568-501593c3ee8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:20.029434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2c849-9e46-43f7-ae4f-965e64c573b4 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:20.050628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bed530-e2a8-4342-a568-501593c3ee8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:20.052827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bed530-e2a8-4342-a568-501593c3ee8d service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:20.060099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:20.074687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 993/1981] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:19 2022] POST /identity/v3/users => generated 300 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:20.077605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 989/1982] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:20.078413 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2c849-9e46-43f7-ae4f-965e64c573b4 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:20.081053 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bed530-e2a8-4342-a568-501593c3ee8d service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:20.104410 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2c849-9e46-43f7-ae4f-965e64c573b4 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:20.106809 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bed530-e2a8-4342-a568-501593c3ee8d service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:20.117383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b349a-367d-439d-9ae9-64ed109dce56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:20.118364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0557976-0fb0-4e7d-9da1-8648acf74325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:20.119029 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0557976-0fb0-4e7d-9da1-8648acf74325 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:20.119349 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0557976-0fb0-4e7d-9da1-8648acf74325 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:20.120338 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b349a-367d-439d-9ae9-64ed109dce56 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:20.120685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0557976-0fb0-4e7d-9da1-8648acf74325 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:20.121373 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0557976-0fb0-4e7d-9da1-8648acf74325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:20.121996 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b349a-367d-439d-9ae9-64ed109dce56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:20.123096 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b349a-367d-439d-9ae9-64ed109dce56 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:20.125224 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b349a-367d-439d-9ae9-64ed109dce56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:20.126575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0557976-0fb0-4e7d-9da1-8648acf74325 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:20.130643 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b349a-367d-439d-9ae9-64ed109dce56 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:20.148951 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 990/1983] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:20.153147 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0557976-0fb0-4e7d-9da1-8648acf74325 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:20.185826 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 994/1984] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:20 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:20.186022 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0557976-0fb0-4e7d-9da1-8648acf74325 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:20.187596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b349a-367d-439d-9ae9-64ed109dce56 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:20.198613 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b349a-367d-439d-9ae9-64ed109dce56 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:20.200044 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fd2dd-c7bf-4e30-8ee8-4b92d21743d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:20.202388 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fd2dd-c7bf-4e30-8ee8-4b92d21743d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:20.202712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fd2dd-c7bf-4e30-8ee8-4b92d21743d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:20.202999 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fd2dd-c7bf-4e30-8ee8-4b92d21743d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:20.204222 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fd2dd-c7bf-4e30-8ee8-4b92d21743d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:20.206959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ffd69-62d4-4ab3-b19e-dbab09fd5856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:20.207751 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ffd69-62d4-4ab3-b19e-dbab09fd5856 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:20.207969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fd2dd-c7bf-4e30-8ee8-4b92d21743d4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:20.208183 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ffd69-62d4-4ab3-b19e-dbab09fd5856 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:20.208626 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ffd69-62d4-4ab3-b19e-dbab09fd5856 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:20.209464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ffd69-62d4-4ab3-b19e-dbab09fd5856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:20.211424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ffd69-62d4-4ab3-b19e-dbab09fd5856 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:20.224912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 995/1985] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:20.232139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ffd69-62d4-4ab3-b19e-dbab09fd5856 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:20.233629 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 991/1986] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:20.238882 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fd2dd-c7bf-4e30-8ee8-4b92d21743d4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:20.266997 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fd2dd-c7bf-4e30-8ee8-4b92d21743d4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:20.279979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ffd69-62d4-4ab3-b19e-dbab09fd5856 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:20.280842 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bee0a-5cd5-48b6-bec6-221191460b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:20.281979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bee0a-5cd5-48b6-bec6-221191460b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:20.282352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bee0a-5cd5-48b6-bec6-221191460b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:20.282748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bee0a-5cd5-48b6-bec6-221191460b23 admin admin] PATH_INFO: `/v3/projects/201789c0a1ab4cd49d32a95d885a5dde/users/4f9900a5a6ad49c19639f5be645f7b23/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:20.292995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863db70-ad52-488d-9b89-35ae20b5b25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:20.293855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863db70-ad52-488d-9b89-35ae20b5b25d admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:20.294296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863db70-ad52-488d-9b89-35ae20b5b25d admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:20.296819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863db70-ad52-488d-9b89-35ae20b5b25d admin admin] PATH_INFO: `/v3/projects/cbd453e85dcd4515a131adf80c6852cb/users/114a6522164c49d4997278eeb10ff354/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:20.309225 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bee0a-5cd5-48b6-bec6-221191460b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=201789c0a1ab4cd49d32a95d885a5dde, user_id=4f9900a5a6ad49c19639f5be645f7b23, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:20.313925 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bee0a-5cd5-48b6-bec6-221191460b23 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:20.350577 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 992/1987] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:20 2022] PUT /identity/v3/projects/201789c0a1ab4cd49d32a95d885a5dde/users/4f9900a5a6ad49c19639f5be645f7b23/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:20.365067 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b03a1-04c6-4021-a13a-7b41133e4e65 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:20.365727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b03a1-04c6-4021-a13a-7b41133e4e65 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:20.366638 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b03a1-04c6-4021-a13a-7b41133e4e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:20.370102 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863db70-ad52-488d-9b89-35ae20b5b25d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd453e85dcd4515a131adf80c6852cb, user_id=114a6522164c49d4997278eeb10ff354, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:20.388274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863db70-ad52-488d-9b89-35ae20b5b25d admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:20.410021 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 996/1988] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:20 2022] PUT /identity/v3/projects/cbd453e85dcd4515a131adf80c6852cb/users/114a6522164c49d4997278eeb10ff354/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:20.414192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863db70-ad52-488d-9b89-35ae20b5b25d admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:20.430498 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:20.436375 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c93b03a1-04c6-4021-a13a-7b41133e4e65 None None] MFA Rules not processed for user `4f9900a5a6ad49c19639f5be645f7b23`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:20.439479 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c93b03a1-04c6-4021-a13a-7b41133e4e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:20.521585 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863db70-ad52-488d-9b89-35ae20b5b25d admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:20.527492 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd471538-6c13-47c8-8965-0c760b30a677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:20.528820 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd471538-6c13-47c8-8965-0c760b30a677 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:20.529826 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd471538-6c13-47c8-8965-0c760b30a677 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:20.530427 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd471538-6c13-47c8-8965-0c760b30a677 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:20.531958 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd471538-6c13-47c8-8965-0c760b30a677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:20.534177 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd471538-6c13-47c8-8965-0c760b30a677 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:20.552593 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 997/1989] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:20.555727 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd471538-6c13-47c8-8965-0c760b30a677 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:20.574150 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 993/1990] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:20 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:20.574800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd471538-6c13-47c8-8965-0c760b30a677 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:20.575958 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b03a1-04c6-4021-a13a-7b41133e4e65 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:20.589379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b690b90-ccd0-47c2-8a63-2d7e833f0ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:20.590066 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b690b90-ccd0-47c2-8a63-2d7e833f0ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:20.590352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b690b90-ccd0-47c2-8a63-2d7e833f0ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:20.590624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b690b90-ccd0-47c2-8a63-2d7e833f0ddb admin admin] PATH_INFO: `/v3/projects/cbd453e85dcd4515a131adf80c6852cb/users/114a6522164c49d4997278eeb10ff354/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:20.593723 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b690b90-ccd0-47c2-8a63-2d7e833f0ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd453e85dcd4515a131adf80c6852cb, user_id=114a6522164c49d4997278eeb10ff354, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:20.595271 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b03a1-04c6-4021-a13a-7b41133e4e65 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:20.598419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b690b90-ccd0-47c2-8a63-2d7e833f0ddb admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:20.602097 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771defc-8848-4f4b-b9ca-61a6c4bce71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:20.602735 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771defc-8848-4f4b-b9ca-61a6c4bce71c admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:20.603042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771defc-8848-4f4b-b9ca-61a6c4bce71c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:20.603304 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771defc-8848-4f4b-b9ca-61a6c4bce71c admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:20.603950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771defc-8848-4f4b-b9ca-61a6c4bce71c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:20.606617 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771defc-8848-4f4b-b9ca-61a6c4bce71c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:20.632381 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 998/1991] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:20 2022] PUT /identity/v3/projects/cbd453e85dcd4515a131adf80c6852cb/users/114a6522164c49d4997278eeb10ff354/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:20.634938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa4b87-6aba-4401-ab67-56dc478d063c None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:20.635162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa4b87-6aba-4401-ab67-56dc478d063c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:20.635445 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa4b87-6aba-4401-ab67-56dc478d063c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:20.675555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-f2aa4b87-6aba-4401-ab67-56dc478d063c None None] MFA Rules not processed for user `114a6522164c49d4997278eeb10ff354`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:20.676805 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f2aa4b87-6aba-4401-ab67-56dc478d063c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:20.677372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 994/1992] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:20 2022] POST /identity/v3/projects => generated 401 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:47:20.678217 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771defc-8848-4f4b-b9ca-61a6c4bce71c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:20.680071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1771defc-8848-4f4b-b9ca-61a6c4bce71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:20.791330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771defc-8848-4f4b-b9ca-61a6c4bce71c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:20.798368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4496c-dc5c-478c-ac1b-3f5cc0061871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:20.800880 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4496c-dc5c-478c-ac1b-3f5cc0061871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:20.801173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4496c-dc5c-478c-ac1b-3f5cc0061871 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:20.801490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4496c-dc5c-478c-ac1b-3f5cc0061871 admin admin] PATH_INFO: `/v3/projects/2e9fab16579a421ab162c2c30797e071` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:20.802729 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4496c-dc5c-478c-ac1b-3f5cc0061871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e9fab16579a421ab162c2c30797e071)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:20.804697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4496c-dc5c-478c-ac1b-3f5cc0061871 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:20.815253 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 999/1993] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:20 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:20.816097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa4b87-6aba-4401-ab67-56dc478d063c None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:20.831012 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa4b87-6aba-4401-ab67-56dc478d063c None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:20.836169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a07fa5-22db-480d-9cab-3881297ef74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:20.836678 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a07fa5-22db-480d-9cab-3881297ef74d admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:20.836966 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a07fa5-22db-480d-9cab-3881297ef74d admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:20.837244 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a07fa5-22db-480d-9cab-3881297ef74d admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:20.837941 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a07fa5-22db-480d-9cab-3881297ef74d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:20.840288 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a07fa5-22db-480d-9cab-3881297ef74d admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:20.847602 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:20.868525 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1000/1994] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:20 2022] POST /identity/v3/users => generated 307 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:20.868525 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a07fa5-22db-480d-9cab-3881297ef74d admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:20.868525 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e9a07fa5-22db-480d-9cab-3881297ef74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:20.885413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-eee4496c-dc5c-478c-ac1b-3f5cc0061871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e9fab16579a421ab162c2c30797e071', 'request_id': 'req-eee4496c-dc5c-478c-ac1b-3f5cc0061871'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:20.901728 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-eee4496c-dc5c-478c-ac1b-3f5cc0061871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e9fab16579a421ab162c2c30797e071', 'request_id': 'req-eee4496c-dc5c-478c-ac1b-3f5cc0061871'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:20.913018 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-eee4496c-dc5c-478c-ac1b-3f5cc0061871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e9fab16579a421ab162c2c30797e071', 'request_id': 'req-eee4496c-dc5c-478c-ac1b-3f5cc0061871'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:20.926976 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-eee4496c-dc5c-478c-ac1b-3f5cc0061871 admin admin] The token cache is being invalidate because project 2e9fab16579a421ab162c2c30797e071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:20.927488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-eee4496c-dc5c-478c-ac1b-3f5cc0061871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:20.928565 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-eee4496c-dc5c-478c-ac1b-3f5cc0061871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:20.930916 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 995/1995] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:20 2022] DELETE /identity/v3/projects/2e9fab16579a421ab162c2c30797e071 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:20.931937 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4496c-dc5c-478c-ac1b-3f5cc0061871 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:20.933511 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-eee4496c-dc5c-478c-ac1b-3f5cc0061871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:20.952140 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a07fa5-22db-480d-9cab-3881297ef74d admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:20.978460 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:21.042653 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4496c-dc5c-478c-ac1b-3f5cc0061871 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:21.054154 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83108a-479b-4bdd-af05-e763fa664601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:21.054659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83108a-479b-4bdd-af05-e763fa664601 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:21.054936 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83108a-479b-4bdd-af05-e763fa664601 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:21.055201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83108a-479b-4bdd-af05-e763fa664601 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:21.055849 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83108a-479b-4bdd-af05-e763fa664601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:21.057612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83108a-479b-4bdd-af05-e763fa664601 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:21.063750 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974e289-1fab-4ce2-bfac-88687929e7d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:21.064891 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974e289-1fab-4ce2-bfac-88687929e7d0 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:21.065440 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974e289-1fab-4ce2-bfac-88687929e7d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:21.066018 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974e289-1fab-4ce2-bfac-88687929e7d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:21.069090 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3974e289-1fab-4ce2-bfac-88687929e7d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:21.071198 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 996/1996] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:21.075633 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83108a-479b-4bdd-af05-e763fa664601 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:21.077447 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7c83108a-479b-4bdd-af05-e763fa664601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:21.095934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83108a-479b-4bdd-af05-e763fa664601 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:21.114625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b34d6-5cca-4a14-acdc-b4ed26b79096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:21.115373 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b34d6-5cca-4a14-acdc-b4ed26b79096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:21.115669 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b34d6-5cca-4a14-acdc-b4ed26b79096 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:21.115935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b34d6-5cca-4a14-acdc-b4ed26b79096 admin admin] PATH_INFO: `/v3/users/2b3476491b1f4e4ab1edc3eba33b0cf4` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:21.117216 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b34d6-5cca-4a14-acdc-b4ed26b79096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3476491b1f4e4ab1edc3eba33b0cf4)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:21.119771 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b34d6-5cca-4a14-acdc-b4ed26b79096 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:21.153804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974e289-1fab-4ce2-bfac-88687929e7d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:21.156039 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974e289-1fab-4ce2-bfac-88687929e7d0 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:21.173695 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1001/1997] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:21.173695 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974e289-1fab-4ce2-bfac-88687929e7d0 service cinder] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:21.200123 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4b3b34d6-5cca-4a14-acdc-b4ed26b79096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3476491b1f4e4ab1edc3eba33b0cf4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:21.201099 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974e289-1fab-4ce2-bfac-88687929e7d0 service cinder] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:21.209240 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8c5fc-0e53-49c8-82dd-1987af1de125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:21.209971 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8c5fc-0e53-49c8-82dd-1987af1de125 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:21.210733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8c5fc-0e53-49c8-82dd-1987af1de125 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:21.211013 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8c5fc-0e53-49c8-82dd-1987af1de125 admin admin] PATH_INFO: `/v3/projects/b4016d5a23244720ae08025ee8984b0b/users/bc0f41db0a4245c8bf4a941cf6ec562c/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:21.211555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4b3b34d6-5cca-4a14-acdc-b4ed26b79096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3476491b1f4e4ab1edc3eba33b0cf4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:21.212395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4b3b34d6-5cca-4a14-acdc-b4ed26b79096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3476491b1f4e4ab1edc3eba33b0cf4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:21.213477 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4b3b34d6-5cca-4a14-acdc-b4ed26b79096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3476491b1f4e4ab1edc3eba33b0cf4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:21.228020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4b3b34d6-5cca-4a14-acdc-b4ed26b79096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3476491b1f4e4ab1edc3eba33b0cf4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:21.234360 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8c5fc-0e53-49c8-82dd-1987af1de125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4016d5a23244720ae08025ee8984b0b, user_id=bc0f41db0a4245c8bf4a941cf6ec562c, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:21.239967 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8c5fc-0e53-49c8-82dd-1987af1de125 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:21.261375 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 997/1998] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:21 2022] DELETE /identity/v3/users/2b3476491b1f4e4ab1edc3eba33b0cf4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:21.261599 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1002/1999] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:21 2022] PUT /identity/v3/projects/b4016d5a23244720ae08025ee8984b0b/users/bc0f41db0a4245c8bf4a941cf6ec562c/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:21.264473 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b34d6-5cca-4a14-acdc-b4ed26b79096 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:21.266236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4b3b34d6-5cca-4a14-acdc-b4ed26b79096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:21.292804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:21.382169 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b34d6-5cca-4a14-acdc-b4ed26b79096 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:21.390781 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02720b49-880e-48ac-b220-ee518139ed8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:21.392071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02720b49-880e-48ac-b220-ee518139ed8d admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:21.392580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02720b49-880e-48ac-b220-ee518139ed8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:21.392849 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02720b49-880e-48ac-b220-ee518139ed8d admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:21.393619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02720b49-880e-48ac-b220-ee518139ed8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:21.395531 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02720b49-880e-48ac-b220-ee518139ed8d admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:21.408068 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 998/2000] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:21.411969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8c5fc-0e53-49c8-82dd-1987af1de125 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:21.528778 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8c5fc-0e53-49c8-82dd-1987af1de125 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:21.534733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab94a34-213e-4461-ab08-b1407077b9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:21.536112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab94a34-213e-4461-ab08-b1407077b9f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:21.536573 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab94a34-213e-4461-ab08-b1407077b9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:21.537780 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab94a34-213e-4461-ab08-b1407077b9f6 admin admin] PATH_INFO: `/v3/projects/b4016d5a23244720ae08025ee8984b0b/users/bc0f41db0a4245c8bf4a941cf6ec562c/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:21.540227 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab94a34-213e-4461-ab08-b1407077b9f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4016d5a23244720ae08025ee8984b0b, user_id=bc0f41db0a4245c8bf4a941cf6ec562c, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:21.544831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab94a34-213e-4461-ab08-b1407077b9f6 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:21.574359 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1003/2001] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:21 2022] PUT /identity/v3/projects/b4016d5a23244720ae08025ee8984b0b/users/bc0f41db0a4245c8bf4a941cf6ec562c/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:21.577668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd985f2-4ee5-48a0-bc62-cd2281af51ab None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:21.578226 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd985f2-4ee5-48a0-bc62-cd2281af51ab None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:21.579009 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd985f2-4ee5-48a0-bc62-cd2281af51ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:21.658892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ebd985f2-4ee5-48a0-bc62-cd2281af51ab None None] MFA Rules not processed for user `bc0f41db0a4245c8bf4a941cf6ec562c`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:21.661686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ebd985f2-4ee5-48a0-bc62-cd2281af51ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:21.771813 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab94a34-213e-4461-ab08-b1407077b9f6 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:21.773979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3ab94a34-213e-4461-ab08-b1407077b9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:21.828336 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 999/2002] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:21 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:21.850807 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:21.889326 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab94a34-213e-4461-ab08-b1407077b9f6 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:21.896093 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb7c36-d3e8-433e-9c38-85eb7e444101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:21.897171 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb7c36-d3e8-433e-9c38-85eb7e444101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:21.897171 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb7c36-d3e8-433e-9c38-85eb7e444101 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:21.897411 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb7c36-d3e8-433e-9c38-85eb7e444101 admin admin] PATH_INFO: `/v3/projects/3b759c22ce444f4fb00f7a8243a2f166` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:21.898575 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb7c36-d3e8-433e-9c38-85eb7e444101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b759c22ce444f4fb00f7a8243a2f166)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:21.900778 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb7c36-d3e8-433e-9c38-85eb7e444101 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:21.918872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd985f2-4ee5-48a0-bc62-cd2281af51ab None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:21.920369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ebd985f2-4ee5-48a0-bc62-cd2281af51ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:21.967637 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3cfb7c36-d3e8-433e-9c38-85eb7e444101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b759c22ce444f4fb00f7a8243a2f166', 'request_id': 'req-3cfb7c36-d3e8-433e-9c38-85eb7e444101'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:21.975736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3cfb7c36-d3e8-433e-9c38-85eb7e444101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b759c22ce444f4fb00f7a8243a2f166', 'request_id': 'req-3cfb7c36-d3e8-433e-9c38-85eb7e444101'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:21.984257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3cfb7c36-d3e8-433e-9c38-85eb7e444101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b759c22ce444f4fb00f7a8243a2f166', 'request_id': 'req-3cfb7c36-d3e8-433e-9c38-85eb7e444101'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:21.997724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd985f2-4ee5-48a0-bc62-cd2281af51ab None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:22.003957 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3cfb7c36-d3e8-433e-9c38-85eb7e444101 admin admin] The token cache is being invalidate because project 3b759c22ce444f4fb00f7a8243a2f166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:22.004455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3cfb7c36-d3e8-433e-9c38-85eb7e444101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:22.005213 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3cfb7c36-d3e8-433e-9c38-85eb7e444101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:22.006847 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1004/2003] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:21 2022] DELETE /identity/v3/projects/3b759c22ce444f4fb00f7a8243a2f166 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:22.010858 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb7c36-d3e8-433e-9c38-85eb7e444101 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:22.012735 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3cfb7c36-d3e8-433e-9c38-85eb7e444101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:22.067420 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6e7d3-1186-4152-8b9f-93ed42a6ba9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:22.068463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6e7d3-1186-4152-8b9f-93ed42a6ba9a service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:22.069152 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6e7d3-1186-4152-8b9f-93ed42a6ba9a service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:22.069617 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6e7d3-1186-4152-8b9f-93ed42a6ba9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:22.071950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bbc6e7d3-1186-4152-8b9f-93ed42a6ba9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:22.091566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:22.118710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb7c36-d3e8-433e-9c38-85eb7e444101 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:22.125941 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41221d1-34da-4afe-9d91-0aee489de81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:22.126593 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41221d1-34da-4afe-9d91-0aee489de81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:22.126878 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41221d1-34da-4afe-9d91-0aee489de81f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:22.127155 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41221d1-34da-4afe-9d91-0aee489de81f admin admin] PATH_INFO: `/v3/users/939beab5464e492089e70eac961d2eb9` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:22.128308 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41221d1-34da-4afe-9d91-0aee489de81f admin admin] RBAC: Authorizing `identity:delete_user(user_id=939beab5464e492089e70eac961d2eb9)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:22.130802 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41221d1-34da-4afe-9d91-0aee489de81f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:22.184507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6e7d3-1186-4152-8b9f-93ed42a6ba9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:22.187051 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6e7d3-1186-4152-8b9f-93ed42a6ba9a service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:22.198822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1000/2004] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:21 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 10:47:22.199749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6e7d3-1186-4152-8b9f-93ed42a6ba9a service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:22.201587 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bbc6e7d3-1186-4152-8b9f-93ed42a6ba9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:22.214850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d41221d1-34da-4afe-9d91-0aee489de81f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '939beab5464e492089e70eac961d2eb9'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:22.223305 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d41221d1-34da-4afe-9d91-0aee489de81f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '939beab5464e492089e70eac961d2eb9'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:22.224263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d41221d1-34da-4afe-9d91-0aee489de81f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '939beab5464e492089e70eac961d2eb9'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:22.225021 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d41221d1-34da-4afe-9d91-0aee489de81f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '939beab5464e492089e70eac961d2eb9'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:22.234205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d41221d1-34da-4afe-9d91-0aee489de81f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '939beab5464e492089e70eac961d2eb9'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:22.240801 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:22.262424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1005/2005] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:22 2022] DELETE /identity/v3/users/939beab5464e492089e70eac961d2eb9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:22.292490 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41221d1-34da-4afe-9d91-0aee489de81f admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:22.293932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d41221d1-34da-4afe-9d91-0aee489de81f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:22.312723 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6e7d3-1186-4152-8b9f-93ed42a6ba9a service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:22.370821 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41221d1-34da-4afe-9d91-0aee489de81f admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:22.375717 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36621c-a3e8-42ac-b179-4dc2ad4e9bde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:22.376339 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36621c-a3e8-42ac-b179-4dc2ad4e9bde service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:22.376696 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36621c-a3e8-42ac-b179-4dc2ad4e9bde service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:22.376970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36621c-a3e8-42ac-b179-4dc2ad4e9bde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:22.379259 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fa36621c-a3e8-42ac-b179-4dc2ad4e9bde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:22.394600 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29a5db-b267-45f6-8b71-fc0eb097b25f tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '114a6522164c49d4997278eeb10ff354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbd453e85dcd4515a131adf80c6852cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:22.396018 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29a5db-b267-45f6-8b71-fc0eb097b25f tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:22.396296 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29a5db-b267-45f6-8b71-fc0eb097b25f tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:22.396591 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29a5db-b267-45f6-8b71-fc0eb097b25f tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:22.397251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29a5db-b267-45f6-8b71-fc0eb097b25f tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:22.397553 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29a5db-b267-45f6-8b71-fc0eb097b25f tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:22.399251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29a5db-b267-45f6-8b71-fc0eb097b25f tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:22.416494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1001/2006] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:47:22.420372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29a5db-b267-45f6-8b71-fc0eb097b25f tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:22.422538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ac29a5db-b267-45f6-8b71-fc0eb097b25f tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:22.435821 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29a5db-b267-45f6-8b71-fc0eb097b25f tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:22.443616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1fcb0-a332-446d-a53b-545cb54178d9 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '114a6522164c49d4997278eeb10ff354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbd453e85dcd4515a131adf80c6852cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:22.444887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1fcb0-a332-446d-a53b-545cb54178d9 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:22.445295 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1fcb0-a332-446d-a53b-545cb54178d9 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:22.445570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1fcb0-a332-446d-a53b-545cb54178d9 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:22.446345 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1fcb0-a332-446d-a53b-545cb54178d9 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:22.460722 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1fcb0-a332-446d-a53b-545cb54178d9 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:22.467906 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36621c-a3e8-42ac-b179-4dc2ad4e9bde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:22.470650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36621c-a3e8-42ac-b179-4dc2ad4e9bde service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:22.482099 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1006/2007] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:22 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 10:47:22.496812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1002/2008] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:22 2022] POST /identity/v3/projects => generated 355 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:47:22.500678 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36621c-a3e8-42ac-b179-4dc2ad4e9bde service cinder] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:22.511772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36621c-a3e8-42ac-b179-4dc2ad4e9bde service cinder] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:22.614555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052b172-c461-4fe7-b6fe-289ad2ee2197 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '114a6522164c49d4997278eeb10ff354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbd453e85dcd4515a131adf80c6852cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:22.615338 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052b172-c461-4fe7-b6fe-289ad2ee2197 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:22.615623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052b172-c461-4fe7-b6fe-289ad2ee2197 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:22.615896 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052b172-c461-4fe7-b6fe-289ad2ee2197 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:22.616579 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052b172-c461-4fe7-b6fe-289ad2ee2197 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:22.616875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052b172-c461-4fe7-b6fe-289ad2ee2197 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:22.618487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052b172-c461-4fe7-b6fe-289ad2ee2197 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:22.646577 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1007/2009] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:47:22.731698 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052b172-c461-4fe7-b6fe-289ad2ee2197 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:22.732830 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1fcb0-a332-446d-a53b-545cb54178d9 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:22.736748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e5a1fcb0-a332-446d-a53b-545cb54178d9 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:22.748348 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052b172-c461-4fe7-b6fe-289ad2ee2197 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:22.762883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a575fcc-b686-4ee0-895a-18f6d3854e62 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '114a6522164c49d4997278eeb10ff354', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbd453e85dcd4515a131adf80c6852cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:22.764571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a575fcc-b686-4ee0-895a-18f6d3854e62 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:22.764885 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a575fcc-b686-4ee0-895a-18f6d3854e62 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:22.765166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a575fcc-b686-4ee0-895a-18f6d3854e62 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] PATH_INFO: `/v3/projects/0f5643297351472a942466b5d0b088a5` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:22.767634 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a575fcc-b686-4ee0-895a-18f6d3854e62 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f5643297351472a942466b5d0b088a5)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:22.769821 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a575fcc-b686-4ee0-895a-18f6d3854e62 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:22.836964 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:22.843454 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:22.872527 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3a575fcc-b686-4ee0-895a-18f6d3854e62 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f5643297351472a942466b5d0b088a5', 'request_id': 'req-3a575fcc-b686-4ee0-895a-18f6d3854e62'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:22.882479 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3a575fcc-b686-4ee0-895a-18f6d3854e62 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f5643297351472a942466b5d0b088a5', 'request_id': 'req-3a575fcc-b686-4ee0-895a-18f6d3854e62'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:22.895956 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3a575fcc-b686-4ee0-895a-18f6d3854e62 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f5643297351472a942466b5d0b088a5', 'request_id': 'req-3a575fcc-b686-4ee0-895a-18f6d3854e62'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:22.912461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3a575fcc-b686-4ee0-895a-18f6d3854e62 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] The token cache is being invalidate because project 0f5643297351472a942466b5d0b088a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:22.912790 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3a575fcc-b686-4ee0-895a-18f6d3854e62 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:22.913650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3a575fcc-b686-4ee0-895a-18f6d3854e62 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:22.915127 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1008/2010] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:22 2022] DELETE /identity/v3/projects/0f5643297351472a942466b5d0b088a5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:22.918823 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a575fcc-b686-4ee0-895a-18f6d3854e62 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:22.918823 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3a575fcc-b686-4ee0-895a-18f6d3854e62 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:22.944657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1fcb0-a332-446d-a53b-545cb54178d9 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:23.077527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed7499-b4d0-4d3b-97af-03f91fbd205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:23.078997 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed7499-b4d0-4d3b-97af-03f91fbd205a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:23.079431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed7499-b4d0-4d3b-97af-03f91fbd205a admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:23.079777 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed7499-b4d0-4d3b-97af-03f91fbd205a admin admin] PATH_INFO: `/v3/projects/4c19538b52b0438081790878024a8531` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:23.081056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a575fcc-b686-4ee0-895a-18f6d3854e62 tempest-VolumeQuotaClassesTest-2006471670 tempest-VolumeQuotaClassesTest-2006471670-project-admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:23.082766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed7499-b4d0-4d3b-97af-03f91fbd205a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c19538b52b0438081790878024a8531)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:23.086765 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed7499-b4d0-4d3b-97af-03f91fbd205a admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:23.088458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca8c0b-8fa1-4b54-9feb-7449c9016042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:23.089484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca8c0b-8fa1-4b54-9feb-7449c9016042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:23.089892 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca8c0b-8fa1-4b54-9feb-7449c9016042 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:23.090237 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca8c0b-8fa1-4b54-9feb-7449c9016042 admin admin] PATH_INFO: `/v3/users/7644231eb09441e98ceef239723fa09e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:23.091537 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca8c0b-8fa1-4b54-9feb-7449c9016042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7644231eb09441e98ceef239723fa09e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:23.094732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca8c0b-8fa1-4b54-9feb-7449c9016042 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:23.167829 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-12ed7499-b4d0-4d3b-97af-03f91fbd205a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c19538b52b0438081790878024a8531', 'request_id': 'req-12ed7499-b4d0-4d3b-97af-03f91fbd205a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:23.181678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-12ed7499-b4d0-4d3b-97af-03f91fbd205a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c19538b52b0438081790878024a8531', 'request_id': 'req-12ed7499-b4d0-4d3b-97af-03f91fbd205a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:23.193136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-12ed7499-b4d0-4d3b-97af-03f91fbd205a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c19538b52b0438081790878024a8531', 'request_id': 'req-12ed7499-b4d0-4d3b-97af-03f91fbd205a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:23.208179 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-12ed7499-b4d0-4d3b-97af-03f91fbd205a admin admin] The token cache is being invalidate because project 4c19538b52b0438081790878024a8531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:23.208535 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-12ed7499-b4d0-4d3b-97af-03f91fbd205a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:23.209444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-12ed7499-b4d0-4d3b-97af-03f91fbd205a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:23.210046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4fca8c0b-8fa1-4b54-9feb-7449c9016042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7644231eb09441e98ceef239723fa09e'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:23.220644 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1003/2011] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:22 2022] DELETE /identity/v3/projects/4c19538b52b0438081790878024a8531 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:23.222441 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a4060-f34e-40b7-90ba-0f0cac17287f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:23.223172 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a4060-f34e-40b7-90ba-0f0cac17287f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:23.223172 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a4060-f34e-40b7-90ba-0f0cac17287f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:23.225247 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4fca8c0b-8fa1-4b54-9feb-7449c9016042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7644231eb09441e98ceef239723fa09e'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:23.225980 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4fca8c0b-8fa1-4b54-9feb-7449c9016042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7644231eb09441e98ceef239723fa09e'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:23.226640 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4fca8c0b-8fa1-4b54-9feb-7449c9016042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7644231eb09441e98ceef239723fa09e'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:23.247758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4fca8c0b-8fa1-4b54-9feb-7449c9016042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7644231eb09441e98ceef239723fa09e'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:23.268015 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-067a4060-f34e-40b7-90ba-0f0cac17287f None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:23.269527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-067a4060-f34e-40b7-90ba-0f0cac17287f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:23.301352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1009/2012] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:22 2022] DELETE /identity/v3/users/7644231eb09441e98ceef239723fa09e => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:23.303565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5fbdf-462b-4b4f-82e1-83bb75a14ca9 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:23.303565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5fbdf-462b-4b4f-82e1-83bb75a14ca9 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:23.304393 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5fbdf-462b-4b4f-82e1-83bb75a14ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:23.328575 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-43a5fbdf-462b-4b4f-82e1-83bb75a14ca9 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:23.329972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-43a5fbdf-462b-4b4f-82e1-83bb75a14ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:23.371516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:23.420950 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1010/2013] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:23.424428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5fbdf-462b-4b4f-82e1-83bb75a14ca9 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:23.427326 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-43a5fbdf-462b-4b4f-82e1-83bb75a14ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:23.444359 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5fbdf-462b-4b4f-82e1-83bb75a14ca9 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:23.450943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec4bc5-0be6-4ccc-a956-10bdbdce2195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:23.451800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec4bc5-0be6-4ccc-a956-10bdbdce2195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:23.452232 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec4bc5-0be6-4ccc-a956-10bdbdce2195 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:23.452720 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec4bc5-0be6-4ccc-a956-10bdbdce2195 admin admin] PATH_INFO: `/v3/users/88b533e1338c4f53a1d2da5281e98542` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:23.454446 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec4bc5-0be6-4ccc-a956-10bdbdce2195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88b533e1338c4f53a1d2da5281e98542)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:23.456765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec4bc5-0be6-4ccc-a956-10bdbdce2195 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:23.492866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1004/2014] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:23.493836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a4060-f34e-40b7-90ba-0f0cac17287f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:23.496580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-067a4060-f34e-40b7-90ba-0f0cac17287f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:23.511187 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:23.576353 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6dec4bc5-0be6-4ccc-a956-10bdbdce2195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88b533e1338c4f53a1d2da5281e98542'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:23.596901 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6dec4bc5-0be6-4ccc-a956-10bdbdce2195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88b533e1338c4f53a1d2da5281e98542'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:23.597586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6dec4bc5-0be6-4ccc-a956-10bdbdce2195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88b533e1338c4f53a1d2da5281e98542'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:23.598270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6dec4bc5-0be6-4ccc-a956-10bdbdce2195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88b533e1338c4f53a1d2da5281e98542'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:23.606388 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a4060-f34e-40b7-90ba-0f0cac17287f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:23.616110 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6dec4bc5-0be6-4ccc-a956-10bdbdce2195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88b533e1338c4f53a1d2da5281e98542'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:23.645871 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1011/2015] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:23 2022] DELETE /identity/v3/users/88b533e1338c4f53a1d2da5281e98542 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:23.651127 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feca9f-1f75-414d-9bc8-c011348e345a None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:23.651477 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feca9f-1f75-414d-9bc8-c011348e345a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:23.651780 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feca9f-1f75-414d-9bc8-c011348e345a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:23.683662 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-27feca9f-1f75-414d-9bc8-c011348e345a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:23.685951 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-27feca9f-1f75-414d-9bc8-c011348e345a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:23.705841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2882a2-45a3-4755-9268-89202a82be26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:23.706531 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2882a2-45a3-4755-9268-89202a82be26 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:23.707112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2882a2-45a3-4755-9268-89202a82be26 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:23.707397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2882a2-45a3-4755-9268-89202a82be26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:23.710155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ba2882a2-45a3-4755-9268-89202a82be26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:23.734038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2882a2-45a3-4755-9268-89202a82be26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:23.736393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2882a2-45a3-4755-9268-89202a82be26 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:23.768621 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1005/2016] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:23.768621 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da524906-03a7-438b-a1a0-e377f3f6e02a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:23.768621 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da524906-03a7-438b-a1a0-e377f3f6e02a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:23.768621 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da524906-03a7-438b-a1a0-e377f3f6e02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:23.809661 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-da524906-03a7-438b-a1a0-e377f3f6e02a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:23.811182 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-da524906-03a7-438b-a1a0-e377f3f6e02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:23.833112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1012/2017] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:23.837932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feca9f-1f75-414d-9bc8-c011348e345a None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:23.854900 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feca9f-1f75-414d-9bc8-c011348e345a None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:23.866307 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72746f04-23a8-4438-9325-3a5e883f5b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:23.866974 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72746f04-23a8-4438-9325-3a5e883f5b36 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:23.867393 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72746f04-23a8-4438-9325-3a5e883f5b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:23.867821 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72746f04-23a8-4438-9325-3a5e883f5b36 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:23.868486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72746f04-23a8-4438-9325-3a5e883f5b36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:23.868926 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72746f04-23a8-4438-9325-3a5e883f5b36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:23.870866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72746f04-23a8-4438-9325-3a5e883f5b36 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:23.902794 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1006/2018] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:23.907449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1013/2019] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:47:23.908509 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da524906-03a7-438b-a1a0-e377f3f6e02a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:23.918157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72746f04-23a8-4438-9325-3a5e883f5b36 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:23.920169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-72746f04-23a8-4438-9325-3a5e883f5b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:23.927495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da524906-03a7-438b-a1a0-e377f3f6e02a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:23.935087 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603c75a-1c7b-4f42-b9f6-a10ee9f5243b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:23.935536 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603c75a-1c7b-4f42-b9f6-a10ee9f5243b admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:23.936517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603c75a-1c7b-4f42-b9f6-a10ee9f5243b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:23.936517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603c75a-1c7b-4f42-b9f6-a10ee9f5243b admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:23.936820 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603c75a-1c7b-4f42-b9f6-a10ee9f5243b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:23.939144 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603c75a-1c7b-4f42-b9f6-a10ee9f5243b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:23.991120 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1007/2020] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:23 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:23.993804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:23.995665 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603c75a-1c7b-4f42-b9f6-a10ee9f5243b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:24.046382 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72746f04-23a8-4438-9325-3a5e883f5b36 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:24.100829 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:24.134910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603c75a-1c7b-4f42-b9f6-a10ee9f5243b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:24.147303 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b14db-6492-45c4-91be-b66b1631d209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:24.148275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b14db-6492-45c4-91be-b66b1631d209 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:24.148961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b14db-6492-45c4-91be-b66b1631d209 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:24.150071 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b14db-6492-45c4-91be-b66b1631d209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:24.151934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cb1ee-28ea-4bc0-a5a1-928321bd6935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:24.152691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cb1ee-28ea-4bc0-a5a1-928321bd6935 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:24.152969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cb1ee-28ea-4bc0-a5a1-928321bd6935 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:24.153244 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cb1ee-28ea-4bc0-a5a1-928321bd6935 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:24.153883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cb1ee-28ea-4bc0-a5a1-928321bd6935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:24.158305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cb1ee-28ea-4bc0-a5a1-928321bd6935 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:24.167984 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b14db-6492-45c4-91be-b66b1631d209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:24.169716 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b14db-6492-45c4-91be-b66b1631d209 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:24.186672 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1014/2021] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 10:47:24.213318 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1008/2022] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:23 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:24.217911 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b14db-6492-45c4-91be-b66b1631d209 service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:24.248740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b14db-6492-45c4-91be-b66b1631d209 service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:24.258325 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae19824-08b5-4902-9cb0-7ebc1bd64207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:24.259207 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae19824-08b5-4902-9cb0-7ebc1bd64207 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:24.259969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae19824-08b5-4902-9cb0-7ebc1bd64207 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:24.260284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae19824-08b5-4902-9cb0-7ebc1bd64207 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:24.261496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae19824-08b5-4902-9cb0-7ebc1bd64207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:24.263940 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae19824-08b5-4902-9cb0-7ebc1bd64207 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:24.278659 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1015/2023] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:24.283369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cb1ee-28ea-4bc0-a5a1-928321bd6935 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:24.299748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cb1ee-28ea-4bc0-a5a1-928321bd6935 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:24.311566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f001af1-48b0-4703-968d-3e55a68d26d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:24.312327 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f001af1-48b0-4703-968d-3e55a68d26d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:24.313463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f001af1-48b0-4703-968d-3e55a68d26d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:24.313838 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f001af1-48b0-4703-968d-3e55a68d26d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:24.314751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f001af1-48b0-4703-968d-3e55a68d26d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:24.316933 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f001af1-48b0-4703-968d-3e55a68d26d7 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:24.347048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae19824-08b5-4902-9cb0-7ebc1bd64207 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:24.356883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3ae19824-08b5-4902-9cb0-7ebc1bd64207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:24.368117 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1009/2024] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 10:47:24.372311 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f001af1-48b0-4703-968d-3e55a68d26d7 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:24.383976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae19824-08b5-4902-9cb0-7ebc1bd64207 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:24.397543 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7feae07-9334-43df-a60a-8fef11d36009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:24.398202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feae07-9334-43df-a60a-8fef11d36009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:24.398478 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feae07-9334-43df-a60a-8fef11d36009 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:24.399515 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feae07-9334-43df-a60a-8fef11d36009 admin admin] PATH_INFO: `/v3/projects/bb14e58692514ebab2c0ce85e5662808` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:24.400930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f001af1-48b0-4703-968d-3e55a68d26d7 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:24.402267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7feae07-9334-43df-a60a-8fef11d36009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb14e58692514ebab2c0ce85e5662808)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:24.404528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7feae07-9334-43df-a60a-8fef11d36009 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:24.415678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8129e-4a18-47e7-89e1-8519b94cf43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:24.416692 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8129e-4a18-47e7-89e1-8519b94cf43f admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:24.417316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8129e-4a18-47e7-89e1-8519b94cf43f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:24.417598 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8129e-4a18-47e7-89e1-8519b94cf43f admin admin] PATH_INFO: `/v3/projects/b70b733c24ea4464a3e92be8e69f8b09/users/8b465bf4555345729c5a42729154ffa0/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:24.454165 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8129e-4a18-47e7-89e1-8519b94cf43f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70b733c24ea4464a3e92be8e69f8b09, user_id=8b465bf4555345729c5a42729154ffa0, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:24.459697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8129e-4a18-47e7-89e1-8519b94cf43f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:24.504828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1010/2025] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:24 2022] PUT /identity/v3/projects/b70b733c24ea4464a3e92be8e69f8b09/users/8b465bf4555345729c5a42729154ffa0/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:24.506852 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d386800-6bd5-473f-b9eb-a2ac9365890d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:24.507434 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d386800-6bd5-473f-b9eb-a2ac9365890d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:24.507816 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d386800-6bd5-473f-b9eb-a2ac9365890d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:24.546043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e7feae07-9334-43df-a60a-8fef11d36009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb14e58692514ebab2c0ce85e5662808', 'request_id': 'req-e7feae07-9334-43df-a60a-8fef11d36009'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:24.565277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e7feae07-9334-43df-a60a-8fef11d36009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb14e58692514ebab2c0ce85e5662808', 'request_id': 'req-e7feae07-9334-43df-a60a-8fef11d36009'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:24.582336 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e7feae07-9334-43df-a60a-8fef11d36009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb14e58692514ebab2c0ce85e5662808', 'request_id': 'req-e7feae07-9334-43df-a60a-8fef11d36009'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:24.585166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2d386800-6bd5-473f-b9eb-a2ac9365890d None None] MFA Rules not processed for user `8b465bf4555345729c5a42729154ffa0`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:24.587867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2d386800-6bd5-473f-b9eb-a2ac9365890d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:24.606274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e7feae07-9334-43df-a60a-8fef11d36009 admin admin] The token cache is being invalidate because project bb14e58692514ebab2c0ce85e5662808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:24.606650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e7feae07-9334-43df-a60a-8fef11d36009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:24.610007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e7feae07-9334-43df-a60a-8fef11d36009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:24.616632 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1016/2026] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:24 2022] DELETE /identity/v3/projects/bb14e58692514ebab2c0ce85e5662808 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:24.617935 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7feae07-9334-43df-a60a-8fef11d36009 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:24.619717 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e7feae07-9334-43df-a60a-8fef11d36009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:24.724988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1011/2027] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:47:24.737414 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d386800-6bd5-473f-b9eb-a2ac9365890d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:24.738980 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7feae07-9334-43df-a60a-8fef11d36009 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:24.739359 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2d386800-6bd5-473f-b9eb-a2ac9365890d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:24.744690 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e73e6-110e-4cb8-90a5-9a35d7c4fc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:24.745538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e73e6-110e-4cb8-90a5-9a35d7c4fc02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:24.746020 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e73e6-110e-4cb8-90a5-9a35d7c4fc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:24.746474 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e73e6-110e-4cb8-90a5-9a35d7c4fc02 admin admin] PATH_INFO: `/v3/users/2d22ec0cd6e6463ab86b058ec07cb9c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:24.747925 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e73e6-110e-4cb8-90a5-9a35d7c4fc02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d22ec0cd6e6463ab86b058ec07cb9c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:24.750182 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e73e6-110e-4cb8-90a5-9a35d7c4fc02 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:24.757631 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:24.803468 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d386800-6bd5-473f-b9eb-a2ac9365890d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:24.809395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992ecdc-d3e3-40b6-9215-3addde981a8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:24.810227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992ecdc-d3e3-40b6-9215-3addde981a8a service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:24.810509 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992ecdc-d3e3-40b6-9215-3addde981a8a service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:24.810780 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992ecdc-d3e3-40b6-9215-3addde981a8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:24.815837 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-161e73e6-110e-4cb8-90a5-9a35d7c4fc02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d22ec0cd6e6463ab86b058ec07cb9c7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:24.823309 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992ecdc-d3e3-40b6-9215-3addde981a8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:24.825000 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992ecdc-d3e3-40b6-9215-3addde981a8a service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:24.826783 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-161e73e6-110e-4cb8-90a5-9a35d7c4fc02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d22ec0cd6e6463ab86b058ec07cb9c7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:24.827687 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-161e73e6-110e-4cb8-90a5-9a35d7c4fc02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d22ec0cd6e6463ab86b058ec07cb9c7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:24.829139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-161e73e6-110e-4cb8-90a5-9a35d7c4fc02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d22ec0cd6e6463ab86b058ec07cb9c7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:24.835586 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1012/2028] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 10:47:24.841271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-161e73e6-110e-4cb8-90a5-9a35d7c4fc02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d22ec0cd6e6463ab86b058ec07cb9c7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:24.862912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992ecdc-d3e3-40b6-9215-3addde981a8a service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:24.865666 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0992ecdc-d3e3-40b6-9215-3addde981a8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:24.870381 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1017/2029] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:24 2022] DELETE /identity/v3/users/2d22ec0cd6e6463ab86b058ec07cb9c7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:24.883255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992ecdc-d3e3-40b6-9215-3addde981a8a service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:24.913888 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:24.971675 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92029eb8-f98c-4d4d-9073-5cee5ab23eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:24.973347 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92029eb8-f98c-4d4d-9073-5cee5ab23eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:24.974466 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92029eb8-f98c-4d4d-9073-5cee5ab23eca admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:24.974938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92029eb8-f98c-4d4d-9073-5cee5ab23eca admin admin] PATH_INFO: `/v3/users/8b465bf4555345729c5a42729154ffa0` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:24.976964 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92029eb8-f98c-4d4d-9073-5cee5ab23eca admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b465bf4555345729c5a42729154ffa0)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:24.981124 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92029eb8-f98c-4d4d-9073-5cee5ab23eca admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:25.048332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-92029eb8-f98c-4d4d-9073-5cee5ab23eca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b465bf4555345729c5a42729154ffa0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:25.061387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-92029eb8-f98c-4d4d-9073-5cee5ab23eca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b465bf4555345729c5a42729154ffa0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:25.063044 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-92029eb8-f98c-4d4d-9073-5cee5ab23eca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b465bf4555345729c5a42729154ffa0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:25.064082 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-92029eb8-f98c-4d4d-9073-5cee5ab23eca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b465bf4555345729c5a42729154ffa0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:25.075969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-92029eb8-f98c-4d4d-9073-5cee5ab23eca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b465bf4555345729c5a42729154ffa0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:25.111879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1013/2030] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:24 2022] DELETE /identity/v3/users/8b465bf4555345729c5a42729154ffa0 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:47:25.128211 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ef50d-0ea0-4d20-8d62-ea440fa8da74 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:25.128600 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ef50d-0ea0-4d20-8d62-ea440fa8da74 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:25.128962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ef50d-0ea0-4d20-8d62-ea440fa8da74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:25.173119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-fa3ef50d-0ea0-4d20-8d62-ea440fa8da74 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:25.175034 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fa3ef50d-0ea0-4d20-8d62-ea440fa8da74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:25.183416 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92029eb8-f98c-4d4d-9073-5cee5ab23eca admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:25.184957 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-92029eb8-f98c-4d4d-9073-5cee5ab23eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:25.287395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92029eb8-f98c-4d4d-9073-5cee5ab23eca admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:25.289302 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1018/2031] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:25.292807 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01510a33-7c63-480d-8226-fbc8fb84a241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:25.293585 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01510a33-7c63-480d-8226-fbc8fb84a241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:25.293856 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01510a33-7c63-480d-8226-fbc8fb84a241 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:25.294273 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01510a33-7c63-480d-8226-fbc8fb84a241 admin admin] PATH_INFO: `/v3/projects/656f2f597c524752a41d41de94a5b0f8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:25.295444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01510a33-7c63-480d-8226-fbc8fb84a241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=656f2f597c524752a41d41de94a5b0f8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:25.297811 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01510a33-7c63-480d-8226-fbc8fb84a241 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:25.301361 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ef50d-0ea0-4d20-8d62-ea440fa8da74 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:25.304220 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fa3ef50d-0ea0-4d20-8d62-ea440fa8da74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:25.372436 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:25.375982 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-01510a33-7c63-480d-8226-fbc8fb84a241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '656f2f597c524752a41d41de94a5b0f8', 'request_id': 'req-01510a33-7c63-480d-8226-fbc8fb84a241'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:25.385440 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-01510a33-7c63-480d-8226-fbc8fb84a241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '656f2f597c524752a41d41de94a5b0f8', 'request_id': 'req-01510a33-7c63-480d-8226-fbc8fb84a241'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:25.397715 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-01510a33-7c63-480d-8226-fbc8fb84a241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '656f2f597c524752a41d41de94a5b0f8', 'request_id': 'req-01510a33-7c63-480d-8226-fbc8fb84a241'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:25.412936 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-01510a33-7c63-480d-8226-fbc8fb84a241 admin admin] The token cache is being invalidate because project 656f2f597c524752a41d41de94a5b0f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:25.413246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-01510a33-7c63-480d-8226-fbc8fb84a241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:25.416970 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-01510a33-7c63-480d-8226-fbc8fb84a241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:25.419241 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1014/2032] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:25 2022] DELETE /identity/v3/projects/656f2f597c524752a41d41de94a5b0f8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:25.424314 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01510a33-7c63-480d-8226-fbc8fb84a241 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:25.427375 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-01510a33-7c63-480d-8226-fbc8fb84a241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:25.429637 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ef50d-0ea0-4d20-8d62-ea440fa8da74 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:25.516569 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:25.529779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3463c1-6537-4f9b-afc7-ad0cc42c6dbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:25.530504 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3463c1-6537-4f9b-afc7-ad0cc42c6dbc service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:25.530774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3463c1-6537-4f9b-afc7-ad0cc42c6dbc service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:25.531150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3463c1-6537-4f9b-afc7-ad0cc42c6dbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:25.536675 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2c3463c1-6537-4f9b-afc7-ad0cc42c6dbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:25.542777 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01510a33-7c63-480d-8226-fbc8fb84a241 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:25.548840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92dfff-31ee-4f13-b826-83d63316f9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:25.549494 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3463c1-6537-4f9b-afc7-ad0cc42c6dbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:25.549622 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92dfff-31ee-4f13-b826-83d63316f9c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:25.549992 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92dfff-31ee-4f13-b826-83d63316f9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:25.550333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92dfff-31ee-4f13-b826-83d63316f9c4 admin admin] PATH_INFO: `/v3/users/114a6522164c49d4997278eeb10ff354` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:25.551240 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3463c1-6537-4f9b-afc7-ad0cc42c6dbc service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:25.551619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92dfff-31ee-4f13-b826-83d63316f9c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=114a6522164c49d4997278eeb10ff354)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:25.553751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92dfff-31ee-4f13-b826-83d63316f9c4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:25.562231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1019/2033] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:25.563752 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3463c1-6537-4f9b-afc7-ad0cc42c6dbc service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:25.565227 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2c3463c1-6537-4f9b-afc7-ad0cc42c6dbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:25.578191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3463c1-6537-4f9b-afc7-ad0cc42c6dbc service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:25.583417 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794c802-f432-4a30-86e5-6d60ed1787f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:25.584043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794c802-f432-4a30-86e5-6d60ed1787f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:25.584442 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794c802-f432-4a30-86e5-6d60ed1787f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:25.584867 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794c802-f432-4a30-86e5-6d60ed1787f8 admin admin] PATH_INFO: `/v3/projects/19b4c5bb3e384b16bafe43f0aecda666` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:25.586427 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794c802-f432-4a30-86e5-6d60ed1787f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b4c5bb3e384b16bafe43f0aecda666)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:25.589336 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794c802-f432-4a30-86e5-6d60ed1787f8 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:25.630813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fe92dfff-31ee-4f13-b826-83d63316f9c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '114a6522164c49d4997278eeb10ff354'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:25.648970 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fe92dfff-31ee-4f13-b826-83d63316f9c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '114a6522164c49d4997278eeb10ff354'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:25.649732 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fe92dfff-31ee-4f13-b826-83d63316f9c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '114a6522164c49d4997278eeb10ff354'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:25.650488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fe92dfff-31ee-4f13-b826-83d63316f9c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '114a6522164c49d4997278eeb10ff354'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:25.663844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fe92dfff-31ee-4f13-b826-83d63316f9c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '114a6522164c49d4997278eeb10ff354'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:25.678123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a794c802-f432-4a30-86e5-6d60ed1787f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b4c5bb3e384b16bafe43f0aecda666', 'request_id': 'req-a794c802-f432-4a30-86e5-6d60ed1787f8'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:25.688864 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1015/2034] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:25 2022] DELETE /identity/v3/users/114a6522164c49d4997278eeb10ff354 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:25.690616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a794c802-f432-4a30-86e5-6d60ed1787f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b4c5bb3e384b16bafe43f0aecda666', 'request_id': 'req-a794c802-f432-4a30-86e5-6d60ed1787f8'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:25.704438 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a794c802-f432-4a30-86e5-6d60ed1787f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b4c5bb3e384b16bafe43f0aecda666', 'request_id': 'req-a794c802-f432-4a30-86e5-6d60ed1787f8'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:25.744584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a794c802-f432-4a30-86e5-6d60ed1787f8 admin admin] The token cache is being invalidate because project 19b4c5bb3e384b16bafe43f0aecda666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:25.744905 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a794c802-f432-4a30-86e5-6d60ed1787f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:25.745573 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a794c802-f432-4a30-86e5-6d60ed1787f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:25.747340 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1020/2035] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:25 2022] DELETE /identity/v3/projects/19b4c5bb3e384b16bafe43f0aecda666 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:25.752036 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92dfff-31ee-4f13-b826-83d63316f9c4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:25.754339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fe92dfff-31ee-4f13-b826-83d63316f9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:25.883251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:25.892783 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92dfff-31ee-4f13-b826-83d63316f9c4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:25.900713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75952e-cbc2-4201-b239-531bf88b00b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:25.903062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75952e-cbc2-4201-b239-531bf88b00b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:25.904566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75952e-cbc2-4201-b239-531bf88b00b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:25.905050 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75952e-cbc2-4201-b239-531bf88b00b5 admin admin] PATH_INFO: `/v3/users/38f41ced37f842acb3e7004c0c1b0e7b` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:25.906628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75952e-cbc2-4201-b239-531bf88b00b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38f41ced37f842acb3e7004c0c1b0e7b)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:25.909827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75952e-cbc2-4201-b239-531bf88b00b5 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:25.991505 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8a75952e-cbc2-4201-b239-531bf88b00b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38f41ced37f842acb3e7004c0c1b0e7b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:26.011745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794c802-f432-4a30-86e5-6d60ed1787f8 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:26.014768 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a794c802-f432-4a30-86e5-6d60ed1787f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:26.047910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8a75952e-cbc2-4201-b239-531bf88b00b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38f41ced37f842acb3e7004c0c1b0e7b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:26.048912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8a75952e-cbc2-4201-b239-531bf88b00b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38f41ced37f842acb3e7004c0c1b0e7b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:26.052590 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8a75952e-cbc2-4201-b239-531bf88b00b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38f41ced37f842acb3e7004c0c1b0e7b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:26.089889 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8a75952e-cbc2-4201-b239-531bf88b00b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38f41ced37f842acb3e7004c0c1b0e7b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:26.141120 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1016/2036] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:25 2022] DELETE /identity/v3/users/38f41ced37f842acb3e7004c0c1b0e7b => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:26.220519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794c802-f432-4a30-86e5-6d60ed1787f8 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:26.374327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f2507-86ec-4488-9403-949a6ccc3a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:26.375293 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f2507-86ec-4488-9403-949a6ccc3a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:26.378374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f2507-86ec-4488-9403-949a6ccc3a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:26.378832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f2507-86ec-4488-9403-949a6ccc3a10 admin admin] PATH_INFO: `/v3/projects/b70b733c24ea4464a3e92be8e69f8b09` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:26.380366 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f2507-86ec-4488-9403-949a6ccc3a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b70b733c24ea4464a3e92be8e69f8b09)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:26.385491 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f2507-86ec-4488-9403-949a6ccc3a10 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:26.440065 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:26.553491 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e04f2507-86ec-4488-9403-949a6ccc3a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b70b733c24ea4464a3e92be8e69f8b09', 'request_id': 'req-e04f2507-86ec-4488-9403-949a6ccc3a10'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:26.570278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e04f2507-86ec-4488-9403-949a6ccc3a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b70b733c24ea4464a3e92be8e69f8b09', 'request_id': 'req-e04f2507-86ec-4488-9403-949a6ccc3a10'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:26.586389 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e04f2507-86ec-4488-9403-949a6ccc3a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b70b733c24ea4464a3e92be8e69f8b09', 'request_id': 'req-e04f2507-86ec-4488-9403-949a6ccc3a10'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:26.615428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e04f2507-86ec-4488-9403-949a6ccc3a10 admin admin] The token cache is being invalidate because project b70b733c24ea4464a3e92be8e69f8b09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:26.615742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e04f2507-86ec-4488-9403-949a6ccc3a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:26.618144 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e04f2507-86ec-4488-9403-949a6ccc3a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:26.621992 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1021/2037] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:26 2022] DELETE /identity/v3/projects/b70b733c24ea4464a3e92be8e69f8b09 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:26.627342 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afdf21-0720-4328-bf14-a7039286fddf None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:26.627669 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afdf21-0720-4328-bf14-a7039286fddf None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:26.627975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afdf21-0720-4328-bf14-a7039286fddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:26.666836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c0afdf21-0720-4328-bf14-a7039286fddf None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:26.668077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c0afdf21-0720-4328-bf14-a7039286fddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:26.784497 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1017/2038] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:26.793107 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73346176-1565-4fcb-900b-13e45151f3eb None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:26.793517 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73346176-1565-4fcb-900b-13e45151f3eb None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:26.794947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73346176-1565-4fcb-900b-13e45151f3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:26.820913 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-73346176-1565-4fcb-900b-13e45151f3eb None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:26.822250 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-73346176-1565-4fcb-900b-13e45151f3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:26.833980 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1022/2039] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:26.835737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afdf21-0720-4328-bf14-a7039286fddf None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:26.855162 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afdf21-0720-4328-bf14-a7039286fddf None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:26.865410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb9b2d-41c1-4b33-86c2-53c611a301ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:26.866641 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb9b2d-41c1-4b33-86c2-53c611a301ef admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:26.868255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb9b2d-41c1-4b33-86c2-53c611a301ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:26.868699 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb9b2d-41c1-4b33-86c2-53c611a301ef admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:26.869533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb9b2d-41c1-4b33-86c2-53c611a301ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:26.869915 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb9b2d-41c1-4b33-86c2-53c611a301ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:26.872387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb9b2d-41c1-4b33-86c2-53c611a301ef admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:26.895628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1018/2040] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:47:26.896614 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73346176-1565-4fcb-900b-13e45151f3eb None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:26.916800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73346176-1565-4fcb-900b-13e45151f3eb None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:26.923539 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb9b2d-41c1-4b33-86c2-53c611a301ef admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:26.925468 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-54fb9b2d-41c1-4b33-86c2-53c611a301ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:26.926420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b81ef1-f946-4f0f-9313-ef2d2c73774f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:26.927227 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b81ef1-f946-4f0f-9313-ef2d2c73774f admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:26.927614 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b81ef1-f946-4f0f-9313-ef2d2c73774f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:26.928013 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b81ef1-f946-4f0f-9313-ef2d2c73774f admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:26.928792 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b81ef1-f946-4f0f-9313-ef2d2c73774f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:26.930837 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b81ef1-f946-4f0f-9313-ef2d2c73774f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:26.943377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb9b2d-41c1-4b33-86c2-53c611a301ef admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:26.951084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0bcda-42cb-43ef-931b-080bc030b454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:26.951773 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0bcda-42cb-43ef-931b-080bc030b454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:26.952108 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0bcda-42cb-43ef-931b-080bc030b454 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:26.952308 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0bcda-42cb-43ef-931b-080bc030b454 admin admin] PATH_INFO: `/v3/projects/9795c664b7214ae5a675bc09238f4439` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:26.960356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0bcda-42cb-43ef-931b-080bc030b454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9795c664b7214ae5a675bc09238f4439)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:26.968583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0bcda-42cb-43ef-931b-080bc030b454 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:27.002618 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1023/2041] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:26 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:47:27.007402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b81ef1-f946-4f0f-9313-ef2d2c73774f admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:27.085572 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7ce0bcda-42cb-43ef-931b-080bc030b454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9795c664b7214ae5a675bc09238f4439', 'request_id': 'req-7ce0bcda-42cb-43ef-931b-080bc030b454'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:27.097080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7ce0bcda-42cb-43ef-931b-080bc030b454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9795c664b7214ae5a675bc09238f4439', 'request_id': 'req-7ce0bcda-42cb-43ef-931b-080bc030b454'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:27.106041 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:27.118358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7ce0bcda-42cb-43ef-931b-080bc030b454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9795c664b7214ae5a675bc09238f4439', 'request_id': 'req-7ce0bcda-42cb-43ef-931b-080bc030b454'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:27.129695 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b81ef1-f946-4f0f-9313-ef2d2c73774f admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:27.139145 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7ce0bcda-42cb-43ef-931b-080bc030b454 admin admin] The token cache is being invalidate because project 9795c664b7214ae5a675bc09238f4439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:27.139608 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7ce0bcda-42cb-43ef-931b-080bc030b454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:27.141084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7ce0bcda-42cb-43ef-931b-080bc030b454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:27.150176 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1019/2042] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:26 2022] DELETE /identity/v3/projects/9795c664b7214ae5a675bc09238f4439 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:27.155599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247f5a4-52c3-4ac0-9e8f-c69a43c10821 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:27.156137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247f5a4-52c3-4ac0-9e8f-c69a43c10821 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:27.156582 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247f5a4-52c3-4ac0-9e8f-c69a43c10821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:27.210883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5b115-5dd4-49db-bf4a-05b8a723b893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:27.211444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-0247f5a4-52c3-4ac0-9e8f-c69a43c10821 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:27.212130 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5b115-5dd4-49db-bf4a-05b8a723b893 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:27.212647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5b115-5dd4-49db-bf4a-05b8a723b893 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:27.213144 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5b115-5dd4-49db-bf4a-05b8a723b893 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:27.213959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0247f5a4-52c3-4ac0-9e8f-c69a43c10821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:27.215540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5b115-5dd4-49db-bf4a-05b8a723b893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:27.217828 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5b115-5dd4-49db-bf4a-05b8a723b893 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:27.267661 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1020/2043] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:47:27.267661 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247f5a4-52c3-4ac0-9e8f-c69a43c10821 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:27.271112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0247f5a4-52c3-4ac0-9e8f-c69a43c10821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:27.271425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1024/2044] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:27 2022] POST /identity/v3/users => generated 296 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:47:27.272904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09631787-4e69-4d7a-adde-4de783e24c4f None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:27.273194 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09631787-4e69-4d7a-adde-4de783e24c4f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:27.273507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09631787-4e69-4d7a-adde-4de783e24c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:27.291110 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247f5a4-52c3-4ac0-9e8f-c69a43c10821 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:27.299305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b81ee-834f-4315-8fbc-0190415cc034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:27.300018 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b81ee-834f-4315-8fbc-0190415cc034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:27.300355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b81ee-834f-4315-8fbc-0190415cc034 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:27.300662 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b81ee-834f-4315-8fbc-0190415cc034 admin admin] PATH_INFO: `/v3/projects/cbd453e85dcd4515a131adf80c6852cb` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:27.302113 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b81ee-834f-4315-8fbc-0190415cc034 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbd453e85dcd4515a131adf80c6852cb)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:27.304377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b81ee-834f-4315-8fbc-0190415cc034 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:27.312127 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-09631787-4e69-4d7a-adde-4de783e24c4f None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:27.315289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-09631787-4e69-4d7a-adde-4de783e24c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:27.342884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1025/2045] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:27.342884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09631787-4e69-4d7a-adde-4de783e24c4f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:27.344906 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-09631787-4e69-4d7a-adde-4de783e24c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:27.367010 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09631787-4e69-4d7a-adde-4de783e24c4f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:27.377924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:27.400442 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c97b81ee-834f-4315-8fbc-0190415cc034 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbd453e85dcd4515a131adf80c6852cb', 'request_id': 'req-c97b81ee-834f-4315-8fbc-0190415cc034'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:27.410525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c97b81ee-834f-4315-8fbc-0190415cc034 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbd453e85dcd4515a131adf80c6852cb', 'request_id': 'req-c97b81ee-834f-4315-8fbc-0190415cc034'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:27.424470 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c97b81ee-834f-4315-8fbc-0190415cc034 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbd453e85dcd4515a131adf80c6852cb', 'request_id': 'req-c97b81ee-834f-4315-8fbc-0190415cc034'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:27.440242 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c97b81ee-834f-4315-8fbc-0190415cc034 admin admin] The token cache is being invalidate because project cbd453e85dcd4515a131adf80c6852cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:27.440810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c97b81ee-834f-4315-8fbc-0190415cc034 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:27.442014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c97b81ee-834f-4315-8fbc-0190415cc034 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:27.444337 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1021/2046] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:27 2022] DELETE /identity/v3/projects/cbd453e85dcd4515a131adf80c6852cb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:27.445619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b81ee-834f-4315-8fbc-0190415cc034 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:27.449609 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c97b81ee-834f-4315-8fbc-0190415cc034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:27.469222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f3ff7-0d84-41b2-9776-15ab21ec3325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:27.470607 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f3ff7-0d84-41b2-9776-15ab21ec3325 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:27.471180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f3ff7-0d84-41b2-9776-15ab21ec3325 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:27.471682 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f3ff7-0d84-41b2-9776-15ab21ec3325 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:27.473074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f3ff7-0d84-41b2-9776-15ab21ec3325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:27.475260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f3ff7-0d84-41b2-9776-15ab21ec3325 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:27.489662 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1026/2047] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:27.491455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af93675-a9a1-4455-b0a7-5d67f840b129 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:27.492329 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af93675-a9a1-4455-b0a7-5d67f840b129 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:27.492822 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af93675-a9a1-4455-b0a7-5d67f840b129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:27.514987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-3af93675-a9a1-4455-b0a7-5d67f840b129 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:27.516392 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3af93675-a9a1-4455-b0a7-5d67f840b129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:27.525166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1027/2048] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:27.526137 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af93675-a9a1-4455-b0a7-5d67f840b129 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:27.527573 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3af93675-a9a1-4455-b0a7-5d67f840b129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:27.539932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af93675-a9a1-4455-b0a7-5d67f840b129 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:27.542175 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b81ee-834f-4315-8fbc-0190415cc034 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:27.545592 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ba1ae-c30b-4827-89dd-da72a52bb646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:27.546241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ba1ae-c30b-4827-89dd-da72a52bb646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:27.546497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ba1ae-c30b-4827-89dd-da72a52bb646 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:27.547375 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ba1ae-c30b-4827-89dd-da72a52bb646 admin admin] PATH_INFO: `/v3/users/4f9900a5a6ad49c19639f5be645f7b23` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:27.548148 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92448586-97d1-4abc-80dd-8b313eef441b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:27.548871 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92448586-97d1-4abc-80dd-8b313eef441b admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:27.549036 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ba1ae-c30b-4827-89dd-da72a52bb646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f9900a5a6ad49c19639f5be645f7b23)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:27.549281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92448586-97d1-4abc-80dd-8b313eef441b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:27.549565 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92448586-97d1-4abc-80dd-8b313eef441b admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:27.550222 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92448586-97d1-4abc-80dd-8b313eef441b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:27.550669 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92448586-97d1-4abc-80dd-8b313eef441b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:27.551418 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ba1ae-c30b-4827-89dd-da72a52bb646 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:27.552267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92448586-97d1-4abc-80dd-8b313eef441b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:27.566143 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1022/2049] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:47:27.566990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92448586-97d1-4abc-80dd-8b313eef441b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:27.568597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-92448586-97d1-4abc-80dd-8b313eef441b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:27.584030 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92448586-97d1-4abc-80dd-8b313eef441b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:27.589811 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd09551-845e-4019-8ebe-899d8f132036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:27.590489 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd09551-845e-4019-8ebe-899d8f132036 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:27.590913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd09551-845e-4019-8ebe-899d8f132036 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:27.591198 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd09551-845e-4019-8ebe-899d8f132036 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:27.592188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd09551-845e-4019-8ebe-899d8f132036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:27.594977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd09551-845e-4019-8ebe-899d8f132036 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:27.609685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1023/2050] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:27.610032 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbe4b3-54f6-42d7-8825-da3f37e62afb None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:27.610430 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbe4b3-54f6-42d7-8825-da3f37e62afb None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:27.610852 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbe4b3-54f6-42d7-8825-da3f37e62afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:27.618889 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-911ba1ae-c30b-4827-89dd-da72a52bb646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f9900a5a6ad49c19639f5be645f7b23'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:27.629957 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-911ba1ae-c30b-4827-89dd-da72a52bb646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f9900a5a6ad49c19639f5be645f7b23'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:27.630715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-911ba1ae-c30b-4827-89dd-da72a52bb646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f9900a5a6ad49c19639f5be645f7b23'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:27.631436 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-911ba1ae-c30b-4827-89dd-da72a52bb646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f9900a5a6ad49c19639f5be645f7b23'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:27.631902 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e3dbe4b3-54f6-42d7-8825-da3f37e62afb None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:27.633218 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e3dbe4b3-54f6-42d7-8825-da3f37e62afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:27.640876 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-911ba1ae-c30b-4827-89dd-da72a52bb646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f9900a5a6ad49c19639f5be645f7b23'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:27.642370 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1024/2051] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:27.643342 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbe4b3-54f6-42d7-8825-da3f37e62afb None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:27.646694 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e3dbe4b3-54f6-42d7-8825-da3f37e62afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:27.670016 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbe4b3-54f6-42d7-8825-da3f37e62afb None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:27.676886 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1028/2052] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:27 2022] DELETE /identity/v3/users/4f9900a5a6ad49c19639f5be645f7b23 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:27.680879 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ba1ae-c30b-4827-89dd-da72a52bb646 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:27.680991 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca96bd6-2a53-4862-824d-277d5a0977de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:27.681112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-911ba1ae-c30b-4827-89dd-da72a52bb646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:27.681188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca96bd6-2a53-4862-824d-277d5a0977de admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:27.681188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca96bd6-2a53-4862-824d-277d5a0977de admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:27.681188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca96bd6-2a53-4862-824d-277d5a0977de admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:27.681188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca96bd6-2a53-4862-824d-277d5a0977de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:27.684468 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca96bd6-2a53-4862-824d-277d5a0977de admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:27.731351 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1025/2053] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:27 2022] POST /identity/v3/projects => generated 371 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:27.732351 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca96bd6-2a53-4862-824d-277d5a0977de admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:27.756445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:27.781559 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ba1ae-c30b-4827-89dd-da72a52bb646 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:27.801259 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:27.851980 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca96bd6-2a53-4862-824d-277d5a0977de admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:27.860868 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd87b4-800e-401a-a949-7f2abaf3f570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:27.861510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd87b4-800e-401a-a949-7f2abaf3f570 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:27.861793 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd87b4-800e-401a-a949-7f2abaf3f570 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:27.862070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd87b4-800e-401a-a949-7f2abaf3f570 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:27.862742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd87b4-800e-401a-a949-7f2abaf3f570 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:27.863093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd87b4-800e-401a-a949-7f2abaf3f570 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:27.864828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd87b4-800e-401a-a949-7f2abaf3f570 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:27.879838 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1026/2054] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:47:27.881005 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a2542-8b7e-4513-8c46-64d1ce00e6e7 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:27.881346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a2542-8b7e-4513-8c46-64d1ce00e6e7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:27.881627 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a2542-8b7e-4513-8c46-64d1ce00e6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:27.909213 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-419a2542-8b7e-4513-8c46-64d1ce00e6e7 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:27.910454 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-419a2542-8b7e-4513-8c46-64d1ce00e6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:27.921001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1027/2055] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:27.924789 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a2542-8b7e-4513-8c46-64d1ce00e6e7 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:27.924892 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b64408-f00e-40b1-80d7-c1f09213f466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:27.938488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a2542-8b7e-4513-8c46-64d1ce00e6e7 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:27.941621 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b64408-f00e-40b1-80d7-c1f09213f466 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:27.941990 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b64408-f00e-40b1-80d7-c1f09213f466 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:27.942273 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b64408-f00e-40b1-80d7-c1f09213f466 admin admin] PATH_INFO: `/v3/projects/69db61a4a9244bcd95b78bcd61d03a76/users/c1ffe3e92f27483da6ae6e597449a5d8/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:27.944588 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ac269-5ab3-4dd8-a742-1320e8eb7767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:27.945330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ac269-5ab3-4dd8-a742-1320e8eb7767 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:27.945688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ac269-5ab3-4dd8-a742-1320e8eb7767 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:27.947543 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ac269-5ab3-4dd8-a742-1320e8eb7767 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:27.947543 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ac269-5ab3-4dd8-a742-1320e8eb7767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:27.948880 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ac269-5ab3-4dd8-a742-1320e8eb7767 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:27.971828 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b64408-f00e-40b1-80d7-c1f09213f466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69db61a4a9244bcd95b78bcd61d03a76, user_id=c1ffe3e92f27483da6ae6e597449a5d8, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:27.977519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b64408-f00e-40b1-80d7-c1f09213f466 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:27.983764 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1028/2056] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:27 2022] POST /identity/v3/users => generated 286 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:27.985035 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ac269-5ab3-4dd8-a742-1320e8eb7767 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:28.008829 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1029/2057] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:27 2022] PUT /identity/v3/projects/69db61a4a9244bcd95b78bcd61d03a76/users/c1ffe3e92f27483da6ae6e597449a5d8/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:28.013599 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b64408-f00e-40b1-80d7-c1f09213f466 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:28.017377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ac269-5ab3-4dd8-a742-1320e8eb7767 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:28.017846 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-79b64408-f00e-40b1-80d7-c1f09213f466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:28.143282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a0b25-c40f-4e4d-a36d-4c9bffc4cd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:28.143919 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a0b25-c40f-4e4d-a36d-4c9bffc4cd79 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:28.144200 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a0b25-c40f-4e4d-a36d-4c9bffc4cd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:28.144517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a0b25-c40f-4e4d-a36d-4c9bffc4cd79 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:28.145156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a0b25-c40f-4e4d-a36d-4c9bffc4cd79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:28.147688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a0b25-c40f-4e4d-a36d-4c9bffc4cd79 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:28.173614 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b64408-f00e-40b1-80d7-c1f09213f466 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:28.178620 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3796a-a0be-4ab4-ad14-bf3b0677a82c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:28.179635 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3796a-a0be-4ab4-ad14-bf3b0677a82c service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:28.180154 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3796a-a0be-4ab4-ad14-bf3b0677a82c service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:28.180585 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3796a-a0be-4ab4-ad14-bf3b0677a82c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:28.185517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1029/2058] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:27 2022] POST /identity/v3/projects => generated 391 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:28.186896 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a0b25-c40f-4e4d-a36d-4c9bffc4cd79 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:28.196437 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3796a-a0be-4ab4-ad14-bf3b0677a82c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:28.198098 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3796a-a0be-4ab4-ad14-bf3b0677a82c service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:28.211086 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1030/2059] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:28.212598 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd723951-e916-4fac-9200-48baf0e7b082 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:28.213024 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd723951-e916-4fac-9200-48baf0e7b082 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:28.213421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd723951-e916-4fac-9200-48baf0e7b082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:28.269429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-bd723951-e916-4fac-9200-48baf0e7b082 None None] MFA Rules not processed for user `c1ffe3e92f27483da6ae6e597449a5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:28.270883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-bd723951-e916-4fac-9200-48baf0e7b082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:28.330525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a0b25-c40f-4e4d-a36d-4c9bffc4cd79 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:28.345591 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361eccb-df2e-4515-9941-d4043b84ff53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:28.346606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361eccb-df2e-4515-9941-d4043b84ff53 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:28.346927 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361eccb-df2e-4515-9941-d4043b84ff53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:28.347524 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361eccb-df2e-4515-9941-d4043b84ff53 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:28.347988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361eccb-df2e-4515-9941-d4043b84ff53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:28.349954 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361eccb-df2e-4515-9941-d4043b84ff53 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:28.376814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1030/2060] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:28.376814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361eccb-df2e-4515-9941-d4043b84ff53 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:28.393655 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361eccb-df2e-4515-9941-d4043b84ff53 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:28.399829 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbd0c0-37f5-481b-8ca5-719c5af8a3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:28.400622 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbd0c0-37f5-481b-8ca5-719c5af8a3ef admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:28.401361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbd0c0-37f5-481b-8ca5-719c5af8a3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:28.401651 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbd0c0-37f5-481b-8ca5-719c5af8a3ef admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:28.402338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bbd0c0-37f5-481b-8ca5-719c5af8a3ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:28.404261 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bbd0c0-37f5-481b-8ca5-719c5af8a3ef admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:28.413359 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:28.435565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1031/2061] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:28.436654 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd723951-e916-4fac-9200-48baf0e7b082 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:28.456915 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd723951-e916-4fac-9200-48baf0e7b082 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:28.462959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74b264-8e69-47d5-9728-882dd30b4fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:28.463675 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74b264-8e69-47d5-9728-882dd30b4fdf admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:28.464264 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74b264-8e69-47d5-9728-882dd30b4fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:28.464633 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74b264-8e69-47d5-9728-882dd30b4fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:28.465335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74b264-8e69-47d5-9728-882dd30b4fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:28.467314 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74b264-8e69-47d5-9728-882dd30b4fdf admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:28.468347 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1031/2062] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:28 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:28.469109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbd0c0-37f5-481b-8ca5-719c5af8a3ef admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:28.475962 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-15bbd0c0-37f5-481b-8ca5-719c5af8a3ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:28.488001 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1032/2063] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:28.489256 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74b264-8e69-47d5-9728-882dd30b4fdf admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:28.514028 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74b264-8e69-47d5-9728-882dd30b4fdf admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:28.531223 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809a2ac-34fe-434a-992b-b320d050e545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:28.531782 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809a2ac-34fe-434a-992b-b320d050e545 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:28.531998 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809a2ac-34fe-434a-992b-b320d050e545 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:28.532150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809a2ac-34fe-434a-992b-b320d050e545 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:28.533021 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809a2ac-34fe-434a-992b-b320d050e545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:28.535181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809a2ac-34fe-434a-992b-b320d050e545 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:28.552595 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1033/2064] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:28.552972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809a2ac-34fe-434a-992b-b320d050e545 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:28.568401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809a2ac-34fe-434a-992b-b320d050e545 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:28.577223 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a1e43-29e0-4f35-abd8-a410695bca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:28.578507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a1e43-29e0-4f35-abd8-a410695bca8c admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:28.578846 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a1e43-29e0-4f35-abd8-a410695bca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:28.579184 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a1e43-29e0-4f35-abd8-a410695bca8c admin admin] PATH_INFO: `/v3/projects/9fcdbb4f8b1d422b9470121d11147e8d/users/936f87df21764327a82fa50d33b68e9f/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:28.583138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:28.584567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbd0c0-37f5-481b-8ca5-719c5af8a3ef admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:28.588617 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da227b-2045-4055-a9fd-581ed4087f75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:28.589563 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da227b-2045-4055-a9fd-581ed4087f75 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:28.589925 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da227b-2045-4055-a9fd-581ed4087f75 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:28.590318 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da227b-2045-4055-a9fd-581ed4087f75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:28.604424 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da227b-2045-4055-a9fd-581ed4087f75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:28.604899 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a1e43-29e0-4f35-abd8-a410695bca8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fcdbb4f8b1d422b9470121d11147e8d, user_id=936f87df21764327a82fa50d33b68e9f, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:28.606527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da227b-2045-4055-a9fd-581ed4087f75 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:28.613197 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a1e43-29e0-4f35-abd8-a410695bca8c admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:28.617841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1032/2065] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:28 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:28.618954 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da227b-2045-4055-a9fd-581ed4087f75 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:28.633873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da227b-2045-4055-a9fd-581ed4087f75 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:28.638290 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1034/2066] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:28 2022] PUT /identity/v3/projects/9fcdbb4f8b1d422b9470121d11147e8d/users/936f87df21764327a82fa50d33b68e9f/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:28.643973 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e79ec-0578-4d1f-8fec-eac0ae6e50cd None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:28.644334 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e79ec-0578-4d1f-8fec-eac0ae6e50cd None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:28.644699 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e79ec-0578-4d1f-8fec-eac0ae6e50cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:28.668001 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-551e79ec-0578-4d1f-8fec-eac0ae6e50cd None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:28.669692 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-551e79ec-0578-4d1f-8fec-eac0ae6e50cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:28.779943 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa084cf2-21a1-420a-aea2-e35b9239bad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:28.780431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa084cf2-21a1-420a-aea2-e35b9239bad7 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:28.780823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa084cf2-21a1-420a-aea2-e35b9239bad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:28.782206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa084cf2-21a1-420a-aea2-e35b9239bad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:28.784905 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa084cf2-21a1-420a-aea2-e35b9239bad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:28.786601 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa084cf2-21a1-420a-aea2-e35b9239bad7 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:28.808618 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1033/2067] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:28.809921 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa084cf2-21a1-420a-aea2-e35b9239bad7 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:28.812983 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fa084cf2-21a1-420a-aea2-e35b9239bad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:28.816655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1035/2068] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:47:28.821370 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e79ec-0578-4d1f-8fec-eac0ae6e50cd None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:28.831965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa084cf2-21a1-420a-aea2-e35b9239bad7 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:28.834419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e79ec-0578-4d1f-8fec-eac0ae6e50cd None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:28.837823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ba148-a912-4d2a-9c2d-da2ff4761d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:28.838601 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ba148-a912-4d2a-9c2d-da2ff4761d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:28.838887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ba148-a912-4d2a-9c2d-da2ff4761d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:28.839408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ba148-a912-4d2a-9c2d-da2ff4761d85 admin admin] PATH_INFO: `/v3/projects/201789c0a1ab4cd49d32a95d885a5dde` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:28.839693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9f5dc-3cbe-469e-947b-33e7522d638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:28.840597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ba148-a912-4d2a-9c2d-da2ff4761d85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=201789c0a1ab4cd49d32a95d885a5dde)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:28.840696 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9f5dc-3cbe-469e-947b-33e7522d638f admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:28.840999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9f5dc-3cbe-469e-947b-33e7522d638f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:28.841339 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9f5dc-3cbe-469e-947b-33e7522d638f admin admin] PATH_INFO: `/v3/projects/8336d1b79bcd400aa64fad8449d2162f/users/ac84ddc6c3884b82a7e9af8a23ff9acc/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:28.842638 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ba148-a912-4d2a-9c2d-da2ff4761d85 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:28.859722 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9f5dc-3cbe-469e-947b-33e7522d638f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8336d1b79bcd400aa64fad8449d2162f, user_id=ac84ddc6c3884b82a7e9af8a23ff9acc, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:28.862500 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9f5dc-3cbe-469e-947b-33e7522d638f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:28.878339 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1036/2069] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:28 2022] PUT /identity/v3/projects/8336d1b79bcd400aa64fad8449d2162f/users/ac84ddc6c3884b82a7e9af8a23ff9acc/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:28.881518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9f5dc-3cbe-469e-947b-33e7522d638f admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:28.883745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-20d9f5dc-3cbe-469e-947b-33e7522d638f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:28.911075 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cb3ba148-a912-4d2a-9c2d-da2ff4761d85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '201789c0a1ab4cd49d32a95d885a5dde', 'request_id': 'req-cb3ba148-a912-4d2a-9c2d-da2ff4761d85'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:28.919608 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cb3ba148-a912-4d2a-9c2d-da2ff4761d85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '201789c0a1ab4cd49d32a95d885a5dde', 'request_id': 'req-cb3ba148-a912-4d2a-9c2d-da2ff4761d85'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:28.932314 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cb3ba148-a912-4d2a-9c2d-da2ff4761d85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '201789c0a1ab4cd49d32a95d885a5dde', 'request_id': 'req-cb3ba148-a912-4d2a-9c2d-da2ff4761d85'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:28.955603 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cb3ba148-a912-4d2a-9c2d-da2ff4761d85 admin admin] The token cache is being invalidate because project 201789c0a1ab4cd49d32a95d885a5dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:28.955907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cb3ba148-a912-4d2a-9c2d-da2ff4761d85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:28.957137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cb3ba148-a912-4d2a-9c2d-da2ff4761d85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:28.958855 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1034/2070] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:28 2022] DELETE /identity/v3/projects/201789c0a1ab4cd49d32a95d885a5dde => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:28.963564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1935cd-0510-471a-a3c5-86318e38d498 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:28.964277 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1935cd-0510-471a-a3c5-86318e38d498 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:28.964583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1935cd-0510-471a-a3c5-86318e38d498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:28.966602 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9f5dc-3cbe-469e-947b-33e7522d638f admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:28.991022 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:29.002847 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2c1935cd-0510-471a-a3c5-86318e38d498 None None] MFA Rules not processed for user `ac84ddc6c3884b82a7e9af8a23ff9acc`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:29.006349 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2c1935cd-0510-471a-a3c5-86318e38d498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:29.061016 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe020cba-bc43-4fdb-8552-6876793abac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:29.061871 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe020cba-bc43-4fdb-8552-6876793abac5 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:29.062935 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe020cba-bc43-4fdb-8552-6876793abac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:29.063166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe020cba-bc43-4fdb-8552-6876793abac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:29.065417 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fe020cba-bc43-4fdb-8552-6876793abac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:29.110787 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:29.122363 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1035/2071] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:29.122363 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1935cd-0510-471a-a3c5-86318e38d498 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:29.122363 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2c1935cd-0510-471a-a3c5-86318e38d498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:29.160211 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe020cba-bc43-4fdb-8552-6876793abac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:29.161699 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe020cba-bc43-4fdb-8552-6876793abac5 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:29.173956 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1037/2072] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:29.175216 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe020cba-bc43-4fdb-8552-6876793abac5 service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:29.177010 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fe020cba-bc43-4fdb-8552-6876793abac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:29.191562 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe020cba-bc43-4fdb-8552-6876793abac5 service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:29.203594 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6a037-347a-4f2a-9ce6-62e4721c756a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:29.204232 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6a037-347a-4f2a-9ce6-62e4721c756a admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:29.204758 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6a037-347a-4f2a-9ce6-62e4721c756a admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:29.205241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6a037-347a-4f2a-9ce6-62e4721c756a admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:29.206787 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6a037-347a-4f2a-9ce6-62e4721c756a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:29.211820 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6a037-347a-4f2a-9ce6-62e4721c756a admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:29.217253 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1935cd-0510-471a-a3c5-86318e38d498 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:29.224836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9df939-489a-435e-8303-e146c6c056c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:29.226167 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9df939-489a-435e-8303-e146c6c056c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:29.226430 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9df939-489a-435e-8303-e146c6c056c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:29.226836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9df939-489a-435e-8303-e146c6c056c3 admin admin] PATH_INFO: `/v3/users/bc0f41db0a4245c8bf4a941cf6ec562c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:29.228291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9df939-489a-435e-8303-e146c6c056c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0f41db0a4245c8bf4a941cf6ec562c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:29.230581 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9df939-489a-435e-8303-e146c6c056c3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:29.256165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1038/2073] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:29 2022] POST /identity/v3/projects => generated 393 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:29.260222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6a037-347a-4f2a-9ce6-62e4721c756a admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:29.304931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cc9df939-489a-435e-8303-e146c6c056c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0f41db0a4245c8bf4a941cf6ec562c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:29.315305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cc9df939-489a-435e-8303-e146c6c056c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0f41db0a4245c8bf4a941cf6ec562c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:29.316405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cc9df939-489a-435e-8303-e146c6c056c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0f41db0a4245c8bf4a941cf6ec562c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:29.317166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cc9df939-489a-435e-8303-e146c6c056c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0f41db0a4245c8bf4a941cf6ec562c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:29.325678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cc9df939-489a-435e-8303-e146c6c056c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0f41db0a4245c8bf4a941cf6ec562c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:29.342096 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6a037-347a-4f2a-9ce6-62e4721c756a admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:29.348583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1036/2074] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:29 2022] DELETE /identity/v3/users/bc0f41db0a4245c8bf4a941cf6ec562c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:29.352469 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed643c1-9c40-45fb-a710-3c57b825c7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:29.353313 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed643c1-9c40-45fb-a710-3c57b825c7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:29.353606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed643c1-9c40-45fb-a710-3c57b825c7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:29.353975 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed643c1-9c40-45fb-a710-3c57b825c7c6 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:29.354987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed643c1-9c40-45fb-a710-3c57b825c7c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:29.357043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed643c1-9c40-45fb-a710-3c57b825c7c6 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:29.406969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1039/2075] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:29 2022] POST /identity/v3/users => generated 303 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:29.409979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9df939-489a-435e-8303-e146c6c056c3 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:29.411572 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cc9df939-489a-435e-8303-e146c6c056c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:29.446007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:29.505900 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9df939-489a-435e-8303-e146c6c056c3 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:29.511468 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba68dc2-1858-4311-8f02-9c87cec75040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:29.512353 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba68dc2-1858-4311-8f02-9c87cec75040 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:29.512837 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba68dc2-1858-4311-8f02-9c87cec75040 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:29.513310 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba68dc2-1858-4311-8f02-9c87cec75040 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:29.514227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba68dc2-1858-4311-8f02-9c87cec75040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:29.516794 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba68dc2-1858-4311-8f02-9c87cec75040 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:29.528372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1037/2076] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:29.532541 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed643c1-9c40-45fb-a710-3c57b825c7c6 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:29.544198 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed643c1-9c40-45fb-a710-3c57b825c7c6 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:29.554530 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73cdd5-9b74-4716-9876-0a5164591503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:29.555320 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73cdd5-9b74-4716-9876-0a5164591503 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:29.555591 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73cdd5-9b74-4716-9876-0a5164591503 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:29.555864 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73cdd5-9b74-4716-9876-0a5164591503 admin admin] PATH_INFO: `/v3/projects/fabfc5097e2546eabea417a7757ec211/users/15fe3a6a0cfb4877b882a152f4c711aa/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:29.576984 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73cdd5-9b74-4716-9876-0a5164591503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabfc5097e2546eabea417a7757ec211, user_id=15fe3a6a0cfb4877b882a152f4c711aa, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:29.580356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73cdd5-9b74-4716-9876-0a5164591503 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:29.598425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1040/2077] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:29 2022] PUT /identity/v3/projects/fabfc5097e2546eabea417a7757ec211/users/15fe3a6a0cfb4877b882a152f4c711aa/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:47:29.602326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba68dc2-1858-4311-8f02-9c87cec75040 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:29.614173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba68dc2-1858-4311-8f02-9c87cec75040 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:29.685945 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560992c7-d0cf-4d2c-9056-11f8e48fb019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:29.686517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560992c7-d0cf-4d2c-9056-11f8e48fb019 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:29.686794 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560992c7-d0cf-4d2c-9056-11f8e48fb019 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:29.687062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560992c7-d0cf-4d2c-9056-11f8e48fb019 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:29.688229 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560992c7-d0cf-4d2c-9056-11f8e48fb019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:29.689886 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560992c7-d0cf-4d2c-9056-11f8e48fb019 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:29.700237 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1038/2078] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:29.704768 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73cdd5-9b74-4716-9876-0a5164591503 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:29.728642 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73cdd5-9b74-4716-9876-0a5164591503 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:29.740188 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2df55-9600-487c-90ed-b996f8e5496c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:29.740743 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2df55-9600-487c-90ed-b996f8e5496c admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:29.741082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2df55-9600-487c-90ed-b996f8e5496c admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:29.741981 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2df55-9600-487c-90ed-b996f8e5496c admin admin] PATH_INFO: `/v3/projects/fabfc5097e2546eabea417a7757ec211/users/15fe3a6a0cfb4877b882a152f4c711aa/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:29.744152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2df55-9600-487c-90ed-b996f8e5496c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabfc5097e2546eabea417a7757ec211, user_id=15fe3a6a0cfb4877b882a152f4c711aa, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:29.747085 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2df55-9600-487c-90ed-b996f8e5496c admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:29.759854 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1041/2079] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:29 2022] PUT /identity/v3/projects/fabfc5097e2546eabea417a7757ec211/users/15fe3a6a0cfb4877b882a152f4c711aa/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:29.770855 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c3792-9934-4c5e-8b8c-b2858ef780b9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:29.771145 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c3792-9934-4c5e-8b8c-b2858ef780b9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:29.771418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c3792-9934-4c5e-8b8c-b2858ef780b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:29.786075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2df55-9600-487c-90ed-b996f8e5496c admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:29.787950 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0fd2df55-9600-487c-90ed-b996f8e5496c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:29.805143 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7a6c3792-9934-4c5e-8b8c-b2858ef780b9 None None] MFA Rules not processed for user `15fe3a6a0cfb4877b882a152f4c711aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:29.806503 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7a6c3792-9934-4c5e-8b8c-b2858ef780b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:29.868010 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:29.876860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2df55-9600-487c-90ed-b996f8e5496c admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:29.883232 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79d666-0f19-4fb9-b8e8-0405057cdc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:29.883997 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79d666-0f19-4fb9-b8e8-0405057cdc7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:29.884379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79d666-0f19-4fb9-b8e8-0405057cdc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:29.884881 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79d666-0f19-4fb9-b8e8-0405057cdc7d admin admin] PATH_INFO: `/v3/projects/b4016d5a23244720ae08025ee8984b0b` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:29.886155 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79d666-0f19-4fb9-b8e8-0405057cdc7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4016d5a23244720ae08025ee8984b0b)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:29.888774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79d666-0f19-4fb9-b8e8-0405057cdc7d admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:29.922861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1039/2080] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:29 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:29.931647 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c3792-9934-4c5e-8b8c-b2858ef780b9 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:29.933856 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7a6c3792-9934-4c5e-8b8c-b2858ef780b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:29.966369 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-5c79d666-0f19-4fb9-b8e8-0405057cdc7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4016d5a23244720ae08025ee8984b0b', 'request_id': 'req-5c79d666-0f19-4fb9-b8e8-0405057cdc7d'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:29.974128 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-5c79d666-0f19-4fb9-b8e8-0405057cdc7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4016d5a23244720ae08025ee8984b0b', 'request_id': 'req-5c79d666-0f19-4fb9-b8e8-0405057cdc7d'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:29.991130 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-5c79d666-0f19-4fb9-b8e8-0405057cdc7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4016d5a23244720ae08025ee8984b0b', 'request_id': 'req-5c79d666-0f19-4fb9-b8e8-0405057cdc7d'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:29.997401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:30.010433 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-5c79d666-0f19-4fb9-b8e8-0405057cdc7d admin admin] The token cache is being invalidate because project b4016d5a23244720ae08025ee8984b0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:30.010675 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-5c79d666-0f19-4fb9-b8e8-0405057cdc7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:30.011434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-5c79d666-0f19-4fb9-b8e8-0405057cdc7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:30.017590 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1042/2081] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:29 2022] DELETE /identity/v3/projects/b4016d5a23244720ae08025ee8984b0b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:47:30.018562 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c3792-9934-4c5e-8b8c-b2858ef780b9 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:30.021322 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103b9fb-47ab-4d8b-bbbb-74c3377742d0 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:30.024755 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103b9fb-47ab-4d8b-bbbb-74c3377742d0 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:30.024755 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103b9fb-47ab-4d8b-bbbb-74c3377742d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:30.052236 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-0103b9fb-47ab-4d8b-bbbb-74c3377742d0 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:30.053656 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0103b9fb-47ab-4d8b-bbbb-74c3377742d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:30.119694 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20202d8-ad5e-4e56-885b-f28a4de774a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:30.120495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20202d8-ad5e-4e56-885b-f28a4de774a4 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:30.120814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20202d8-ad5e-4e56-885b-f28a4de774a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:30.121084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20202d8-ad5e-4e56-885b-f28a4de774a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:30.125493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c20202d8-ad5e-4e56-885b-f28a4de774a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:30.168089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1043/2082] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:30.170250 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c840c-fd81-4c95-81fe-b8502026bd5c None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:30.170669 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c840c-fd81-4c95-81fe-b8502026bd5c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:30.171012 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c840c-fd81-4c95-81fe-b8502026bd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:30.223094 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-be5c840c-fd81-4c95-81fe-b8502026bd5c None None] MFA Rules not processed for user `936f87df21764327a82fa50d33b68e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:30.226975 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-be5c840c-fd81-4c95-81fe-b8502026bd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:30.232374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20202d8-ad5e-4e56-885b-f28a4de774a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:30.234550 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20202d8-ad5e-4e56-885b-f28a4de774a4 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:30.247850 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1040/2083] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:29 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 10:47:30.249495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0e5b7-6ad2-4aaf-9643-d16c79deb5cb None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:30.250510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0e5b7-6ad2-4aaf-9643-d16c79deb5cb None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:30.250889 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0e5b7-6ad2-4aaf-9643-d16c79deb5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:30.279729 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-26d0e5b7-6ad2-4aaf-9643-d16c79deb5cb None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:30.281384 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-26d0e5b7-6ad2-4aaf-9643-d16c79deb5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:30.291669 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1041/2084] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:30.296952 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0e5b7-6ad2-4aaf-9643-d16c79deb5cb None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:30.309555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0e5b7-6ad2-4aaf-9643-d16c79deb5cb None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:30.319604 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54c929-b8ac-4fdf-813f-72f2b6070498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:30.320521 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54c929-b8ac-4fdf-813f-72f2b6070498 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:30.320944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54c929-b8ac-4fdf-813f-72f2b6070498 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:30.321465 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54c929-b8ac-4fdf-813f-72f2b6070498 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:30.322419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54c929-b8ac-4fdf-813f-72f2b6070498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:30.322942 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54c929-b8ac-4fdf-813f-72f2b6070498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:30.324814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54c929-b8ac-4fdf-813f-72f2b6070498 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:30.345908 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1042/2085] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:47:30.350880 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54c929-b8ac-4fdf-813f-72f2b6070498 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:30.364601 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54c929-b8ac-4fdf-813f-72f2b6070498 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:30.381025 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202e136-1701-4fda-91bd-0ba9724dc7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:30.383389 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202e136-1701-4fda-91bd-0ba9724dc7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:30.383976 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202e136-1701-4fda-91bd-0ba9724dc7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:30.384501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202e136-1701-4fda-91bd-0ba9724dc7f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:30.385394 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202e136-1701-4fda-91bd-0ba9724dc7f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:30.387794 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202e136-1701-4fda-91bd-0ba9724dc7f8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:30.415070 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1044/2086] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:30.422212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c840c-fd81-4c95-81fe-b8502026bd5c None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:30.425005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-be5c840c-fd81-4c95-81fe-b8502026bd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:30.444056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1043/2087] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:30 2022] POST /identity/v3/projects => generated 389 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:30.445084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202e136-1701-4fda-91bd-0ba9724dc7f8 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:30.447899 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c202e136-1701-4fda-91bd-0ba9724dc7f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:30.449167 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c840c-fd81-4c95-81fe-b8502026bd5c None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:30.466665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:30.529481 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202e136-1701-4fda-91bd-0ba9724dc7f8 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:30.535294 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ce52d-f20a-4c5d-8328-12ae25596798 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:30.536140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ce52d-f20a-4c5d-8328-12ae25596798 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:30.536528 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ce52d-f20a-4c5d-8328-12ae25596798 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:30.536927 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ce52d-f20a-4c5d-8328-12ae25596798 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:30.538762 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58729b9-1901-416d-87ad-ddf2db86ff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:30.539028 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-939ce52d-f20a-4c5d-8328-12ae25596798 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:30.539708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58729b9-1901-416d-87ad-ddf2db86ff40 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:30.540129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58729b9-1901-416d-87ad-ddf2db86ff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:30.540541 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58729b9-1901-416d-87ad-ddf2db86ff40 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:30.541349 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58729b9-1901-416d-87ad-ddf2db86ff40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:30.543247 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58729b9-1901-416d-87ad-ddf2db86ff40 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:30.557897 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:30.577883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1045/2088] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:30 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:30.579887 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58729b9-1901-416d-87ad-ddf2db86ff40 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:30.625478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ce52d-f20a-4c5d-8328-12ae25596798 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:30.626511 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ce52d-f20a-4c5d-8328-12ae25596798 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:30.636332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1044/2089] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:30 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:30.637191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ce52d-f20a-4c5d-8328-12ae25596798 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:30.638613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-939ce52d-f20a-4c5d-8328-12ae25596798 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:30.654283 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ce52d-f20a-4c5d-8328-12ae25596798 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:30.659124 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdfe30-e32f-4905-baa6-77fbed05bb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:30.659805 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdfe30-e32f-4905-baa6-77fbed05bb3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:30.660088 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdfe30-e32f-4905-baa6-77fbed05bb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:30.660363 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdfe30-e32f-4905-baa6-77fbed05bb3c admin admin] PATH_INFO: `/v3/users/e47b29049c704d11a9c4072a174f92ae` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:30.662049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdfe30-e32f-4905-baa6-77fbed05bb3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e47b29049c704d11a9c4072a174f92ae)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:30.662752 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58729b9-1901-416d-87ad-ddf2db86ff40 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:30.664537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdfe30-e32f-4905-baa6-77fbed05bb3c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:30.668611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950e1a-4711-4c61-9c30-e27caeac3d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:30.669547 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950e1a-4711-4c61-9c30-e27caeac3d13 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:30.669829 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950e1a-4711-4c61-9c30-e27caeac3d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:30.670107 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950e1a-4711-4c61-9c30-e27caeac3d13 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:30.670951 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07950e1a-4711-4c61-9c30-e27caeac3d13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:30.673786 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07950e1a-4711-4c61-9c30-e27caeac3d13 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:30.730229 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1046/2090] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:30 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:30.730923 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950e1a-4711-4c61-9c30-e27caeac3d13 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:30.757180 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d7bdfe30-e32f-4905-baa6-77fbed05bb3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e47b29049c704d11a9c4072a174f92ae'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:30.765968 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950e1a-4711-4c61-9c30-e27caeac3d13 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:30.777317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d7bdfe30-e32f-4905-baa6-77fbed05bb3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e47b29049c704d11a9c4072a174f92ae'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:30.778241 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d7bdfe30-e32f-4905-baa6-77fbed05bb3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e47b29049c704d11a9c4072a174f92ae'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:30.779307 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6958d88-83b9-40ef-8582-6a34ffea4e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:30.779838 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d7bdfe30-e32f-4905-baa6-77fbed05bb3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e47b29049c704d11a9c4072a174f92ae'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:30.786628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6958d88-83b9-40ef-8582-6a34ffea4e90 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:30.788128 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6958d88-83b9-40ef-8582-6a34ffea4e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:30.788480 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6958d88-83b9-40ef-8582-6a34ffea4e90 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:30.789489 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6958d88-83b9-40ef-8582-6a34ffea4e90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:30.795485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6958d88-83b9-40ef-8582-6a34ffea4e90 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:30.801432 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d7bdfe30-e32f-4905-baa6-77fbed05bb3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e47b29049c704d11a9c4072a174f92ae'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:30.830348 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1047/2091] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:30 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:30.831084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6958d88-83b9-40ef-8582-6a34ffea4e90 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:30.833665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a6958d88-83b9-40ef-8582-6a34ffea4e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:30.838463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1045/2092] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:30 2022] DELETE /identity/v3/users/e47b29049c704d11a9c4072a174f92ae => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:30.840346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdfe30-e32f-4905-baa6-77fbed05bb3c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:30.843267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d7bdfe30-e32f-4905-baa6-77fbed05bb3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:30.852818 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6958d88-83b9-40ef-8582-6a34ffea4e90 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:30.919667 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e053a-8f5e-4674-8c30-ba4198937eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:30.919977 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e053a-8f5e-4674-8c30-ba4198937eec admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:30.920262 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e053a-8f5e-4674-8c30-ba4198937eec admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:30.920536 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e053a-8f5e-4674-8c30-ba4198937eec admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:30.921300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e053a-8f5e-4674-8c30-ba4198937eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:30.923888 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e053a-8f5e-4674-8c30-ba4198937eec admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:30.934899 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1048/2093] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:30.936078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a01133-a276-40d1-8649-c808f0d7b9b5 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:30.936312 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a01133-a276-40d1-8649-c808f0d7b9b5 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:30.936618 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a01133-a276-40d1-8649-c808f0d7b9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:30.967792 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-b9a01133-a276-40d1-8649-c808f0d7b9b5 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:30.969604 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b9a01133-a276-40d1-8649-c808f0d7b9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:30.979181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1049/2094] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:30.980398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a01133-a276-40d1-8649-c808f0d7b9b5 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:30.980582 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdfe30-e32f-4905-baa6-77fbed05bb3c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:30.987728 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:30.990144 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa89ac-d455-4da0-ad20-5eb1fd6e2a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:30.991404 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa89ac-d455-4da0-ad20-5eb1fd6e2a01 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:30.991830 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa89ac-d455-4da0-ad20-5eb1fd6e2a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:30.992832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa89ac-d455-4da0-ad20-5eb1fd6e2a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:30.993754 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa89ac-d455-4da0-ad20-5eb1fd6e2a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:30.995884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a01133-a276-40d1-8649-c808f0d7b9b5 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:30.996943 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa89ac-d455-4da0-ad20-5eb1fd6e2a01 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:31.004508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774610a4-4fcd-446c-8d5e-00220d3547b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:31.005287 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774610a4-4fcd-446c-8d5e-00220d3547b5 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:31.005817 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774610a4-4fcd-446c-8d5e-00220d3547b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:31.006177 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774610a4-4fcd-446c-8d5e-00220d3547b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:31.006937 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774610a4-4fcd-446c-8d5e-00220d3547b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:31.008661 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774610a4-4fcd-446c-8d5e-00220d3547b5 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:31.015039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1046/2095] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:31.016032 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa89ac-d455-4da0-ad20-5eb1fd6e2a01 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:31.022134 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-73fa89ac-d455-4da0-ad20-5eb1fd6e2a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:31.032481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1050/2096] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:31.037745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774610a4-4fcd-446c-8d5e-00220d3547b5 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:31.051359 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774610a4-4fcd-446c-8d5e-00220d3547b5 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:31.057856 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:31.070066 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d38c0a-435d-49d5-ab5c-23b6f1f8fda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:31.071364 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d38c0a-435d-49d5-ab5c-23b6f1f8fda5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:31.071593 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d38c0a-435d-49d5-ab5c-23b6f1f8fda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:31.072420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d38c0a-435d-49d5-ab5c-23b6f1f8fda5 admin admin] PATH_INFO: `/v3/projects/91568bf133da4b97bb2dd2218d76cb57/users/980f993f8398468fba96cbe806ae9e5a/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:31.092711 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa89ac-d455-4da0-ad20-5eb1fd6e2a01 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:31.092996 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d38c0a-435d-49d5-ab5c-23b6f1f8fda5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91568bf133da4b97bb2dd2218d76cb57, user_id=980f993f8398468fba96cbe806ae9e5a, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:31.096040 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d38c0a-435d-49d5-ab5c-23b6f1f8fda5 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:31.097365 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46410875-d89e-4a30-9102-a6abc03573f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:31.097970 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46410875-d89e-4a30-9102-a6abc03573f0 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:31.098249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46410875-d89e-4a30-9102-a6abc03573f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:31.098515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46410875-d89e-4a30-9102-a6abc03573f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:31.110633 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46410875-d89e-4a30-9102-a6abc03573f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:31.112161 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46410875-d89e-4a30-9102-a6abc03573f0 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:31.115593 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1051/2097] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:31 2022] PUT /identity/v3/projects/91568bf133da4b97bb2dd2218d76cb57/users/980f993f8398468fba96cbe806ae9e5a/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:31.115593 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d38c0a-435d-49d5-ab5c-23b6f1f8fda5 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:31.123244 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1047/2098] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:31.124199 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46410875-d89e-4a30-9102-a6abc03573f0 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:31.135418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46410875-d89e-4a30-9102-a6abc03573f0 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:31.192263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d38c0a-435d-49d5-ab5c-23b6f1f8fda5 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:31.199374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e9934-54c4-4c53-aa31-11f4d214a856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:31.200212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e9934-54c4-4c53-aa31-11f4d214a856 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:31.200763 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e9934-54c4-4c53-aa31-11f4d214a856 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:31.200891 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e9934-54c4-4c53-aa31-11f4d214a856 admin admin] PATH_INFO: `/v3/projects/3f994f8581c04f989d466bee5b223fad/users/7e3f19ef1e41428a9085f73d83d4492c/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:31.211738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4e618-75d2-41cd-8059-e8a1e8734f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:31.212777 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4e618-75d2-41cd-8059-e8a1e8734f54 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:31.213099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4e618-75d2-41cd-8059-e8a1e8734f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:31.213401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4e618-75d2-41cd-8059-e8a1e8734f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:31.214489 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4e618-75d2-41cd-8059-e8a1e8734f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:31.216333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4e618-75d2-41cd-8059-e8a1e8734f54 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:31.217856 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e9934-54c4-4c53-aa31-11f4d214a856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f994f8581c04f989d466bee5b223fad, user_id=7e3f19ef1e41428a9085f73d83d4492c, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:31.221049 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e9934-54c4-4c53-aa31-11f4d214a856 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:31.230773 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1048/2099] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:31.235505 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4e618-75d2-41cd-8059-e8a1e8734f54 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:31.236060 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1052/2100] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:31 2022] PUT /identity/v3/projects/3f994f8581c04f989d466bee5b223fad/users/7e3f19ef1e41428a9085f73d83d4492c/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:31.247405 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbb47f-2770-49a1-ab7e-02e50823bf82 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:31.247543 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4e618-75d2-41cd-8059-e8a1e8734f54 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:31.247627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbb47f-2770-49a1-ab7e-02e50823bf82 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:31.247800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbb47f-2770-49a1-ab7e-02e50823bf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:31.278412 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-43fbb47f-2770-49a1-ab7e-02e50823bf82 None None] MFA Rules not processed for user `7e3f19ef1e41428a9085f73d83d4492c`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:31.279760 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-43fbb47f-2770-49a1-ab7e-02e50823bf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:31.338376 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a35a3-d82a-454c-8900-8cfa7e2c81b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:31.339346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a35a3-d82a-454c-8900-8cfa7e2c81b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:31.339648 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a35a3-d82a-454c-8900-8cfa7e2c81b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:31.340099 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a35a3-d82a-454c-8900-8cfa7e2c81b2 admin admin] PATH_INFO: `/v3/projects/91568bf133da4b97bb2dd2218d76cb57/users/980f993f8398468fba96cbe806ae9e5a/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:31.342758 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a35a3-d82a-454c-8900-8cfa7e2c81b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91568bf133da4b97bb2dd2218d76cb57, user_id=980f993f8398468fba96cbe806ae9e5a, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:31.345758 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a35a3-d82a-454c-8900-8cfa7e2c81b2 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:31.358493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1049/2101] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:31 2022] PUT /identity/v3/projects/91568bf133da4b97bb2dd2218d76cb57/users/980f993f8398468fba96cbe806ae9e5a/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:31.365220 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1053/2102] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:47:31.369701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a35a3-d82a-454c-8900-8cfa7e2c81b2 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:31.442963 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbb47f-2770-49a1-ab7e-02e50823bf82 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:31.444416 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-43fbb47f-2770-49a1-ab7e-02e50823bf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:31.447066 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a35a3-d82a-454c-8900-8cfa7e2c81b2 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:31.448116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:31.454408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d3537-e488-461d-9aaa-04aa5606a10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:31.455579 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d3537-e488-461d-9aaa-04aa5606a10e admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:31.455864 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d3537-e488-461d-9aaa-04aa5606a10e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:31.456319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d3537-e488-461d-9aaa-04aa5606a10e admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:31.457283 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d3537-e488-461d-9aaa-04aa5606a10e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:31.461227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d3537-e488-461d-9aaa-04aa5606a10e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:31.467257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbb47f-2770-49a1-ab7e-02e50823bf82 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:31.473016 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703d73f-22c4-471f-9207-a1221682d524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:31.473823 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703d73f-22c4-471f-9207-a1221682d524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:31.474160 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703d73f-22c4-471f-9207-a1221682d524 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:31.474523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703d73f-22c4-471f-9207-a1221682d524 admin admin] PATH_INFO: `/v3/projects/40ae8b10c2d14a08a15e87fd18205b2e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:31.475851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703d73f-22c4-471f-9207-a1221682d524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40ae8b10c2d14a08a15e87fd18205b2e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:31.478038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703d73f-22c4-471f-9207-a1221682d524 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:31.502884 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1050/2103] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:31 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:31.506205 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d3537-e488-461d-9aaa-04aa5606a10e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:31.539550 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:31.557302 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a703d73f-22c4-471f-9207-a1221682d524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40ae8b10c2d14a08a15e87fd18205b2e', 'request_id': 'req-a703d73f-22c4-471f-9207-a1221682d524'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:31.577209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a703d73f-22c4-471f-9207-a1221682d524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40ae8b10c2d14a08a15e87fd18205b2e', 'request_id': 'req-a703d73f-22c4-471f-9207-a1221682d524'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:31.588159 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a703d73f-22c4-471f-9207-a1221682d524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40ae8b10c2d14a08a15e87fd18205b2e', 'request_id': 'req-a703d73f-22c4-471f-9207-a1221682d524'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:31.601420 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d3537-e488-461d-9aaa-04aa5606a10e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:31.604372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a703d73f-22c4-471f-9207-a1221682d524 admin admin] The token cache is being invalidate because project 40ae8b10c2d14a08a15e87fd18205b2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:31.604854 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a703d73f-22c4-471f-9207-a1221682d524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:31.606114 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a703d73f-22c4-471f-9207-a1221682d524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:31.607901 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1054/2104] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:31 2022] DELETE /identity/v3/projects/40ae8b10c2d14a08a15e87fd18205b2e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:31.612983 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703d73f-22c4-471f-9207-a1221682d524 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:31.614035 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a703d73f-22c4-471f-9207-a1221682d524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:31.695337 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d4604-8678-4592-9074-7ca865590160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:31.695862 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d4604-8678-4592-9074-7ca865590160 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:31.696160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d4604-8678-4592-9074-7ca865590160 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:31.696572 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d4604-8678-4592-9074-7ca865590160 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:31.697183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d4604-8678-4592-9074-7ca865590160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:31.699223 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d4604-8678-4592-9074-7ca865590160 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:31.720076 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703d73f-22c4-471f-9207-a1221682d524 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:31.726943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc57a30-c328-4784-8415-4a782af544ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:31.727701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc57a30-c328-4784-8415-4a782af544ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:31.728073 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc57a30-c328-4784-8415-4a782af544ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:31.728444 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc57a30-c328-4784-8415-4a782af544ae admin admin] PATH_INFO: `/v3/users/27493d2933054192bc1b7b93d659f9a6` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:31.729907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc57a30-c328-4784-8415-4a782af544ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=27493d2933054192bc1b7b93d659f9a6)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:31.731699 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1051/2105] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:31 2022] POST /identity/v3/users => generated 300 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:31.732274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc57a30-c328-4784-8415-4a782af544ae admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:31.732780 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d4604-8678-4592-9074-7ca865590160 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:31.735093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-942d4604-8678-4592-9074-7ca865590160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:31.757156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d4604-8678-4592-9074-7ca865590160 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:31.764715 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c7ac3-f27a-49f7-846f-8ac315985a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:31.765569 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c7ac3-f27a-49f7-846f-8ac315985a0d admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:31.765846 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c7ac3-f27a-49f7-846f-8ac315985a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:31.766119 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c7ac3-f27a-49f7-846f-8ac315985a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:31.766830 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c7ac3-f27a-49f7-846f-8ac315985a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:31.768840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c7ac3-f27a-49f7-846f-8ac315985a0d admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:31.787041 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1052/2106] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:31.787948 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c7ac3-f27a-49f7-846f-8ac315985a0d admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:31.809840 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bdc57a30-c328-4784-8415-4a782af544ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27493d2933054192bc1b7b93d659f9a6'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:31.814604 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c7ac3-f27a-49f7-846f-8ac315985a0d admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:31.819794 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bdc57a30-c328-4784-8415-4a782af544ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27493d2933054192bc1b7b93d659f9a6'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:31.820741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bdc57a30-c328-4784-8415-4a782af544ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27493d2933054192bc1b7b93d659f9a6'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:31.821446 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bdc57a30-c328-4784-8415-4a782af544ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27493d2933054192bc1b7b93d659f9a6'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:31.833636 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a4e6d-edc8-4c66-a969-f08876a8f3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:31.834322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a4e6d-edc8-4c66-a969-f08876a8f3c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:31.834648 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a4e6d-edc8-4c66-a969-f08876a8f3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:31.834957 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a4e6d-edc8-4c66-a969-f08876a8f3c1 admin admin] PATH_INFO: `/v3/projects/63dfad96912248da9c51361a592401b2/users/4fba662124734032a510144183880ec1/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:31.838714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bdc57a30-c328-4784-8415-4a782af544ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27493d2933054192bc1b7b93d659f9a6'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:31.855367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a4e6d-edc8-4c66-a969-f08876a8f3c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63dfad96912248da9c51361a592401b2, user_id=4fba662124734032a510144183880ec1, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:31.859077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a4e6d-edc8-4c66-a969-f08876a8f3c1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:31.865319 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1055/2107] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:31 2022] DELETE /identity/v3/users/27493d2933054192bc1b7b93d659f9a6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:31.877860 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1053/2108] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:31 2022] PUT /identity/v3/projects/63dfad96912248da9c51361a592401b2/users/4fba662124734032a510144183880ec1/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:31.880521 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc57a30-c328-4784-8415-4a782af544ae admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:31.882742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-bdc57a30-c328-4784-8415-4a782af544ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:31.948061 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:31.986505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc57a30-c328-4784-8415-4a782af544ae admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:32.137974 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fe76c-9ac6-4500-ab44-1a6e43bcdcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:32.138878 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fe76c-9ac6-4500-ab44-1a6e43bcdcd3 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:32.139368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fe76c-9ac6-4500-ab44-1a6e43bcdcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:32.139711 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fe76c-9ac6-4500-ab44-1a6e43bcdcd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:32.141014 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fe76c-9ac6-4500-ab44-1a6e43bcdcd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:32.142771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fe76c-9ac6-4500-ab44-1a6e43bcdcd3 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:32.172984 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1056/2109] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:32.175949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a4e6d-edc8-4c66-a969-f08876a8f3c1 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:32.190770 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a4e6d-edc8-4c66-a969-f08876a8f3c1 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:32.205749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9e5d6-6a56-46a2-9b68-fba7240589be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:32.206659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9e5d6-6a56-46a2-9b68-fba7240589be admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:32.206950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9e5d6-6a56-46a2-9b68-fba7240589be admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:32.207593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9e5d6-6a56-46a2-9b68-fba7240589be admin admin] PATH_INFO: `/v3/projects/63dfad96912248da9c51361a592401b2/users/4fba662124734032a510144183880ec1/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:32.212950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9e5d6-6a56-46a2-9b68-fba7240589be admin admin] RBAC: Authorizing `identity:create_grant(project_id=63dfad96912248da9c51361a592401b2, user_id=4fba662124734032a510144183880ec1, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:32.220749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9e5d6-6a56-46a2-9b68-fba7240589be admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:32.237876 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1054/2110] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:32 2022] PUT /identity/v3/projects/63dfad96912248da9c51361a592401b2/users/4fba662124734032a510144183880ec1/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:47:32.248523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba714f4-8158-438a-8ebd-02d02b78a73b None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:32.248924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba714f4-8158-438a-8ebd-02d02b78a73b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:32.249210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba714f4-8158-438a-8ebd-02d02b78a73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:32.279972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-4ba714f4-8158-438a-8ebd-02d02b78a73b None None] MFA Rules not processed for user `4fba662124734032a510144183880ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:32.281838 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-4ba714f4-8158-438a-8ebd-02d02b78a73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:32.356935 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1057/2111] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:32 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:47:32.369668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9e5d6-6a56-46a2-9b68-fba7240589be admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:32.371701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bad9e5d6-6a56-46a2-9b68-fba7240589be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:32.411142 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:32.439592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9e5d6-6a56-46a2-9b68-fba7240589be admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:32.444041 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de17c9-66ff-498c-8e41-0063b1c174b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:32.444927 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de17c9-66ff-498c-8e41-0063b1c174b4 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:32.445391 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de17c9-66ff-498c-8e41-0063b1c174b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:32.445729 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de17c9-66ff-498c-8e41-0063b1c174b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:32.458219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de17c9-66ff-498c-8e41-0063b1c174b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:32.459650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de17c9-66ff-498c-8e41-0063b1c174b4 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:32.471697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1055/2112] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:32.577306 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2330806-795a-4261-b244-f6b64483912f None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:32.578397 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2330806-795a-4261-b244-f6b64483912f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:32.578838 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2330806-795a-4261-b244-f6b64483912f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:32.644516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-f2330806-795a-4261-b244-f6b64483912f None None] MFA Rules not processed for user `980f993f8398468fba96cbe806ae9e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:32.645781 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f2330806-795a-4261-b244-f6b64483912f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:32.678622 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de17c9-66ff-498c-8e41-0063b1c174b4 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:32.680594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-09de17c9-66ff-498c-8e41-0063b1c174b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:32.789340 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:32.800975 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1058/2113] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:32.802046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2330806-795a-4261-b244-f6b64483912f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:32.852311 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de17c9-66ff-498c-8e41-0063b1c174b4 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:32.861923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb89e12-99a2-46e2-8140-8ad3cc298cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:32.862573 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb89e12-99a2-46e2-8140-8ad3cc298cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:32.862847 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb89e12-99a2-46e2-8140-8ad3cc298cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:32.863116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb89e12-99a2-46e2-8140-8ad3cc298cc8 admin admin] PATH_INFO: `/v3/projects/2ff38722bd834e47a2b6b9fc0d69c4a0` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:32.864500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb89e12-99a2-46e2-8140-8ad3cc298cc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff38722bd834e47a2b6b9fc0d69c4a0)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:32.866420 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb89e12-99a2-46e2-8140-8ad3cc298cc8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:32.953663 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2330806-795a-4261-b244-f6b64483912f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:32.966732 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fdb89e12-99a2-46e2-8140-8ad3cc298cc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff38722bd834e47a2b6b9fc0d69c4a0', 'request_id': 'req-fdb89e12-99a2-46e2-8140-8ad3cc298cc8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:32.979067 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fdb89e12-99a2-46e2-8140-8ad3cc298cc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff38722bd834e47a2b6b9fc0d69c4a0', 'request_id': 'req-fdb89e12-99a2-46e2-8140-8ad3cc298cc8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:32.996307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fdb89e12-99a2-46e2-8140-8ad3cc298cc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff38722bd834e47a2b6b9fc0d69c4a0', 'request_id': 'req-fdb89e12-99a2-46e2-8140-8ad3cc298cc8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:33.014026 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fdb89e12-99a2-46e2-8140-8ad3cc298cc8 admin admin] The token cache is being invalidate because project 2ff38722bd834e47a2b6b9fc0d69c4a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:33.014767 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fdb89e12-99a2-46e2-8140-8ad3cc298cc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:33.016252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fdb89e12-99a2-46e2-8140-8ad3cc298cc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:33.018936 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1056/2114] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:32 2022] DELETE /identity/v3/projects/2ff38722bd834e47a2b6b9fc0d69c4a0 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:33.021160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fa8ad-259b-45b9-8d16-8d2bf887f736 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:33.021556 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fa8ad-259b-45b9-8d16-8d2bf887f736 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:33.022196 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fa8ad-259b-45b9-8d16-8d2bf887f736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:33.043843 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-979fa8ad-259b-45b9-8d16-8d2bf887f736 None None] MFA Rules not processed for user `936f87df21764327a82fa50d33b68e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:33.045422 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-979fa8ad-259b-45b9-8d16-8d2bf887f736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:33.092268 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb689e9-91e9-4a7a-a9f4-c506d25efc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:33.093174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb689e9-91e9-4a7a-a9f4-c506d25efc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:33.093639 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb689e9-91e9-4a7a-a9f4-c506d25efc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:33.094027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb689e9-91e9-4a7a-a9f4-c506d25efc82 admin admin] PATH_INFO: `/v3/users/7e3f19ef1e41428a9085f73d83d4492c` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:33.097048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb689e9-91e9-4a7a-a9f4-c506d25efc82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e3f19ef1e41428a9085f73d83d4492c)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:33.099477 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb689e9-91e9-4a7a-a9f4-c506d25efc82 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:33.186057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1057/2115] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:33.186057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbb3ce-2a97-4cc8-9400-fbcf56843775 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:33.186057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbb3ce-2a97-4cc8-9400-fbcf56843775 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:33.186057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbb3ce-2a97-4cc8-9400-fbcf56843775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:33.200743 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ceb689e9-91e9-4a7a-a9f4-c506d25efc82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e3f19ef1e41428a9085f73d83d4492c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:33.212209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ceb689e9-91e9-4a7a-a9f4-c506d25efc82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e3f19ef1e41428a9085f73d83d4492c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:33.212906 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ceb689e9-91e9-4a7a-a9f4-c506d25efc82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e3f19ef1e41428a9085f73d83d4492c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:33.213314 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-29cbb3ce-2a97-4cc8-9400-fbcf56843775 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:33.213624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ceb689e9-91e9-4a7a-a9f4-c506d25efc82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e3f19ef1e41428a9085f73d83d4492c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:33.215031 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-29cbb3ce-2a97-4cc8-9400-fbcf56843775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:33.231492 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1058/2116] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:33.231671 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ceb689e9-91e9-4a7a-a9f4-c506d25efc82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e3f19ef1e41428a9085f73d83d4492c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:33.231771 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbb3ce-2a97-4cc8-9400-fbcf56843775 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:33.231771 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-29cbb3ce-2a97-4cc8-9400-fbcf56843775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:33.237305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:33.275184 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1059/2117] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:32 2022] DELETE /identity/v3/users/7e3f19ef1e41428a9085f73d83d4492c => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:33.281265 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3589f-8637-4295-9a05-4015db480087 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:33.281480 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3589f-8637-4295-9a05-4015db480087 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:33.281762 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3589f-8637-4295-9a05-4015db480087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:33.305397 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-05b3589f-8637-4295-9a05-4015db480087 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:33.306787 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-05b3589f-8637-4295-9a05-4015db480087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:33.342603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:33.391813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbb3ce-2a97-4cc8-9400-fbcf56843775 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:33.430235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1060/2118] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:33.431548 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3777ec-f828-4951-88c4-f9c0a1e8d68e None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:33.431835 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3777ec-f828-4951-88c4-f9c0a1e8d68e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:33.432263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3777ec-f828-4951-88c4-f9c0a1e8d68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:33.461792 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-4c3777ec-f828-4951-88c4-f9c0a1e8d68e None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:33.463391 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-4c3777ec-f828-4951-88c4-f9c0a1e8d68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:33.477201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1061/2119] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:33.477201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3777ec-f828-4951-88c4-f9c0a1e8d68e None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:33.487201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3777ec-f828-4951-88c4-f9c0a1e8d68e None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:33.493463 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2e741-83d9-48d2-8370-2fdbc58d8542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:33.494485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2e741-83d9-48d2-8370-2fdbc58d8542 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:33.494831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2e741-83d9-48d2-8370-2fdbc58d8542 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:33.495290 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2e741-83d9-48d2-8370-2fdbc58d8542 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:33.496232 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2e741-83d9-48d2-8370-2fdbc58d8542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:33.496723 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2e741-83d9-48d2-8370-2fdbc58d8542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:33.498996 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2e741-83d9-48d2-8370-2fdbc58d8542 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:33.502949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3c53d-65c0-4d31-ae2f-020863490def service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:33.503595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3c53d-65c0-4d31-ae2f-020863490def service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:33.503874 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3c53d-65c0-4d31-ae2f-020863490def service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:33.504147 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3c53d-65c0-4d31-ae2f-020863490def service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:33.506190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f5e3c53d-65c0-4d31-ae2f-020863490def service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:33.516871 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1062/2120] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:47:33.517877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2e741-83d9-48d2-8370-2fdbc58d8542 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:33.531380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2e741-83d9-48d2-8370-2fdbc58d8542 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:33.537809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad49045-58a9-4db8-b290-66aeaf5b680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:33.538599 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad49045-58a9-4db8-b290-66aeaf5b680e admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:33.539211 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad49045-58a9-4db8-b290-66aeaf5b680e admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:33.539211 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad49045-58a9-4db8-b290-66aeaf5b680e admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:33.539636 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad49045-58a9-4db8-b290-66aeaf5b680e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:33.541738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad49045-58a9-4db8-b290-66aeaf5b680e admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:33.573358 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1063/2121] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:33 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:47:33.574329 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad49045-58a9-4db8-b290-66aeaf5b680e admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:33.578286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0ad49045-58a9-4db8-b290-66aeaf5b680e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:33.593401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3c53d-65c0-4d31-ae2f-020863490def service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:33.595232 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3c53d-65c0-4d31-ae2f-020863490def service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:33.605267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1059/2122] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:33.606257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3c53d-65c0-4d31-ae2f-020863490def service nova] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:33.618214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3c53d-65c0-4d31-ae2f-020863490def service nova] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:33.660351 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:33.662129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad49045-58a9-4db8-b290-66aeaf5b680e admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:33.673149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7509765-8681-4cd0-b94d-285f57b1513a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:33.673969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7509765-8681-4cd0-b94d-285f57b1513a service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:33.674405 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7509765-8681-4cd0-b94d-285f57b1513a service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:33.674829 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7509765-8681-4cd0-b94d-285f57b1513a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:33.689068 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72ce19-4e14-4b50-a022-a2e36a025eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:33.689689 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72ce19-4e14-4b50-a022-a2e36a025eec admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:33.689974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72ce19-4e14-4b50-a022-a2e36a025eec admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:33.690247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72ce19-4e14-4b50-a022-a2e36a025eec admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:33.691155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72ce19-4e14-4b50-a022-a2e36a025eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:33.692988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72ce19-4e14-4b50-a022-a2e36a025eec admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:33.728641 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1060/2123] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:33 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:33.732270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72ce19-4e14-4b50-a022-a2e36a025eec admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:33.743748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72ce19-4e14-4b50-a022-a2e36a025eec admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:33.748814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17638d76-1a9c-4938-8909-f4aac40b1c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:33.749405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17638d76-1a9c-4938-8909-f4aac40b1c88 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:33.750259 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7509765-8681-4cd0-b94d-285f57b1513a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:33.750371 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17638d76-1a9c-4938-8909-f4aac40b1c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:33.750618 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17638d76-1a9c-4938-8909-f4aac40b1c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:33.751312 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17638d76-1a9c-4938-8909-f4aac40b1c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:33.752580 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7509765-8681-4cd0-b94d-285f57b1513a service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:33.752919 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17638d76-1a9c-4938-8909-f4aac40b1c88 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:33.766767 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1061/2125] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 10:47:33.766969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1064/2125] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:33.768750 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17638d76-1a9c-4938-8909-f4aac40b1c88 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:33.779306 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17638d76-1a9c-4938-8909-f4aac40b1c88 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:33.784118 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6419b06-5b48-4bda-ad5e-2b05a32f2c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:33.784758 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6419b06-5b48-4bda-ad5e-2b05a32f2c4f admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:33.785053 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6419b06-5b48-4bda-ad5e-2b05a32f2c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:33.785325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6419b06-5b48-4bda-ad5e-2b05a32f2c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:33.785958 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6419b06-5b48-4bda-ad5e-2b05a32f2c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:33.787573 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6419b06-5b48-4bda-ad5e-2b05a32f2c4f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:33.798976 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1062/2126] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 10:47:33.803113 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7509765-8681-4cd0-b94d-285f57b1513a service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:33.814002 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7509765-8681-4cd0-b94d-285f57b1513a service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:33.818850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b976f-2c93-4733-9e51-bde5ab32eb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:33.819552 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b976f-2c93-4733-9e51-bde5ab32eb2f admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:33.819835 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b976f-2c93-4733-9e51-bde5ab32eb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:33.820113 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b976f-2c93-4733-9e51-bde5ab32eb2f admin admin] PATH_INFO: `/v3/projects/6d163c6b72914ee2949f3ebb93a475fd/users/5ee4a9b1d2284ff4aad93bff1e85685a/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:33.837319 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b976f-2c93-4733-9e51-bde5ab32eb2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d163c6b72914ee2949f3ebb93a475fd, user_id=5ee4a9b1d2284ff4aad93bff1e85685a, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:33.840291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b976f-2c93-4733-9e51-bde5ab32eb2f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:33.855007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1065/2127] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:33 2022] PUT /identity/v3/projects/6d163c6b72914ee2949f3ebb93a475fd/users/5ee4a9b1d2284ff4aad93bff1e85685a/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:33.867271 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f89432-9915-471f-b997-d16390532f5c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:33.867556 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f89432-9915-471f-b997-d16390532f5c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:33.867854 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f89432-9915-471f-b997-d16390532f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:33.897689 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d6f89432-9915-471f-b997-d16390532f5c None None] MFA Rules not processed for user `5ee4a9b1d2284ff4aad93bff1e85685a`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:33.898920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d6f89432-9915-471f-b997-d16390532f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:33.974155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1063/2128] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:33.975763 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b976f-2c93-4733-9e51-bde5ab32eb2f admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:33.987557 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:34.042715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b976f-2c93-4733-9e51-bde5ab32eb2f admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:34.048380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b3f62-3e4f-4c78-a5b4-14b68902c64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:34.049652 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b3f62-3e4f-4c78-a5b4-14b68902c64a admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:34.049652 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b3f62-3e4f-4c78-a5b4-14b68902c64a admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:34.050632 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b3f62-3e4f-4c78-a5b4-14b68902c64a admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:34.051372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b3f62-3e4f-4c78-a5b4-14b68902c64a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:34.053441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b3f62-3e4f-4c78-a5b4-14b68902c64a admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:34.083867 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1066/2129] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:33 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:34.085321 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f89432-9915-471f-b997-d16390532f5c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:34.103581 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f89432-9915-471f-b997-d16390532f5c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:34.235015 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a76fd5-7616-4813-ae28-3b91742722c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:34.235692 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a76fd5-7616-4813-ae28-3b91742722c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:34.236015 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a76fd5-7616-4813-ae28-3b91742722c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:34.236463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a76fd5-7616-4813-ae28-3b91742722c0 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:34.237248 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a76fd5-7616-4813-ae28-3b91742722c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:34.239534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a76fd5-7616-4813-ae28-3b91742722c0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:34.284053 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1064/2130] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:34 2022] POST /identity/v3/users => generated 298 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:34.289325 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b3f62-3e4f-4c78-a5b4-14b68902c64a admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:34.303106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b3f62-3e4f-4c78-a5b4-14b68902c64a admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:34.310719 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8310e91-7b5c-49e4-8051-7e2ca976c8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:34.311376 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8310e91-7b5c-49e4-8051-7e2ca976c8df admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:34.311655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8310e91-7b5c-49e4-8051-7e2ca976c8df admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:34.312440 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8310e91-7b5c-49e4-8051-7e2ca976c8df admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:34.313180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8310e91-7b5c-49e4-8051-7e2ca976c8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:34.314812 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8310e91-7b5c-49e4-8051-7e2ca976c8df admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:34.336761 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1067/2131] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:34.340726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a76fd5-7616-4813-ae28-3b91742722c0 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:34.362802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a76fd5-7616-4813-ae28-3b91742722c0 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:34.381745 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d19627-807a-48e3-9835-4eca41a69a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:34.384907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d19627-807a-48e3-9835-4eca41a69a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:34.385555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d19627-807a-48e3-9835-4eca41a69a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:34.385688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d19627-807a-48e3-9835-4eca41a69a88 admin admin] PATH_INFO: `/v3/projects/31cc87ba4f7342dc8c1d9ddb03f67cd9/users/9a0a068d80634a3eb4c012aa9dfb7598/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:34.407140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d19627-807a-48e3-9835-4eca41a69a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31cc87ba4f7342dc8c1d9ddb03f67cd9, user_id=9a0a068d80634a3eb4c012aa9dfb7598, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:34.410241 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d19627-807a-48e3-9835-4eca41a69a88 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:34.421021 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:34.428804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1065/2132] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:34 2022] PUT /identity/v3/projects/31cc87ba4f7342dc8c1d9ddb03f67cd9/users/9a0a068d80634a3eb4c012aa9dfb7598/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:34.432406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8310e91-7b5c-49e4-8051-7e2ca976c8df admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:34.448417 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8310e91-7b5c-49e4-8051-7e2ca976c8df admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:34.581695 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e31b7a-1f98-451a-ae75-790a1ca36f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:34.582351 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e31b7a-1f98-451a-ae75-790a1ca36f07 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:34.582582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e31b7a-1f98-451a-ae75-790a1ca36f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:34.582970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e31b7a-1f98-451a-ae75-790a1ca36f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:34.583502 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e31b7a-1f98-451a-ae75-790a1ca36f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:34.585098 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e31b7a-1f98-451a-ae75-790a1ca36f07 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:34.620709 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1068/2133] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:34.621428 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d19627-807a-48e3-9835-4eca41a69a88 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:34.637966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d19627-807a-48e3-9835-4eca41a69a88 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:34.645630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabf4e6-db27-47ff-a7e7-eb70bd41d4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:34.646360 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabf4e6-db27-47ff-a7e7-eb70bd41d4d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:34.646620 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabf4e6-db27-47ff-a7e7-eb70bd41d4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:34.646889 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabf4e6-db27-47ff-a7e7-eb70bd41d4d4 admin admin] PATH_INFO: `/v3/projects/31cc87ba4f7342dc8c1d9ddb03f67cd9/users/9a0a068d80634a3eb4c012aa9dfb7598/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:34.650298 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbabf4e6-db27-47ff-a7e7-eb70bd41d4d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31cc87ba4f7342dc8c1d9ddb03f67cd9, user_id=9a0a068d80634a3eb4c012aa9dfb7598, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:34.653630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbabf4e6-db27-47ff-a7e7-eb70bd41d4d4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:34.672596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1066/2134] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:34 2022] PUT /identity/v3/projects/31cc87ba4f7342dc8c1d9ddb03f67cd9/users/9a0a068d80634a3eb4c012aa9dfb7598/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:34.682518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368161b-f6c4-42c1-9371-682b40588464 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:34.682803 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368161b-f6c4-42c1-9371-682b40588464 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:34.683075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368161b-f6c4-42c1-9371-682b40588464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:34.720380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-9368161b-f6c4-42c1-9371-682b40588464 None None] MFA Rules not processed for user `9a0a068d80634a3eb4c012aa9dfb7598`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:34.724541 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9368161b-f6c4-42c1-9371-682b40588464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:34.785102 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabf4e6-db27-47ff-a7e7-eb70bd41d4d4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:34.796232 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-dbabf4e6-db27-47ff-a7e7-eb70bd41d4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:34.916649 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1069/2135] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:34.917519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368161b-f6c4-42c1-9371-682b40588464 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:34.922510 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9368161b-f6c4-42c1-9371-682b40588464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:34.965084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:34.996131 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabf4e6-db27-47ff-a7e7-eb70bd41d4d4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:35.014898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15327c-40f4-4fe2-8994-90ce551d5472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:35.014898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15327c-40f4-4fe2-8994-90ce551d5472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:35.014898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15327c-40f4-4fe2-8994-90ce551d5472 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:35.014898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15327c-40f4-4fe2-8994-90ce551d5472 admin admin] PATH_INFO: `/v3/users/ac84ddc6c3884b82a7e9af8a23ff9acc` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:35.017963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15327c-40f4-4fe2-8994-90ce551d5472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac84ddc6c3884b82a7e9af8a23ff9acc)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:35.019894 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15327c-40f4-4fe2-8994-90ce551d5472 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:35.126540 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ef15327c-40f4-4fe2-8994-90ce551d5472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac84ddc6c3884b82a7e9af8a23ff9acc'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:35.137214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ef15327c-40f4-4fe2-8994-90ce551d5472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac84ddc6c3884b82a7e9af8a23ff9acc'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:35.139394 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ef15327c-40f4-4fe2-8994-90ce551d5472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac84ddc6c3884b82a7e9af8a23ff9acc'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:35.140918 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ef15327c-40f4-4fe2-8994-90ce551d5472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac84ddc6c3884b82a7e9af8a23ff9acc'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:35.153557 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368161b-f6c4-42c1-9371-682b40588464 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:35.167665 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ef15327c-40f4-4fe2-8994-90ce551d5472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac84ddc6c3884b82a7e9af8a23ff9acc'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:35.178555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964626b-11dd-44e0-820b-ed9b82f9b6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:35.179221 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964626b-11dd-44e0-820b-ed9b82f9b6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:35.179501 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964626b-11dd-44e0-820b-ed9b82f9b6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:35.179771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964626b-11dd-44e0-820b-ed9b82f9b6d5 admin admin] PATH_INFO: `/v3/projects/3f994f8581c04f989d466bee5b223fad` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:35.182080 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964626b-11dd-44e0-820b-ed9b82f9b6d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f994f8581c04f989d466bee5b223fad)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:35.183999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964626b-11dd-44e0-820b-ed9b82f9b6d5 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:35.191299 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1067/2136] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:34 2022] DELETE /identity/v3/users/ac84ddc6c3884b82a7e9af8a23ff9acc => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:35.194141 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15327c-40f4-4fe2-8994-90ce551d5472 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:35.196089 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ef15327c-40f4-4fe2-8994-90ce551d5472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:35.298726 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8964626b-11dd-44e0-820b-ed9b82f9b6d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f994f8581c04f989d466bee5b223fad', 'request_id': 'req-8964626b-11dd-44e0-820b-ed9b82f9b6d5'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:35.308202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8964626b-11dd-44e0-820b-ed9b82f9b6d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f994f8581c04f989d466bee5b223fad', 'request_id': 'req-8964626b-11dd-44e0-820b-ed9b82f9b6d5'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:35.320492 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8964626b-11dd-44e0-820b-ed9b82f9b6d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f994f8581c04f989d466bee5b223fad', 'request_id': 'req-8964626b-11dd-44e0-820b-ed9b82f9b6d5'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:35.334713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15327c-40f4-4fe2-8994-90ce551d5472 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:35.353537 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8964626b-11dd-44e0-820b-ed9b82f9b6d5 admin admin] The token cache is being invalidate because project 3f994f8581c04f989d466bee5b223fad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:35.353841 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8964626b-11dd-44e0-820b-ed9b82f9b6d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:35.356314 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8964626b-11dd-44e0-820b-ed9b82f9b6d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:35.357969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1070/2137] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:34 2022] DELETE /identity/v3/projects/3f994f8581c04f989d466bee5b223fad => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:35.359316 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2298bf-08ad-4f2c-a297-6bbeb50547d2 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:35.359603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2298bf-08ad-4f2c-a297-6bbeb50547d2 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:35.359873 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2298bf-08ad-4f2c-a297-6bbeb50547d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:35.374608 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:35.412258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-fe2298bf-08ad-4f2c-a297-6bbeb50547d2 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:35.413567 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fe2298bf-08ad-4f2c-a297-6bbeb50547d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:35.460816 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23c603-acf9-4466-9aa4-fcd62eaf3123 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:35.461467 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23c603-acf9-4466-9aa4-fcd62eaf3123 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:35.461812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23c603-acf9-4466-9aa4-fcd62eaf3123 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:35.462090 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23c603-acf9-4466-9aa4-fcd62eaf3123 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:35.466163 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-dd23c603-acf9-4466-9aa4-fcd62eaf3123 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:35.546310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1071/2138] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:35.548823 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2298bf-08ad-4f2c-a297-6bbeb50547d2 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:35.553749 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fe2298bf-08ad-4f2c-a297-6bbeb50547d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:35.566802 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2298bf-08ad-4f2c-a297-6bbeb50547d2 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:35.572652 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c231ae-f788-431e-8669-d5d657804180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:35.573299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c231ae-f788-431e-8669-d5d657804180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:35.573684 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c231ae-f788-431e-8669-d5d657804180 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:35.574063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c231ae-f788-431e-8669-d5d657804180 admin admin] PATH_INFO: `/v3/users/4fba662124734032a510144183880ec1` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:35.575307 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c231ae-f788-431e-8669-d5d657804180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fba662124734032a510144183880ec1)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:35.579854 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c231ae-f788-431e-8669-d5d657804180 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:35.589762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23c603-acf9-4466-9aa4-fcd62eaf3123 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:35.591369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23c603-acf9-4466-9aa4-fcd62eaf3123 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:35.628064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1068/2139] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:35.629185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23c603-acf9-4466-9aa4-fcd62eaf3123 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:35.630831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-dd23c603-acf9-4466-9aa4-fcd62eaf3123 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:35.637441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:35.678200 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a4c231ae-f788-431e-8669-d5d657804180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fba662124734032a510144183880ec1'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:35.691976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a4c231ae-f788-431e-8669-d5d657804180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fba662124734032a510144183880ec1'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:35.693173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a4c231ae-f788-431e-8669-d5d657804180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fba662124734032a510144183880ec1'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:35.694242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a4c231ae-f788-431e-8669-d5d657804180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fba662124734032a510144183880ec1'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:35.713011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a4c231ae-f788-431e-8669-d5d657804180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fba662124734032a510144183880ec1'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:35.739873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23c603-acf9-4466-9aa4-fcd62eaf3123 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:35.744298 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1072/2140] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:35 2022] DELETE /identity/v3/users/4fba662124734032a510144183880ec1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:35.746360 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f51f8-6ba7-4019-95f7-353286f91db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:35.748064 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c231ae-f788-431e-8669-d5d657804180 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:35.759728 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f51f8-6ba7-4019-95f7-353286f91db7 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:35.760716 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f51f8-6ba7-4019-95f7-353286f91db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:35.761144 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f51f8-6ba7-4019-95f7-353286f91db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:35.761551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a4c231ae-f788-431e-8669-d5d657804180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:35.767157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b08f51f8-6ba7-4019-95f7-353286f91db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:35.797832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f51f8-6ba7-4019-95f7-353286f91db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:35.800395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f51f8-6ba7-4019-95f7-353286f91db7 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:35.825732 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1069/2141] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:35.888941 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c231ae-f788-431e-8669-d5d657804180 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:35.903126 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e8177-538d-4067-85f9-f30524c8ef3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:35.904061 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e8177-538d-4067-85f9-f30524c8ef3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:35.904456 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e8177-538d-4067-85f9-f30524c8ef3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:35.904838 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e8177-538d-4067-85f9-f30524c8ef3b admin admin] PATH_INFO: `/v3/users/5ee4a9b1d2284ff4aad93bff1e85685a` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:35.906840 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e8177-538d-4067-85f9-f30524c8ef3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee4a9b1d2284ff4aad93bff1e85685a)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:35.909022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e8177-538d-4067-85f9-f30524c8ef3b admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:35.989904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d02e8177-538d-4067-85f9-f30524c8ef3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee4a9b1d2284ff4aad93bff1e85685a'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:36.005649 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d02e8177-538d-4067-85f9-f30524c8ef3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee4a9b1d2284ff4aad93bff1e85685a'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:36.006889 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d02e8177-538d-4067-85f9-f30524c8ef3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee4a9b1d2284ff4aad93bff1e85685a'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:36.008087 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d02e8177-538d-4067-85f9-f30524c8ef3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee4a9b1d2284ff4aad93bff1e85685a'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:36.033530 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d02e8177-538d-4067-85f9-f30524c8ef3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee4a9b1d2284ff4aad93bff1e85685a'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:36.066844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1073/2142] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:35 2022] DELETE /identity/v3/users/5ee4a9b1d2284ff4aad93bff1e85685a => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:36.072459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572159d6-35ac-4090-88f1-b2c15020ee31 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:36.072823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572159d6-35ac-4090-88f1-b2c15020ee31 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:36.073105 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572159d6-35ac-4090-88f1-b2c15020ee31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:36.104053 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-572159d6-35ac-4090-88f1-b2c15020ee31 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:36.107352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-572159d6-35ac-4090-88f1-b2c15020ee31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:36.217056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1070/2143] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:36.249037 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e8177-538d-4067-85f9-f30524c8ef3b admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:36.251522 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d02e8177-538d-4067-85f9-f30524c8ef3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:36.316852 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:36.379018 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e8177-538d-4067-85f9-f30524c8ef3b admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:36.386087 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a728f41-7adf-4cf3-8eaf-c49654125c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:36.386713 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a728f41-7adf-4cf3-8eaf-c49654125c9f service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:36.386991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a728f41-7adf-4cf3-8eaf-c49654125c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:36.387265 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a728f41-7adf-4cf3-8eaf-c49654125c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:36.404723 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a728f41-7adf-4cf3-8eaf-c49654125c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:36.408420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a728f41-7adf-4cf3-8eaf-c49654125c9f service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:36.421543 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1074/2144] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:36.938466 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572159d6-35ac-4090-88f1-b2c15020ee31 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:36.940199 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-572159d6-35ac-4090-88f1-b2c15020ee31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:36.958411 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572159d6-35ac-4090-88f1-b2c15020ee31 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:36.975324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32db6d-0e04-4009-8112-582f132cb319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:36.975994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32db6d-0e04-4009-8112-582f132cb319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:36.976272 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32db6d-0e04-4009-8112-582f132cb319 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:36.976563 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32db6d-0e04-4009-8112-582f132cb319 admin admin] PATH_INFO: `/v3/projects/63dfad96912248da9c51361a592401b2` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:36.982893 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32db6d-0e04-4009-8112-582f132cb319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63dfad96912248da9c51361a592401b2)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:36.985481 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32db6d-0e04-4009-8112-582f132cb319 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:37.007311 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:37.115119 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cc32db6d-0e04-4009-8112-582f132cb319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63dfad96912248da9c51361a592401b2', 'request_id': 'req-cc32db6d-0e04-4009-8112-582f132cb319'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:37.132075 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cc32db6d-0e04-4009-8112-582f132cb319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63dfad96912248da9c51361a592401b2', 'request_id': 'req-cc32db6d-0e04-4009-8112-582f132cb319'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:37.144050 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cc32db6d-0e04-4009-8112-582f132cb319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63dfad96912248da9c51361a592401b2', 'request_id': 'req-cc32db6d-0e04-4009-8112-582f132cb319'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:37.160894 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cc32db6d-0e04-4009-8112-582f132cb319 admin admin] The token cache is being invalidate because project 63dfad96912248da9c51361a592401b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:37.161222 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cc32db6d-0e04-4009-8112-582f132cb319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:37.162492 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cc32db6d-0e04-4009-8112-582f132cb319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:37.169598 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1071/2145] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:36 2022] DELETE /identity/v3/projects/63dfad96912248da9c51361a592401b2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:37.170643 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63c62d-7505-43e0-a4d8-cc1527e49c4c None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:37.171104 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63c62d-7505-43e0-a4d8-cc1527e49c4c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:37.171912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63c62d-7505-43e0-a4d8-cc1527e49c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:37.198899 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-cb63c62d-7505-43e0-a4d8-cc1527e49c4c None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:37.201239 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-cb63c62d-7505-43e0-a4d8-cc1527e49c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:37.237996 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32db6d-0e04-4009-8112-582f132cb319 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:37.239545 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cc32db6d-0e04-4009-8112-582f132cb319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:37.386056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1075/2146] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:37.401487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef94b23-4623-4fd1-b9dd-1421d4c473b2 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:37.401685 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef94b23-4623-4fd1-b9dd-1421d4c473b2 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:37.401959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef94b23-4623-4fd1-b9dd-1421d4c473b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:37.447246 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-eef94b23-4623-4fd1-b9dd-1421d4c473b2 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:37.449701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32db6d-0e04-4009-8112-582f132cb319 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:37.453334 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-eef94b23-4623-4fd1-b9dd-1421d4c473b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:37.455441 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e094a9-46d7-4e27-a39d-a6bd588c4467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:37.456295 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e094a9-46d7-4e27-a39d-a6bd588c4467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:37.457288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e094a9-46d7-4e27-a39d-a6bd588c4467 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:37.457288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e094a9-46d7-4e27-a39d-a6bd588c4467 admin admin] PATH_INFO: `/v3/projects/8336d1b79bcd400aa64fad8449d2162f` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:37.458542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e094a9-46d7-4e27-a39d-a6bd588c4467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8336d1b79bcd400aa64fad8449d2162f)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:37.461020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e094a9-46d7-4e27-a39d-a6bd588c4467 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:37.464840 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1076/2147] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:37.469720 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef94b23-4623-4fd1-b9dd-1421d4c473b2 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:37.500111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef94b23-4623-4fd1-b9dd-1421d4c473b2 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:37.506089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442342e-5794-45a7-8e52-27beea1c7c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:37.506769 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442342e-5794-45a7-8e52-27beea1c7c99 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:37.507116 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442342e-5794-45a7-8e52-27beea1c7c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:37.507453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442342e-5794-45a7-8e52-27beea1c7c99 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:37.508176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442342e-5794-45a7-8e52-27beea1c7c99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:37.508569 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442342e-5794-45a7-8e52-27beea1c7c99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:37.510943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442342e-5794-45a7-8e52-27beea1c7c99 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:37.528928 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1077/2148] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:47:37.533338 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442342e-5794-45a7-8e52-27beea1c7c99 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:37.545008 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442342e-5794-45a7-8e52-27beea1c7c99 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:37.557684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c4e094a9-46d7-4e27-a39d-a6bd588c4467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8336d1b79bcd400aa64fad8449d2162f', 'request_id': 'req-c4e094a9-46d7-4e27-a39d-a6bd588c4467'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:37.588324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c4e094a9-46d7-4e27-a39d-a6bd588c4467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8336d1b79bcd400aa64fad8449d2162f', 'request_id': 'req-c4e094a9-46d7-4e27-a39d-a6bd588c4467'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:37.604214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c4e094a9-46d7-4e27-a39d-a6bd588c4467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8336d1b79bcd400aa64fad8449d2162f', 'request_id': 'req-c4e094a9-46d7-4e27-a39d-a6bd588c4467'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:37.618059 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c4e094a9-46d7-4e27-a39d-a6bd588c4467 admin admin] The token cache is being invalidate because project 8336d1b79bcd400aa64fad8449d2162f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:37.618352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c4e094a9-46d7-4e27-a39d-a6bd588c4467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:37.619111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c4e094a9-46d7-4e27-a39d-a6bd588c4467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:37.621081 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1072/2149] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:37 2022] DELETE /identity/v3/projects/8336d1b79bcd400aa64fad8449d2162f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:37.627841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e094a9-46d7-4e27-a39d-a6bd588c4467 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:37.634109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c4e094a9-46d7-4e27-a39d-a6bd588c4467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:37.673660 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f49db-31d3-4228-977b-721a9b46d6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:37.675100 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f49db-31d3-4228-977b-721a9b46d6ca admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:37.677031 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f49db-31d3-4228-977b-721a9b46d6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:37.680460 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f49db-31d3-4228-977b-721a9b46d6ca admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:37.681772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f49db-31d3-4228-977b-721a9b46d6ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:37.685663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:37.690676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f49db-31d3-4228-977b-721a9b46d6ca admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:37.747806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e094a9-46d7-4e27-a39d-a6bd588c4467 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:37.762007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1078/2150] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:37 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:37.763417 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f49db-31d3-4228-977b-721a9b46d6ca admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:37.763719 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7babc8b-7127-4b56-8234-6d66ee099573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:37.764635 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7babc8b-7127-4b56-8234-6d66ee099573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:37.765705 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7babc8b-7127-4b56-8234-6d66ee099573 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:37.766054 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7babc8b-7127-4b56-8234-6d66ee099573 admin admin] PATH_INFO: `/v3/users/15fe3a6a0cfb4877b882a152f4c711aa` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:37.766394 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fa6f49db-31d3-4228-977b-721a9b46d6ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:37.769305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7babc8b-7127-4b56-8234-6d66ee099573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15fe3a6a0cfb4877b882a152f4c711aa)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:37.772412 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7babc8b-7127-4b56-8234-6d66ee099573 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:37.839808 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:37.876276 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f49db-31d3-4228-977b-721a9b46d6ca admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:37.882335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac80b4-4d63-458b-ad15-35bcc19a5ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:37.882967 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac80b4-4d63-458b-ad15-35bcc19a5ebd admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:37.883234 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac80b4-4d63-458b-ad15-35bcc19a5ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:37.883519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac80b4-4d63-458b-ad15-35bcc19a5ebd admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:37.883651 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a7babc8b-7127-4b56-8234-6d66ee099573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15fe3a6a0cfb4877b882a152f4c711aa'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:37.884316 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac80b4-4d63-458b-ad15-35bcc19a5ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:37.886319 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac80b4-4d63-458b-ad15-35bcc19a5ebd admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:37.894416 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a7babc8b-7127-4b56-8234-6d66ee099573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15fe3a6a0cfb4877b882a152f4c711aa'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:37.895427 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a7babc8b-7127-4b56-8234-6d66ee099573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15fe3a6a0cfb4877b882a152f4c711aa'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:37.896153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a7babc8b-7127-4b56-8234-6d66ee099573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15fe3a6a0cfb4877b882a152f4c711aa'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:37.908971 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a7babc8b-7127-4b56-8234-6d66ee099573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15fe3a6a0cfb4877b882a152f4c711aa'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:37.928730 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1079/2151] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:37 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:37.930240 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac80b4-4d63-458b-ad15-35bcc19a5ebd admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:37.933400 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-1eac80b4-4d63-458b-ad15-35bcc19a5ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:37.943581 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1073/2152] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:37 2022] DELETE /identity/v3/users/15fe3a6a0cfb4877b882a152f4c711aa => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:47:37.950177 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac80b4-4d63-458b-ad15-35bcc19a5ebd admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:37.994688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18218275-2081-4b68-b0e6-c11d0599c5a4 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:37.995178 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18218275-2081-4b68-b0e6-c11d0599c5a4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:37.995610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18218275-2081-4b68-b0e6-c11d0599c5a4 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:37.997686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1074/2153] 10.222.0.20 () {54 vars in 921 bytes} [Sun Sep 11 10:47:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:47:38.013086 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18a7c2-2767-4f0e-9ae1-986cba9afa44 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:38.013522 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18a7c2-2767-4f0e-9ae1-986cba9afa44 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:38.014305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18a7c2-2767-4f0e-9ae1-986cba9afa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:38.047564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-fa18a7c2-2767-4f0e-9ae1-986cba9afa44 None None] MFA Rules not processed for user `7f0211a05cca4e72b30d64eef4ba527c`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:38.048936 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fa18a7c2-2767-4f0e-9ae1-986cba9afa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:38.052974 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98b7e1-32cd-4687-9bc6-d3ef7eb66008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:38.053703 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98b7e1-32cd-4687-9bc6-d3ef7eb66008 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:38.054109 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98b7e1-32cd-4687-9bc6-d3ef7eb66008 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:38.054389 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98b7e1-32cd-4687-9bc6-d3ef7eb66008 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:38.055050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98b7e1-32cd-4687-9bc6-d3ef7eb66008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:38.059725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98b7e1-32cd-4687-9bc6-d3ef7eb66008 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:38.073367 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1080/2154] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:38.074380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98b7e1-32cd-4687-9bc6-d3ef7eb66008 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:38.076477 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-bd98b7e1-32cd-4687-9bc6-d3ef7eb66008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:38.095821 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98b7e1-32cd-4687-9bc6-d3ef7eb66008 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:38.102952 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56792b67-b2a9-4e24-962d-2c553f685a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:38.104200 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56792b67-b2a9-4e24-962d-2c553f685a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:38.104496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56792b67-b2a9-4e24-962d-2c553f685a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:38.104813 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56792b67-b2a9-4e24-962d-2c553f685a9f admin admin] PATH_INFO: `/v3/projects/6d163c6b72914ee2949f3ebb93a475fd` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:38.106506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56792b67-b2a9-4e24-962d-2c553f685a9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d163c6b72914ee2949f3ebb93a475fd)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:38.111501 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56792b67-b2a9-4e24-962d-2c553f685a9f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:38.163989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1075/2155] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Sep 11 10:47:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:38.166785 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18a7c2-2767-4f0e-9ae1-986cba9afa44 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:38.180246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18a7c2-2767-4f0e-9ae1-986cba9afa44 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:38.210961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-56792b67-b2a9-4e24-962d-2c553f685a9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d163c6b72914ee2949f3ebb93a475fd', 'request_id': 'req-56792b67-b2a9-4e24-962d-2c553f685a9f'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:38.223340 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-56792b67-b2a9-4e24-962d-2c553f685a9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d163c6b72914ee2949f3ebb93a475fd', 'request_id': 'req-56792b67-b2a9-4e24-962d-2c553f685a9f'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:38.237470 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-56792b67-b2a9-4e24-962d-2c553f685a9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d163c6b72914ee2949f3ebb93a475fd', 'request_id': 'req-56792b67-b2a9-4e24-962d-2c553f685a9f'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:38.242655 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:38.258277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-56792b67-b2a9-4e24-962d-2c553f685a9f admin admin] The token cache is being invalidate because project 6d163c6b72914ee2949f3ebb93a475fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:38.258574 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-56792b67-b2a9-4e24-962d-2c553f685a9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:38.259356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-56792b67-b2a9-4e24-962d-2c553f685a9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:38.264589 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1081/2156] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:38 2022] DELETE /identity/v3/projects/6d163c6b72914ee2949f3ebb93a475fd => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:38.266869 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56792b67-b2a9-4e24-962d-2c553f685a9f admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:38.269151 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-56792b67-b2a9-4e24-962d-2c553f685a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:38.270403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece8e3d-386b-47b2-aa5b-f125f1f50d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:38.271184 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece8e3d-386b-47b2-aa5b-f125f1f50d46 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:38.271616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece8e3d-386b-47b2-aa5b-f125f1f50d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:38.271919 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece8e3d-386b-47b2-aa5b-f125f1f50d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:38.272924 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece8e3d-386b-47b2-aa5b-f125f1f50d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:38.275564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece8e3d-386b-47b2-aa5b-f125f1f50d46 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:38.293570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1076/2157] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:38.294742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece8e3d-386b-47b2-aa5b-f125f1f50d46 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:38.296666 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bece8e3d-386b-47b2-aa5b-f125f1f50d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:38.305524 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56792b67-b2a9-4e24-962d-2c553f685a9f admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:38.317909 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46d16e-12e2-41be-859f-7243a1d7a697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:38.318823 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46d16e-12e2-41be-859f-7243a1d7a697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:38.319931 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46d16e-12e2-41be-859f-7243a1d7a697 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:38.320631 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46d16e-12e2-41be-859f-7243a1d7a697 admin admin] PATH_INFO: `/v3/users/d89caad53e7344948b7c2e8e50f21687` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:38.323117 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46d16e-12e2-41be-859f-7243a1d7a697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d89caad53e7344948b7c2e8e50f21687)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:38.331376 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46d16e-12e2-41be-859f-7243a1d7a697 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:38.394330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:38.404435 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0a46d16e-12e2-41be-859f-7243a1d7a697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd89caad53e7344948b7c2e8e50f21687'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:38.416943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0a46d16e-12e2-41be-859f-7243a1d7a697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd89caad53e7344948b7c2e8e50f21687'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:38.417762 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0a46d16e-12e2-41be-859f-7243a1d7a697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd89caad53e7344948b7c2e8e50f21687'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:38.418572 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0a46d16e-12e2-41be-859f-7243a1d7a697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd89caad53e7344948b7c2e8e50f21687'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:38.429056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0a46d16e-12e2-41be-859f-7243a1d7a697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd89caad53e7344948b7c2e8e50f21687'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:38.454201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1082/2158] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:38 2022] DELETE /identity/v3/users/d89caad53e7344948b7c2e8e50f21687 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:38.454201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46d16e-12e2-41be-859f-7243a1d7a697 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:38.454201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0a46d16e-12e2-41be-859f-7243a1d7a697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:38.455732 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece8e3d-386b-47b2-aa5b-f125f1f50d46 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:38.578142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46d16e-12e2-41be-859f-7243a1d7a697 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:38.584149 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc4c99-932b-4752-a73f-360257cd650d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0211a05cca4e72b30d64eef4ba527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:38.586105 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc4c99-932b-4752-a73f-360257cd650d service placement] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:38.586105 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc4c99-932b-4752-a73f-360257cd650d service placement] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:38.586105 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc4c99-932b-4752-a73f-360257cd650d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:38.587441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42ff24-0284-4a09-8814-867f926d6920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:38.588042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-29cc4c99-932b-4752-a73f-360257cd650d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:38.588428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42ff24-0284-4a09-8814-867f926d6920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:38.588884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42ff24-0284-4a09-8814-867f926d6920 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:38.589554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42ff24-0284-4a09-8814-867f926d6920 admin admin] PATH_INFO: `/v3/users/9a0a068d80634a3eb4c012aa9dfb7598` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:38.591020 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42ff24-0284-4a09-8814-867f926d6920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a0a068d80634a3eb4c012aa9dfb7598)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:38.594547 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42ff24-0284-4a09-8814-867f926d6920 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:38.605453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc4c99-932b-4752-a73f-360257cd650d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:38.608169 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc4c99-932b-4752-a73f-360257cd650d service placement] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:38.629771 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1077/2159] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:38.630685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc4c99-932b-4752-a73f-360257cd650d service placement] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:38.632597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-29cc4c99-932b-4752-a73f-360257cd650d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:38.650156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc4c99-932b-4752-a73f-360257cd650d service placement] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:38.657068 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb85e9-0354-4b1a-b74c-62eee886010b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:38.657814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb85e9-0354-4b1a-b74c-62eee886010b admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:38.658105 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb85e9-0354-4b1a-b74c-62eee886010b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:38.658508 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb85e9-0354-4b1a-b74c-62eee886010b admin admin] PATH_INFO: `/v3/projects/f5f2f637da044945a873ad2709b32817/users/61fa435422584fc39b293565b573c352/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:38.680674 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb85e9-0354-4b1a-b74c-62eee886010b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5f2f637da044945a873ad2709b32817, user_id=61fa435422584fc39b293565b573c352, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:38.683870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb85e9-0354-4b1a-b74c-62eee886010b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:38.690378 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ee42ff24-0284-4a09-8814-867f926d6920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a0a068d80634a3eb4c012aa9dfb7598'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:38.699425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ee42ff24-0284-4a09-8814-867f926d6920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a0a068d80634a3eb4c012aa9dfb7598'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:38.700225 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ee42ff24-0284-4a09-8814-867f926d6920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a0a068d80634a3eb4c012aa9dfb7598'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:38.700929 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ee42ff24-0284-4a09-8814-867f926d6920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a0a068d80634a3eb4c012aa9dfb7598'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:38.703117 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1078/2160] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:38 2022] PUT /identity/v3/projects/f5f2f637da044945a873ad2709b32817/users/61fa435422584fc39b293565b573c352/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:38.703822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb85e9-0354-4b1a-b74c-62eee886010b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:38.708916 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-69bb85e9-0354-4b1a-b74c-62eee886010b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:38.720988 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ee42ff24-0284-4a09-8814-867f926d6920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a0a068d80634a3eb4c012aa9dfb7598'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:38.750413 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1083/2161] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:38 2022] DELETE /identity/v3/users/9a0a068d80634a3eb4c012aa9dfb7598 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:38.754596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abcd75-636e-4056-b226-cae146e1fe13 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:38.754889 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abcd75-636e-4056-b226-cae146e1fe13 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:38.755171 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abcd75-636e-4056-b226-cae146e1fe13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:38.790677 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:38.800695 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-41abcd75-636e-4056-b226-cae146e1fe13 None None] MFA Rules not processed for user `61fa435422584fc39b293565b573c352`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:38.802516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-41abcd75-636e-4056-b226-cae146e1fe13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:38.821667 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb85e9-0354-4b1a-b74c-62eee886010b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:38.854606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:38.938746 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d634ce-19b0-41c2-903b-d86257078131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:38.939351 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d634ce-19b0-41c2-903b-d86257078131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:38.939638 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d634ce-19b0-41c2-903b-d86257078131 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:38.939980 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d634ce-19b0-41c2-903b-d86257078131 admin admin] PATH_INFO: `/v3/projects/fabfc5097e2546eabea417a7757ec211` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:38.942671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d634ce-19b0-41c2-903b-d86257078131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fabfc5097e2546eabea417a7757ec211)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:38.946346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d634ce-19b0-41c2-903b-d86257078131 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:38.964465 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1084/2162] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:38.973940 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abcd75-636e-4056-b226-cae146e1fe13 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:38.975731 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-41abcd75-636e-4056-b226-cae146e1fe13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:38.996875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abcd75-636e-4056-b226-cae146e1fe13 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:39.019882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0009ca-85fd-4a49-944d-89d1f469a8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:39.020814 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0009ca-85fd-4a49-944d-89d1f469a8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:39.021311 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0009ca-85fd-4a49-944d-89d1f469a8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:39.022049 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0009ca-85fd-4a49-944d-89d1f469a8a2 admin admin] PATH_INFO: `/v3/projects/5e528d88681f48bd9a93b9851aa9b8dc` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:39.025803 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0009ca-85fd-4a49-944d-89d1f469a8a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e528d88681f48bd9a93b9851aa9b8dc)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:39.027125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a1d634ce-19b0-41c2-903b-d86257078131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fabfc5097e2546eabea417a7757ec211', 'request_id': 'req-a1d634ce-19b0-41c2-903b-d86257078131'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:39.029270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0009ca-85fd-4a49-944d-89d1f469a8a2 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:39.037165 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a1d634ce-19b0-41c2-903b-d86257078131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fabfc5097e2546eabea417a7757ec211', 'request_id': 'req-a1d634ce-19b0-41c2-903b-d86257078131'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:39.051278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a1d634ce-19b0-41c2-903b-d86257078131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fabfc5097e2546eabea417a7757ec211', 'request_id': 'req-a1d634ce-19b0-41c2-903b-d86257078131'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:39.071187 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a1d634ce-19b0-41c2-903b-d86257078131 admin admin] The token cache is being invalidate because project fabfc5097e2546eabea417a7757ec211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:39.071975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a1d634ce-19b0-41c2-903b-d86257078131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:39.073210 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a1d634ce-19b0-41c2-903b-d86257078131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:39.074935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1079/2163] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:38 2022] DELETE /identity/v3/projects/fabfc5097e2546eabea417a7757ec211 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:39.075958 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d634ce-19b0-41c2-903b-d86257078131 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:39.077616 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a1d634ce-19b0-41c2-903b-d86257078131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:39.157081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8e0009ca-85fd-4a49-944d-89d1f469a8a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e528d88681f48bd9a93b9851aa9b8dc', 'request_id': 'req-8e0009ca-85fd-4a49-944d-89d1f469a8a2'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:39.174380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8e0009ca-85fd-4a49-944d-89d1f469a8a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e528d88681f48bd9a93b9851aa9b8dc', 'request_id': 'req-8e0009ca-85fd-4a49-944d-89d1f469a8a2'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:39.190782 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8e0009ca-85fd-4a49-944d-89d1f469a8a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e528d88681f48bd9a93b9851aa9b8dc', 'request_id': 'req-8e0009ca-85fd-4a49-944d-89d1f469a8a2'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:39.210409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8e0009ca-85fd-4a49-944d-89d1f469a8a2 admin admin] The token cache is being invalidate because project 5e528d88681f48bd9a93b9851aa9b8dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:39.210759 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8e0009ca-85fd-4a49-944d-89d1f469a8a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:39.211549 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8e0009ca-85fd-4a49-944d-89d1f469a8a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:39.214988 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1085/2164] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:38 2022] DELETE /identity/v3/projects/5e528d88681f48bd9a93b9851aa9b8dc => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:39.216310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f2103-9957-4768-86bb-cf4538992e63 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:39.217365 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f2103-9957-4768-86bb-cf4538992e63 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:39.217513 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d634ce-19b0-41c2-903b-d86257078131 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:39.217772 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f2103-9957-4768-86bb-cf4538992e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:39.262883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:39.265773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-b49f2103-9957-4768-86bb-cf4538992e63 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:39.267863 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b49f2103-9957-4768-86bb-cf4538992e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:39.322871 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0564f-5f4b-43db-ab60-1548893cdcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:39.323803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0564f-5f4b-43db-ab60-1548893cdcb0 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:39.324165 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0564f-5f4b-43db-ab60-1548893cdcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:39.324666 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0564f-5f4b-43db-ab60-1548893cdcb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:39.325739 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0564f-5f4b-43db-ab60-1548893cdcb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:39.328523 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0564f-5f4b-43db-ab60-1548893cdcb0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:39.363799 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1086/2165] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:39.363799 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f2e11-eb99-42b4-b952-8b509c1d7ae6 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:39.363799 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f2e11-eb99-42b4-b952-8b509c1d7ae6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:39.363799 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f2e11-eb99-42b4-b952-8b509c1d7ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:39.367562 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1080/2166] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:39 2022] POST /identity/v3/projects => generated 385 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:39.368708 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0564f-5f4b-43db-ab60-1548893cdcb0 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:39.370725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-12f0564f-5f4b-43db-ab60-1548893cdcb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:39.383737 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-223f2e11-eb99-42b4-b952-8b509c1d7ae6 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:39.385345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-223f2e11-eb99-42b4-b952-8b509c1d7ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:39.437175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:39.453229 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0564f-5f4b-43db-ab60-1548893cdcb0 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:39.463112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1087/2167] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:39.463112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa011f12-4157-4cf1-97ab-e6e27bb7561f None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:39.463112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa011f12-4157-4cf1-97ab-e6e27bb7561f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:39.463112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa011f12-4157-4cf1-97ab-e6e27bb7561f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:39.465929 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb36100-28f6-4d4e-9e58-8e5a6d896b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:39.467418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb36100-28f6-4d4e-9e58-8e5a6d896b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:39.468427 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb36100-28f6-4d4e-9e58-8e5a6d896b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:39.468926 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb36100-28f6-4d4e-9e58-8e5a6d896b0e admin admin] PATH_INFO: `/v3/projects/31cc87ba4f7342dc8c1d9ddb03f67cd9` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:39.471319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb36100-28f6-4d4e-9e58-8e5a6d896b0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=31cc87ba4f7342dc8c1d9ddb03f67cd9)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:39.477523 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb36100-28f6-4d4e-9e58-8e5a6d896b0e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:39.490220 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-aa011f12-4157-4cf1-97ab-e6e27bb7561f None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:39.492017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-aa011f12-4157-4cf1-97ab-e6e27bb7561f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:39.503662 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1088/2168] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:39.504614 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa011f12-4157-4cf1-97ab-e6e27bb7561f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:39.506983 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-aa011f12-4157-4cf1-97ab-e6e27bb7561f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:39.535549 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa011f12-4157-4cf1-97ab-e6e27bb7561f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:39.547989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6eb36100-28f6-4d4e-9e58-8e5a6d896b0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31cc87ba4f7342dc8c1d9ddb03f67cd9', 'request_id': 'req-6eb36100-28f6-4d4e-9e58-8e5a6d896b0e'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:39.557838 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6eb36100-28f6-4d4e-9e58-8e5a6d896b0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31cc87ba4f7342dc8c1d9ddb03f67cd9', 'request_id': 'req-6eb36100-28f6-4d4e-9e58-8e5a6d896b0e'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:39.569517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6eb36100-28f6-4d4e-9e58-8e5a6d896b0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31cc87ba4f7342dc8c1d9ddb03f67cd9', 'request_id': 'req-6eb36100-28f6-4d4e-9e58-8e5a6d896b0e'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:39.584854 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6eb36100-28f6-4d4e-9e58-8e5a6d896b0e admin admin] The token cache is being invalidate because project 31cc87ba4f7342dc8c1d9ddb03f67cd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:39.585066 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6eb36100-28f6-4d4e-9e58-8e5a6d896b0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:39.586352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6eb36100-28f6-4d4e-9e58-8e5a6d896b0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:39.588391 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1081/2169] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:39 2022] DELETE /identity/v3/projects/31cc87ba4f7342dc8c1d9ddb03f67cd9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:39.590846 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad814dc-6d7d-4878-9fce-2eab61be4373 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:39.591144 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad814dc-6d7d-4878-9fce-2eab61be4373 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:39.591496 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad814dc-6d7d-4878-9fce-2eab61be4373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:39.620126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-bad814dc-6d7d-4878-9fce-2eab61be4373 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:39.621772 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bad814dc-6d7d-4878-9fce-2eab61be4373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:39.627049 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd794a2-52ea-462c-9382-0b7c55793186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:39.628318 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd794a2-52ea-462c-9382-0b7c55793186 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:39.628665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd794a2-52ea-462c-9382-0b7c55793186 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:39.628949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd794a2-52ea-462c-9382-0b7c55793186 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:39.629797 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd794a2-52ea-462c-9382-0b7c55793186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:39.631480 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1082/2170] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:39.631702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd794a2-52ea-462c-9382-0b7c55793186 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:39.633777 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad814dc-6d7d-4878-9fce-2eab61be4373 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:39.635532 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bad814dc-6d7d-4878-9fce-2eab61be4373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:39.649352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad814dc-6d7d-4878-9fce-2eab61be4373 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:39.654899 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171419a8-d840-4655-9c9c-a047df1a1b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:39.656295 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171419a8-d840-4655-9c9c-a047df1a1b53 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:39.656696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171419a8-d840-4655-9c9c-a047df1a1b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:39.657069 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171419a8-d840-4655-9c9c-a047df1a1b53 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:39.657838 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171419a8-d840-4655-9c9c-a047df1a1b53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:39.658232 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171419a8-d840-4655-9c9c-a047df1a1b53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:39.661765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1089/2171] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:39 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:39.661909 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171419a8-d840-4655-9c9c-a047df1a1b53 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:39.662002 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26e0cd-0dfb-4833-8d9a-25383bd845e8 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:39.662002 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26e0cd-0dfb-4833-8d9a-25383bd845e8 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:39.662002 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26e0cd-0dfb-4833-8d9a-25383bd845e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:39.675729 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1083/2172] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:47:39.676791 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171419a8-d840-4655-9c9c-a047df1a1b53 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:39.689724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171419a8-d840-4655-9c9c-a047df1a1b53 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:39.690133 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-5c26e0cd-0dfb-4833-8d9a-25383bd845e8 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:39.691365 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-5c26e0cd-0dfb-4833-8d9a-25383bd845e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:39.697121 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c9257-9fc7-44ed-9815-3a90d88eedb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:39.697754 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c9257-9fc7-44ed-9815-3a90d88eedb5 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:39.698016 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c9257-9fc7-44ed-9815-3a90d88eedb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:39.698289 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c9257-9fc7-44ed-9815-3a90d88eedb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:39.698941 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c9257-9fc7-44ed-9815-3a90d88eedb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:39.699303 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c9257-9fc7-44ed-9815-3a90d88eedb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:39.700201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1090/2173] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:39.701112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c9257-9fc7-44ed-9815-3a90d88eedb5 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:39.707435 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26e0cd-0dfb-4833-8d9a-25383bd845e8 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:39.708888 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-5c26e0cd-0dfb-4833-8d9a-25383bd845e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:39.721865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26e0cd-0dfb-4833-8d9a-25383bd845e8 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:39.726536 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1ae66-f70f-4f9b-a045-727f400a62a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:39.727150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1ae66-f70f-4f9b-a045-727f400a62a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:39.727434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1ae66-f70f-4f9b-a045-727f400a62a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:39.727707 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1ae66-f70f-4f9b-a045-727f400a62a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:39.728414 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1ae66-f70f-4f9b-a045-727f400a62a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:39.735471 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1084/2174] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:47:39.735632 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1ae66-f70f-4f9b-a045-727f400a62a7 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:39.735755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c9257-9fc7-44ed-9815-3a90d88eedb5 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:39.741443 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c9257-9fc7-44ed-9815-3a90d88eedb5 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:39.746232 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a6c6e-8ce1-42f4-93bb-cae8e62d8324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:39.746829 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a6c6e-8ce1-42f4-93bb-cae8e62d8324 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:39.746945 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1091/2175] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:39.747133 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a6c6e-8ce1-42f4-93bb-cae8e62d8324 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:39.747492 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a6c6e-8ce1-42f4-93bb-cae8e62d8324 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:39.748128 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a6c6e-8ce1-42f4-93bb-cae8e62d8324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:39.750622 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a6c6e-8ce1-42f4-93bb-cae8e62d8324 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:39.752086 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577201e-f3a4-4345-b008-e0384f9debc5 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:39.752380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577201e-f3a4-4345-b008-e0384f9debc5 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:39.752695 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577201e-f3a4-4345-b008-e0384f9debc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:39.767340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:39.776698 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-0577201e-f3a4-4345-b008-e0384f9debc5 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:39.777972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0577201e-f3a4-4345-b008-e0384f9debc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:39.788125 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1092/2176] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:39.788125 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577201e-f3a4-4345-b008-e0384f9debc5 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:39.790291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1085/2177] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:39 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:39.791087 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a6c6e-8ce1-42f4-93bb-cae8e62d8324 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:39.800113 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577201e-f3a4-4345-b008-e0384f9debc5 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:39.861225 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a6c6e-8ce1-42f4-93bb-cae8e62d8324 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:39.866452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a9f15-523f-4bec-895e-9bce75ef65c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:39.867162 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9f15-523f-4bec-895e-9bce75ef65c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:39.867502 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9f15-523f-4bec-895e-9bce75ef65c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:39.867839 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9f15-523f-4bec-895e-9bce75ef65c4 admin admin] PATH_INFO: `/v3/projects/2551c5e8c531401a96fd9128944194b5/users/44ef9423e9194322a62d11f467891fc6/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:39.870869 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5f188-dde9-4c54-9156-d9927cf58d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:39.872279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5f188-dde9-4c54-9156-d9927cf58d68 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:39.872643 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5f188-dde9-4c54-9156-d9927cf58d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:39.872875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5f188-dde9-4c54-9156-d9927cf58d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:39.873544 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5f188-dde9-4c54-9156-d9927cf58d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:39.876015 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5f188-dde9-4c54-9156-d9927cf58d68 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:39.884949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a9f15-523f-4bec-895e-9bce75ef65c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2551c5e8c531401a96fd9128944194b5, user_id=44ef9423e9194322a62d11f467891fc6, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:39.888410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a9f15-523f-4bec-895e-9bce75ef65c4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:39.912911 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1093/2178] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:39 2022] POST /identity/v3/projects => generated 389 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:39.912911 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5f188-dde9-4c54-9156-d9927cf58d68 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:39.925372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1086/2179] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:39 2022] PUT /identity/v3/projects/2551c5e8c531401a96fd9128944194b5/users/44ef9423e9194322a62d11f467891fc6/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:39.926499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a9f15-523f-4bec-895e-9bce75ef65c4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:39.951070 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:39.991795 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5f188-dde9-4c54-9156-d9927cf58d68 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:39.998431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b949e-b012-402f-9619-08663b6501fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:39.999370 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b949e-b012-402f-9619-08663b6501fa admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:39.999729 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b949e-b012-402f-9619-08663b6501fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.000052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b949e-b012-402f-9619-08663b6501fa admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.001006 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b949e-b012-402f-9619-08663b6501fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:40.003546 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b949e-b012-402f-9619-08663b6501fa admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:40.007787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a9f15-523f-4bec-895e-9bce75ef65c4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:40.016753 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd33be-6e5f-40ef-943c-deb39dfdba28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:40.017401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd33be-6e5f-40ef-943c-deb39dfdba28 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.017750 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd33be-6e5f-40ef-943c-deb39dfdba28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.017948 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd33be-6e5f-40ef-943c-deb39dfdba28 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.018824 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd33be-6e5f-40ef-943c-deb39dfdba28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:40.018940 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd33be-6e5f-40ef-943c-deb39dfdba28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:40.020607 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd33be-6e5f-40ef-943c-deb39dfdba28 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:40.034148 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1087/2180] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:47:40.035060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd33be-6e5f-40ef-943c-deb39dfdba28 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:40.043038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1094/2181] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:39 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:40.044473 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b949e-b012-402f-9619-08663b6501fa admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:40.049111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd33be-6e5f-40ef-943c-deb39dfdba28 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:40.053981 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0db26-1a83-415f-bbb7-0233dcd7ea9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:40.055080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0db26-1a83-415f-bbb7-0233dcd7ea9e admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.055193 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0db26-1a83-415f-bbb7-0233dcd7ea9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.055606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0db26-1a83-415f-bbb7-0233dcd7ea9e admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.055979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b949e-b012-402f-9619-08663b6501fa admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:40.056399 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0db26-1a83-415f-bbb7-0233dcd7ea9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:40.058395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0db26-1a83-415f-bbb7-0233dcd7ea9e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:40.061441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bb7f4-dd21-46f4-af5d-bdc4677596f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:40.062297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bb7f4-dd21-46f4-af5d-bdc4677596f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.062579 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bb7f4-dd21-46f4-af5d-bdc4677596f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.062855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bb7f4-dd21-46f4-af5d-bdc4677596f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.063505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3bb7f4-dd21-46f4-af5d-bdc4677596f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:40.065277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3bb7f4-dd21-46f4-af5d-bdc4677596f4 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:40.078614 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1095/2182] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:40.082748 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bb7f4-dd21-46f4-af5d-bdc4677596f4 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:40.091535 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1088/2183] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:40 2022] POST /identity/v3/users => generated 295 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:40.093615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bb7f4-dd21-46f4-af5d-bdc4677596f4 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:40.094174 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0db26-1a83-415f-bbb7-0233dcd7ea9e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:40.099791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e91e91-cfee-4924-818a-f74abbd99973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:40.100426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e91e91-cfee-4924-818a-f74abbd99973 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.100806 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e91e91-cfee-4924-818a-f74abbd99973 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.101085 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e91e91-cfee-4924-818a-f74abbd99973 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.101720 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e91e91-cfee-4924-818a-f74abbd99973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:40.103619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e91e91-cfee-4924-818a-f74abbd99973 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:40.106932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0db26-1a83-415f-bbb7-0233dcd7ea9e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:40.114758 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7792f-7ff5-4704-b037-dd91ea2a1d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:40.115523 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7792f-7ff5-4704-b037-dd91ea2a1d20 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.115939 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7792f-7ff5-4704-b037-dd91ea2a1d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.116820 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7792f-7ff5-4704-b037-dd91ea2a1d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.117301 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7792f-7ff5-4704-b037-dd91ea2a1d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:40.119781 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7792f-7ff5-4704-b037-dd91ea2a1d20 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:40.137223 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1089/2184] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:40.138330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7792f-7ff5-4704-b037-dd91ea2a1d20 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:40.151035 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7792f-7ff5-4704-b037-dd91ea2a1d20 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:40.154705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1096/2185] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:40 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:40.156157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e91e91-cfee-4924-818a-f74abbd99973 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:40.205725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:40.225704 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c32bec-3a19-43e4-91ef-c6ab6ab60deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:40.226399 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c32bec-3a19-43e4-91ef-c6ab6ab60deb admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.226681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c32bec-3a19-43e4-91ef-c6ab6ab60deb admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.226955 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c32bec-3a19-43e4-91ef-c6ab6ab60deb admin admin] PATH_INFO: `/v3/projects/2551c5e8c531401a96fd9128944194b5/users/44ef9423e9194322a62d11f467891fc6/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.229012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c32bec-3a19-43e4-91ef-c6ab6ab60deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2551c5e8c531401a96fd9128944194b5, user_id=44ef9423e9194322a62d11f467891fc6, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:40.229475 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e91e91-cfee-4924-818a-f74abbd99973 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:40.231646 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c32bec-3a19-43e4-91ef-c6ab6ab60deb admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:40.234945 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e040b-f73a-41bb-be60-0a9aa5052edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:40.235700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e040b-f73a-41bb-be60-0a9aa5052edd admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.235975 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e040b-f73a-41bb-be60-0a9aa5052edd admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.236961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e040b-f73a-41bb-be60-0a9aa5052edd admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.237074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e040b-f73a-41bb-be60-0a9aa5052edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:40.238834 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e040b-f73a-41bb-be60-0a9aa5052edd admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:40.252587 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1090/2186] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:40 2022] PUT /identity/v3/projects/2551c5e8c531401a96fd9128944194b5/users/44ef9423e9194322a62d11f467891fc6/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:40.252587 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c32bec-3a19-43e4-91ef-c6ab6ab60deb admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:40.262097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1097/2187] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:40.262097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e040b-f73a-41bb-be60-0a9aa5052edd admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:40.264703 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a58e040b-f73a-41bb-be60-0a9aa5052edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:40.280956 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e040b-f73a-41bb-be60-0a9aa5052edd admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:40.328133 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c32bec-3a19-43e4-91ef-c6ab6ab60deb admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:40.334418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386be9f8-fcff-49b6-a15e-0361ad3c39e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:40.335159 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386be9f8-fcff-49b6-a15e-0361ad3c39e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.335536 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386be9f8-fcff-49b6-a15e-0361ad3c39e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.335887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386be9f8-fcff-49b6-a15e-0361ad3c39e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.336665 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386be9f8-fcff-49b6-a15e-0361ad3c39e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:40.338302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386be9f8-fcff-49b6-a15e-0361ad3c39e8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:40.348163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72806d6c-241b-4f64-ab11-fbb18a2f9740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:40.348846 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72806d6c-241b-4f64-ab11-fbb18a2f9740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.349126 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72806d6c-241b-4f64-ab11-fbb18a2f9740 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.349399 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72806d6c-241b-4f64-ab11-fbb18a2f9740 admin admin] PATH_INFO: `/v3/users/c1ffe3e92f27483da6ae6e597449a5d8` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.353330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1091/2188] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:40.353532 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72806d6c-241b-4f64-ab11-fbb18a2f9740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1ffe3e92f27483da6ae6e597449a5d8)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:40.353615 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386be9f8-fcff-49b6-a15e-0361ad3c39e8 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:40.353717 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72806d6c-241b-4f64-ab11-fbb18a2f9740 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:40.364674 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386be9f8-fcff-49b6-a15e-0361ad3c39e8 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:40.370191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663e003-3b93-4bbf-bc36-3b4501914022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:40.370817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663e003-3b93-4bbf-bc36-3b4501914022 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.371098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663e003-3b93-4bbf-bc36-3b4501914022 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.371376 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663e003-3b93-4bbf-bc36-3b4501914022 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.372020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663e003-3b93-4bbf-bc36-3b4501914022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:40.373977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663e003-3b93-4bbf-bc36-3b4501914022 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:40.387173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:40.407728 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1092/2189] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:40 2022] POST /identity/v3/users => generated 291 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:40.407728 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534dab8-3864-4808-ae67-2263967512f9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.407728 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534dab8-3864-4808-ae67-2263967512f9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.407728 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534dab8-3864-4808-ae67-2263967512f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.418489 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-72806d6c-241b-4f64-ab11-fbb18a2f9740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1ffe3e92f27483da6ae6e597449a5d8'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:40.428605 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-72806d6c-241b-4f64-ab11-fbb18a2f9740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1ffe3e92f27483da6ae6e597449a5d8'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:40.429828 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-72806d6c-241b-4f64-ab11-fbb18a2f9740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1ffe3e92f27483da6ae6e597449a5d8'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:40.430697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-72806d6c-241b-4f64-ab11-fbb18a2f9740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1ffe3e92f27483da6ae6e597449a5d8'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:40.439053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-72806d6c-241b-4f64-ab11-fbb18a2f9740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1ffe3e92f27483da6ae6e597449a5d8'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:40.440069 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f534dab8-3864-4808-ae67-2263967512f9 None None] MFA Rules not processed for user `44ef9423e9194322a62d11f467891fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:40.441355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f534dab8-3864-4808-ae67-2263967512f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:40.463296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1098/2190] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:40 2022] DELETE /identity/v3/users/c1ffe3e92f27483da6ae6e597449a5d8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:40.465120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72806d6c-241b-4f64-ab11-fbb18a2f9740 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:40.466835 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-72806d6c-241b-4f64-ab11-fbb18a2f9740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:40.520498 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1093/2191] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:40.524464 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534dab8-3864-4808-ae67-2263967512f9 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:40.526239 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f534dab8-3864-4808-ae67-2263967512f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:40.542285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534dab8-3864-4808-ae67-2263967512f9 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:40.549002 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a13ca1-5f59-4648-86a8-73245cd44d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:40.549849 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a13ca1-5f59-4648-86a8-73245cd44d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.550131 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a13ca1-5f59-4648-86a8-73245cd44d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.550368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72806d6c-241b-4f64-ab11-fbb18a2f9740 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:40.550514 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a13ca1-5f59-4648-86a8-73245cd44d83 admin admin] PATH_INFO: `/v3/projects/7e609dbf54ff4bce943045caae52884b/users/5e1477f4266b4e2b8f7d815f57419f63/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.556893 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3de6f-da33-4d76-9746-cee95930abc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:40.557571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3de6f-da33-4d76-9746-cee95930abc9 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.557859 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3de6f-da33-4d76-9746-cee95930abc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.558142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3de6f-da33-4d76-9746-cee95930abc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.558800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3de6f-da33-4d76-9746-cee95930abc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:40.561656 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3de6f-da33-4d76-9746-cee95930abc9 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:40.568925 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a13ca1-5f59-4648-86a8-73245cd44d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e609dbf54ff4bce943045caae52884b, user_id=5e1477f4266b4e2b8f7d815f57419f63, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:40.586033 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a13ca1-5f59-4648-86a8-73245cd44d83 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:40.596850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1099/2192] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:40.598316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1094/2193] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:40 2022] PUT /identity/v3/projects/7e609dbf54ff4bce943045caae52884b/users/5e1477f4266b4e2b8f7d815f57419f63/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:40.599886 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bf5c5-ea76-49dc-b832-4a45823e2f07 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.600145 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bf5c5-ea76-49dc-b832-4a45823e2f07 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.600420 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bf5c5-ea76-49dc-b832-4a45823e2f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.600675 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3de6f-da33-4d76-9746-cee95930abc9 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:40.606301 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0da3de6f-da33-4d76-9746-cee95930abc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:40.630319 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3de6f-da33-4d76-9746-cee95930abc9 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:40.634673 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-514bf5c5-ea76-49dc-b832-4a45823e2f07 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:40.635956 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-514bf5c5-ea76-49dc-b832-4a45823e2f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:40.647263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:40.699806 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4794f-4b17-4007-bc92-23d1eebfb8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:40.700427 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4794f-4b17-4007-bc92-23d1eebfb8ef admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.700789 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4794f-4b17-4007-bc92-23d1eebfb8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.701014 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4794f-4b17-4007-bc92-23d1eebfb8ef admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.701682 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4794f-4b17-4007-bc92-23d1eebfb8ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:40.703858 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4794f-4b17-4007-bc92-23d1eebfb8ef admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:40.715178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1100/2194] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:40.719436 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4794f-4b17-4007-bc92-23d1eebfb8ef admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:40.719585 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1095/2195] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:40.719585 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bf5c5-ea76-49dc-b832-4a45823e2f07 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:40.720663 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-70b4794f-4b17-4007-bc92-23d1eebfb8ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:40.731241 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bf5c5-ea76-49dc-b832-4a45823e2f07 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:40.737283 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f1c5a-03f7-4302-9a22-461930884312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:40.738042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f1c5a-03f7-4302-9a22-461930884312 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.738389 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f1c5a-03f7-4302-9a22-461930884312 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.738868 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f1c5a-03f7-4302-9a22-461930884312 admin admin] PATH_INFO: `/v3/projects/99612539394f4578983fad9cbbd4a9b6/users/80be130a10624a81bd3e874a3745b571/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.760234 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f1c5a-03f7-4302-9a22-461930884312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99612539394f4578983fad9cbbd4a9b6, user_id=80be130a10624a81bd3e874a3745b571, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:40.764021 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f1c5a-03f7-4302-9a22-461930884312 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:40.770986 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:40.780386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1096/2196] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:40 2022] PUT /identity/v3/projects/99612539394f4578983fad9cbbd4a9b6/users/80be130a10624a81bd3e874a3745b571/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:40.781970 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349beb8-4fe5-4fe8-bbc4-bc32ae04658e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.782410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349beb8-4fe5-4fe8-bbc4-bc32ae04658e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.782744 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349beb8-4fe5-4fe8-bbc4-bc32ae04658e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.792489 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4794f-4b17-4007-bc92-23d1eebfb8ef admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:40.811314 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3349beb8-4fe5-4fe8-bbc4-bc32ae04658e None None] MFA Rules not processed for user `5e1477f4266b4e2b8f7d815f57419f63`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:40.813186 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3349beb8-4fe5-4fe8-bbc4-bc32ae04658e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:40.843356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1f473-50c9-4c63-9a27-e41e70b4cecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:40.843961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1f473-50c9-4c63-9a27-e41e70b4cecc service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.844238 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1f473-50c9-4c63-9a27-e41e70b4cecc service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.844509 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1f473-50c9-4c63-9a27-e41e70b4cecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.846299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c3a1f473-50c9-4c63-9a27-e41e70b4cecc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:40.876859 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1097/2197] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:40.877747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349beb8-4fe5-4fe8-bbc4-bc32ae04658e None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:40.909674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1f473-50c9-4c63-9a27-e41e70b4cecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:40.911134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1f473-50c9-4c63-9a27-e41e70b4cecc service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:40.920006 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1101/2198] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:40.920882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1f473-50c9-4c63-9a27-e41e70b4cecc service cinder] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:40.922218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c3a1f473-50c9-4c63-9a27-e41e70b4cecc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:40.939692 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349beb8-4fe5-4fe8-bbc4-bc32ae04658e None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:40.944390 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a93dd-f0b9-46cc-b0c4-df114f5d82ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:40.945025 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a93dd-f0b9-46cc-b0c4-df114f5d82ff admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.945309 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a93dd-f0b9-46cc-b0c4-df114f5d82ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.945581 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a93dd-f0b9-46cc-b0c4-df114f5d82ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.946224 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a93dd-f0b9-46cc-b0c4-df114f5d82ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:40.947797 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a93dd-f0b9-46cc-b0c4-df114f5d82ff admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:40.958779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1098/2199] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:40.960040 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8fe98-c50a-4031-96ee-606d59fe4dfa None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.960327 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8fe98-c50a-4031-96ee-606d59fe4dfa None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.960615 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8fe98-c50a-4031-96ee-606d59fe4dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:40.979771 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-78d8fe98-c50a-4031-96ee-606d59fe4dfa None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:40.981013 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-78d8fe98-c50a-4031-96ee-606d59fe4dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:40.990810 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1f473-50c9-4c63-9a27-e41e70b4cecc service cinder] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:40.991144 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1099/2200] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:40.991984 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8fe98-c50a-4031-96ee-606d59fe4dfa None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:40.997506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b6a85-bedb-490e-bf4b-fd503d004d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:40.998129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b6a85-bedb-490e-bf4b-fd503d004d1c service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:40.998409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b6a85-bedb-490e-bf4b-fd503d004d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:40.998708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b6a85-bedb-490e-bf4b-fd503d004d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:41.003863 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8fe98-c50a-4031-96ee-606d59fe4dfa None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:41.008533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25c5e3-04d7-4643-b99f-e6aa5925ee96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:41.009167 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25c5e3-04d7-4643-b99f-e6aa5925ee96 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:41.009445 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25c5e3-04d7-4643-b99f-e6aa5925ee96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:41.009716 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25c5e3-04d7-4643-b99f-e6aa5925ee96 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:41.009983 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b6a85-bedb-490e-bf4b-fd503d004d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:41.010350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25c5e3-04d7-4643-b99f-e6aa5925ee96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:41.011398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b6a85-bedb-490e-bf4b-fd503d004d1c service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:41.012222 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25c5e3-04d7-4643-b99f-e6aa5925ee96 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:41.022489 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:41.022635 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1102/2201] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:41.023404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b6a85-bedb-490e-bf4b-fd503d004d1c service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:41.033755 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b6a85-bedb-490e-bf4b-fd503d004d1c service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:41.039582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6b6d4-db39-471a-b2fb-35c616b8c447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:41.041233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6b6d4-db39-471a-b2fb-35c616b8c447 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:41.041578 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6b6d4-db39-471a-b2fb-35c616b8c447 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:41.041915 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6b6d4-db39-471a-b2fb-35c616b8c447 admin admin] PATH_INFO: `/v3/projects/5b4dde8fa08441f8a6c5148c7caf6b35/users/413b1193b8784a2b8acad597c8aa8c6b/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:41.048627 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1100/2202] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:40 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:41.048627 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25c5e3-04d7-4643-b99f-e6aa5925ee96 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:41.052150 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0a25c5e3-04d7-4643-b99f-e6aa5925ee96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:41.058323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6b6d4-db39-471a-b2fb-35c616b8c447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4dde8fa08441f8a6c5148c7caf6b35, user_id=413b1193b8784a2b8acad597c8aa8c6b, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:41.061165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6b6d4-db39-471a-b2fb-35c616b8c447 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:41.080094 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1103/2203] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:41 2022] PUT /identity/v3/projects/5b4dde8fa08441f8a6c5148c7caf6b35/users/413b1193b8784a2b8acad597c8aa8c6b/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:41.081726 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6b6d4-db39-471a-b2fb-35c616b8c447 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:41.138436 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25c5e3-04d7-4643-b99f-e6aa5925ee96 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:41.139692 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:41.186140 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6b6d4-db39-471a-b2fb-35c616b8c447 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:41.194976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afac2d-3065-4aa7-9d53-c56f88af79eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:41.195595 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afac2d-3065-4aa7-9d53-c56f88af79eb admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:41.195879 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afac2d-3065-4aa7-9d53-c56f88af79eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:41.196221 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afac2d-3065-4aa7-9d53-c56f88af79eb admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:41.196817 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afac2d-3065-4aa7-9d53-c56f88af79eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:41.198995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afac2d-3065-4aa7-9d53-c56f88af79eb admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:41.229356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1104/2204] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:41 2022] POST /identity/v3/users => generated 300 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:41.231037 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a14b47-17cc-48a7-ba1a-b1c06271506f None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:41.231584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a14b47-17cc-48a7-ba1a-b1c06271506f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:41.231664 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a14b47-17cc-48a7-ba1a-b1c06271506f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:41.241326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0127d6-0bf0-486f-b380-013d197155ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:41.243421 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0127d6-0bf0-486f-b380-013d197155ec service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:41.243711 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0127d6-0bf0-486f-b380-013d197155ec service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:41.243988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0127d6-0bf0-486f-b380-013d197155ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:41.263154 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0127d6-0bf0-486f-b380-013d197155ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:41.266065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0127d6-0bf0-486f-b380-013d197155ec service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:41.267623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-c3a14b47-17cc-48a7-ba1a-b1c06271506f None None] MFA Rules not processed for user `413b1193b8784a2b8acad597c8aa8c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:41.269197 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c3a14b47-17cc-48a7-ba1a-b1c06271506f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:41.283310 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1101/2205] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:41.284362 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0127d6-0bf0-486f-b380-013d197155ec service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:41.295711 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0127d6-0bf0-486f-b380-013d197155ec service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:41.328463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbeab1-af54-46e7-b1e7-c4a93ef915e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:41.330351 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbeab1-af54-46e7-b1e7-c4a93ef915e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:41.330854 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbeab1-af54-46e7-b1e7-c4a93ef915e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:41.331328 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbeab1-af54-46e7-b1e7-c4a93ef915e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:41.332196 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbeab1-af54-46e7-b1e7-c4a93ef915e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:41.334639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbeab1-af54-46e7-b1e7-c4a93ef915e0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:41.352599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1102/2206] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:41.356632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbeab1-af54-46e7-b1e7-c4a93ef915e0 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:41.372542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbeab1-af54-46e7-b1e7-c4a93ef915e0 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:41.381990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa098f65-be85-43c6-ad4b-4bb4c96a6aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:41.382671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa098f65-be85-43c6-ad4b-4bb4c96a6aac admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:41.383275 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa098f65-be85-43c6-ad4b-4bb4c96a6aac admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:41.383622 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa098f65-be85-43c6-ad4b-4bb4c96a6aac admin admin] PATH_INFO: `/v3/projects/190d6305caec4d149228676ea7bd5291/users/6ab865ac78ef48c28ec0ce6c1e4c672c/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:41.400770 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1105/2207] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:41.407185 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a14b47-17cc-48a7-ba1a-b1c06271506f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:41.420357 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa098f65-be85-43c6-ad4b-4bb4c96a6aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=190d6305caec4d149228676ea7bd5291, user_id=6ab865ac78ef48c28ec0ce6c1e4c672c, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:41.425325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa098f65-be85-43c6-ad4b-4bb4c96a6aac admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:41.430245 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a14b47-17cc-48a7-ba1a-b1c06271506f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:41.440418 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d11a06-1f40-4414-9886-3ed4d0d856ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:41.441291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d11a06-1f40-4414-9886-3ed4d0d856ce admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:41.442135 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d11a06-1f40-4414-9886-3ed4d0d856ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:41.442418 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d11a06-1f40-4414-9886-3ed4d0d856ce admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:41.443124 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d11a06-1f40-4414-9886-3ed4d0d856ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:41.445138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d11a06-1f40-4414-9886-3ed4d0d856ce admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:41.448303 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1103/2208] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:41 2022] PUT /identity/v3/projects/190d6305caec4d149228676ea7bd5291/users/6ab865ac78ef48c28ec0ce6c1e4c672c/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:41.448303 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa098f65-be85-43c6-ad4b-4bb4c96a6aac admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:41.449879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fa098f65-be85-43c6-ad4b-4bb4c96a6aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:41.487205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1106/2209] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:41 2022] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:41.488474 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d11a06-1f40-4414-9886-3ed4d0d856ce admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:41.557277 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa098f65-be85-43c6-ad4b-4bb4c96a6aac admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:41.573242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d11a06-1f40-4414-9886-3ed4d0d856ce admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:41.578754 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:41.580464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372c19c-9227-402c-abf8-0ce955691b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:41.580464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372c19c-9227-402c-abf8-0ce955691b74 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:41.580721 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372c19c-9227-402c-abf8-0ce955691b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:41.580989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372c19c-9227-402c-abf8-0ce955691b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:41.581699 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372c19c-9227-402c-abf8-0ce955691b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:41.583625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372c19c-9227-402c-abf8-0ce955691b74 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:41.597533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1107/2210] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:41.599290 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372c19c-9227-402c-abf8-0ce955691b74 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:41.617102 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372c19c-9227-402c-abf8-0ce955691b74 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:41.626885 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918c8e9-09da-4515-a2e5-343dbbc35fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:41.628699 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918c8e9-09da-4515-a2e5-343dbbc35fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:41.629053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918c8e9-09da-4515-a2e5-343dbbc35fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:41.629391 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918c8e9-09da-4515-a2e5-343dbbc35fb4 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:41.630505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918c8e9-09da-4515-a2e5-343dbbc35fb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:41.633523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918c8e9-09da-4515-a2e5-343dbbc35fb4 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:41.641022 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea3b81-531f-44ea-af76-82d1d252c0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:41.641965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea3b81-531f-44ea-af76-82d1d252c0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:41.642437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea3b81-531f-44ea-af76-82d1d252c0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:41.642894 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea3b81-531f-44ea-af76-82d1d252c0d1 admin admin] PATH_INFO: `/v3/projects/69db61a4a9244bcd95b78bcd61d03a76` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:41.644295 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea3b81-531f-44ea-af76-82d1d252c0d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69db61a4a9244bcd95b78bcd61d03a76)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:41.646845 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea3b81-531f-44ea-af76-82d1d252c0d1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:41.662599 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1108/2211] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:41 2022] POST /identity/v3/users => generated 297 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:41.665759 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918c8e9-09da-4515-a2e5-343dbbc35fb4 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:41.672583 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:41.679536 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918c8e9-09da-4515-a2e5-343dbbc35fb4 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:41.689117 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1119b33-2f0e-49bb-98e6-7128d9686d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:41.689732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1119b33-2f0e-49bb-98e6-7128d9686d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:41.690182 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1119b33-2f0e-49bb-98e6-7128d9686d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:41.690465 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1119b33-2f0e-49bb-98e6-7128d9686d0e admin admin] PATH_INFO: `/v3/projects/190d6305caec4d149228676ea7bd5291/users/6ab865ac78ef48c28ec0ce6c1e4c672c/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:41.692770 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1119b33-2f0e-49bb-98e6-7128d9686d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=190d6305caec4d149228676ea7bd5291, user_id=6ab865ac78ef48c28ec0ce6c1e4c672c, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:41.696453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1119b33-2f0e-49bb-98e6-7128d9686d0e admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:41.709692 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c4ea3b81-531f-44ea-af76-82d1d252c0d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69db61a4a9244bcd95b78bcd61d03a76', 'request_id': 'req-c4ea3b81-531f-44ea-af76-82d1d252c0d1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:41.721824 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1109/2212] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:41 2022] PUT /identity/v3/projects/190d6305caec4d149228676ea7bd5291/users/6ab865ac78ef48c28ec0ce6c1e4c672c/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:41.723138 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c4ea3b81-531f-44ea-af76-82d1d252c0d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69db61a4a9244bcd95b78bcd61d03a76', 'request_id': 'req-c4ea3b81-531f-44ea-af76-82d1d252c0d1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:41.729738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1119b33-2f0e-49bb-98e6-7128d9686d0e admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:41.732217 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c4ea3b81-531f-44ea-af76-82d1d252c0d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69db61a4a9244bcd95b78bcd61d03a76', 'request_id': 'req-c4ea3b81-531f-44ea-af76-82d1d252c0d1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:41.748107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c4ea3b81-531f-44ea-af76-82d1d252c0d1 admin admin] The token cache is being invalidate because project 69db61a4a9244bcd95b78bcd61d03a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:41.748647 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c4ea3b81-531f-44ea-af76-82d1d252c0d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:41.750387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c4ea3b81-531f-44ea-af76-82d1d252c0d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:41.752391 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1104/2213] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:41 2022] DELETE /identity/v3/projects/69db61a4a9244bcd95b78bcd61d03a76 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:41.753680 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45f2a1-2da4-4c32-b982-4d5c06170c9f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:41.754090 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45f2a1-2da4-4c32-b982-4d5c06170c9f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:41.754377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45f2a1-2da4-4c32-b982-4d5c06170c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:41.787476 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-af45f2a1-2da4-4c32-b982-4d5c06170c9f None None] MFA Rules not processed for user `6ab865ac78ef48c28ec0ce6c1e4c672c`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:41.788934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-af45f2a1-2da4-4c32-b982-4d5c06170c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:41.805374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1119b33-2f0e-49bb-98e6-7128d9686d0e admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:41.810218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9b48c-6296-404d-bfa4-e38a61d4ecf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:41.811086 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9b48c-6296-404d-bfa4-e38a61d4ecf6 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:41.811436 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9b48c-6296-404d-bfa4-e38a61d4ecf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:41.812375 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9b48c-6296-404d-bfa4-e38a61d4ecf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:41.813177 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9b48c-6296-404d-bfa4-e38a61d4ecf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:41.815392 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9b48c-6296-404d-bfa4-e38a61d4ecf6 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:41.828937 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1110/2214] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:41.831511 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d1aa3-2488-4419-af33-33a98c38914e None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:41.831965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d1aa3-2488-4419-af33-33a98c38914e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:41.832514 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d1aa3-2488-4419-af33-33a98c38914e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:41.929895 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-f92d1aa3-2488-4419-af33-33a98c38914e None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:41.937811 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f92d1aa3-2488-4419-af33-33a98c38914e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:41.947821 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1105/2215] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:41.950750 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45f2a1-2da4-4c32-b982-4d5c06170c9f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:41.953016 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-af45f2a1-2da4-4c32-b982-4d5c06170c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:41.956493 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1111/2216] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:41.964444 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a9cca-8f03-4891-bd87-19a50a5f9dba None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:41.965237 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a9cca-8f03-4891-bd87-19a50a5f9dba None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:41.965237 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a9cca-8f03-4891-bd87-19a50a5f9dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:41.987713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45f2a1-2da4-4c32-b982-4d5c06170c9f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:42.001365 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dab40-e64d-47f4-9f0d-cbd12492ccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:42.001663 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-471a9cca-8f03-4891-bd87-19a50a5f9dba None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:42.002188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dab40-e64d-47f4-9f0d-cbd12492ccc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:42.002548 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dab40-e64d-47f4-9f0d-cbd12492ccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:42.002920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dab40-e64d-47f4-9f0d-cbd12492ccc9 admin admin] PATH_INFO: `/v3/projects/79438d06371a446e9bdd6e6796455bc2/users/255e9428d4b247b6b50837d62d1ee0d8/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:42.003667 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-471a9cca-8f03-4891-bd87-19a50a5f9dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:42.024096 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dab40-e64d-47f4-9f0d-cbd12492ccc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79438d06371a446e9bdd6e6796455bc2, user_id=255e9428d4b247b6b50837d62d1ee0d8, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:42.026892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dab40-e64d-47f4-9f0d-cbd12492ccc9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:42.043788 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1112/2217] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:42.045201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a9cca-8f03-4891-bd87-19a50a5f9dba None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:42.050849 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1106/2218] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:41 2022] PUT /identity/v3/projects/79438d06371a446e9bdd6e6796455bc2/users/255e9428d4b247b6b50837d62d1ee0d8/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:42.051273 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-471a9cca-8f03-4891-bd87-19a50a5f9dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:42.052774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dab40-e64d-47f4-9f0d-cbd12492ccc9 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:42.080502 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:42.144217 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a9cca-8f03-4891-bd87-19a50a5f9dba None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:42.179072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dab40-e64d-47f4-9f0d-cbd12492ccc9 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:42.184351 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cab80-f8d2-4bfc-a578-38598df9d74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:42.184634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cab80-f8d2-4bfc-a578-38598df9d74b admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:42.185041 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cab80-f8d2-4bfc-a578-38598df9d74b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:42.185381 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cab80-f8d2-4bfc-a578-38598df9d74b admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:42.186229 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cab80-f8d2-4bfc-a578-38598df9d74b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:42.186418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cab80-f8d2-4bfc-a578-38598df9d74b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:42.188746 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cab80-f8d2-4bfc-a578-38598df9d74b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:42.212638 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1107/2219] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:47:42.212638 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cab80-f8d2-4bfc-a578-38598df9d74b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:42.231631 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cab80-f8d2-4bfc-a578-38598df9d74b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:42.244789 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c703cb3-5d9e-4361-be72-28386e854d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:42.245557 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c703cb3-5d9e-4361-be72-28386e854d62 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:42.245801 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c703cb3-5d9e-4361-be72-28386e854d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:42.246327 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c703cb3-5d9e-4361-be72-28386e854d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:42.246984 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c703cb3-5d9e-4361-be72-28386e854d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:42.251154 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c703cb3-5d9e-4361-be72-28386e854d62 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:42.258842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b24945-01aa-43af-90ce-34c075a06b89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:42.259454 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b24945-01aa-43af-90ce-34c075a06b89 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:42.259735 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b24945-01aa-43af-90ce-34c075a06b89 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:42.260009 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b24945-01aa-43af-90ce-34c075a06b89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:42.265706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1108/2220] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:42.266790 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c703cb3-5d9e-4361-be72-28386e854d62 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:42.285161 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c703cb3-5d9e-4361-be72-28386e854d62 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:42.294474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f357a-839b-4e92-9df1-23cff27984ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:42.296233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f357a-839b-4e92-9df1-23cff27984ae admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:42.296663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f357a-839b-4e92-9df1-23cff27984ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:42.297160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f357a-839b-4e92-9df1-23cff27984ae admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:42.298417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f357a-839b-4e92-9df1-23cff27984ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:42.301138 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f357a-839b-4e92-9df1-23cff27984ae admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:42.318725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:42.340191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1109/2221] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:42 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:42.341055 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f357a-839b-4e92-9df1-23cff27984ae admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:42.347030 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b24945-01aa-43af-90ce-34c075a06b89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:42.348510 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b24945-01aa-43af-90ce-34c075a06b89 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:42.360354 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1113/2222] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:42.361888 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b24945-01aa-43af-90ce-34c075a06b89 service cinder] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:42.376041 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b24945-01aa-43af-90ce-34c075a06b89 service cinder] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:42.447170 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f357a-839b-4e92-9df1-23cff27984ae admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:42.454598 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45223321-df18-444b-b9ad-729a5f979872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:42.455231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45223321-df18-444b-b9ad-729a5f979872 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:42.456058 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd275c6-3e45-4e56-8722-68239824848c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:42.456685 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45223321-df18-444b-b9ad-729a5f979872 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:42.456865 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd275c6-3e45-4e56-8722-68239824848c admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:42.456962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45223321-df18-444b-b9ad-729a5f979872 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:42.457299 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd275c6-3e45-4e56-8722-68239824848c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:42.457630 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45223321-df18-444b-b9ad-729a5f979872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:42.457734 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd275c6-3e45-4e56-8722-68239824848c admin admin] PATH_INFO: `/v3/projects/79438d06371a446e9bdd6e6796455bc2/users/255e9428d4b247b6b50837d62d1ee0d8/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:42.459993 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd275c6-3e45-4e56-8722-68239824848c admin admin] RBAC: Authorizing `identity:create_grant(project_id=79438d06371a446e9bdd6e6796455bc2, user_id=255e9428d4b247b6b50837d62d1ee0d8, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:42.462635 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45223321-df18-444b-b9ad-729a5f979872 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:42.463770 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd275c6-3e45-4e56-8722-68239824848c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:42.498952 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1110/2223] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:42 2022] PUT /identity/v3/projects/79438d06371a446e9bdd6e6796455bc2/users/255e9428d4b247b6b50837d62d1ee0d8/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:42.500576 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d98ca9-750e-4fb7-8b91-d8377d5706e0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:42.500871 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d98ca9-750e-4fb7-8b91-d8377d5706e0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:42.501153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d98ca9-750e-4fb7-8b91-d8377d5706e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:42.526763 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1114/2224] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:42 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:42.532006 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45223321-df18-444b-b9ad-729a5f979872 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:42.543121 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-35d98ca9-750e-4fb7-8b91-d8377d5706e0 None None] MFA Rules not processed for user `255e9428d4b247b6b50837d62d1ee0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:42.544450 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-35d98ca9-750e-4fb7-8b91-d8377d5706e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:42.562831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45223321-df18-444b-b9ad-729a5f979872 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:42.683003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:42.730532 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1111/2225] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:42.746172 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b9c84-21fd-486e-94c3-9103a9c078dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:42.746807 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b9c84-21fd-486e-94c3-9103a9c078dd admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:42.747087 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b9c84-21fd-486e-94c3-9103a9c078dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:42.747360 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b9c84-21fd-486e-94c3-9103a9c078dd admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:42.748085 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b9c84-21fd-486e-94c3-9103a9c078dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:42.750405 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b9c84-21fd-486e-94c3-9103a9c078dd admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:42.756680 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d98ca9-750e-4fb7-8b91-d8377d5706e0 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:42.773268 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1115/2226] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:42.778773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b9c84-21fd-486e-94c3-9103a9c078dd admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:42.794818 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b9c84-21fd-486e-94c3-9103a9c078dd admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:42.807703 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8200d7-9afa-4250-84e3-4ad92f0ea0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:42.808327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8200d7-9afa-4250-84e3-4ad92f0ea0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:42.808624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8200d7-9afa-4250-84e3-4ad92f0ea0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:42.808899 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8200d7-9afa-4250-84e3-4ad92f0ea0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:42.809544 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8200d7-9afa-4250-84e3-4ad92f0ea0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:42.811141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8200d7-9afa-4250-84e3-4ad92f0ea0a1 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:42.836567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d98ca9-750e-4fb7-8b91-d8377d5706e0 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:42.842955 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5d659-968e-4500-812f-da85b4e19bc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:42.843736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5d659-968e-4500-812f-da85b4e19bc7 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:42.844044 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5d659-968e-4500-812f-da85b4e19bc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:42.844398 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5d659-968e-4500-812f-da85b4e19bc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:42.845429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1116/2227] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:42.849450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8200d7-9afa-4250-84e3-4ad92f0ea0a1 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:42.861770 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5d659-968e-4500-812f-da85b4e19bc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:42.864760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5d659-968e-4500-812f-da85b4e19bc7 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:42.872658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8200d7-9afa-4250-84e3-4ad92f0ea0a1 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:42.880222 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1112/2228] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 10:47:42.893752 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fba07-36c5-4a0d-a072-c32bb447511c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:42.895491 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fba07-36c5-4a0d-a072-c32bb447511c admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:42.895783 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fba07-36c5-4a0d-a072-c32bb447511c admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:42.896065 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fba07-36c5-4a0d-a072-c32bb447511c admin admin] PATH_INFO: `/v3/projects/f134c140f2c740af969f107e97316678/users/a69e7a31a0024c48ae272459e11278ad/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:42.920270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fba07-36c5-4a0d-a072-c32bb447511c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f134c140f2c740af969f107e97316678, user_id=a69e7a31a0024c48ae272459e11278ad, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:42.925222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fba07-36c5-4a0d-a072-c32bb447511c admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:42.950068 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1117/2229] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:42 2022] PUT /identity/v3/projects/f134c140f2c740af969f107e97316678/users/a69e7a31a0024c48ae272459e11278ad/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:42.957093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1a372-391d-4e3f-8dce-93dbd5e87524 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:42.957487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1a372-391d-4e3f-8dce-93dbd5e87524 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:42.957815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1a372-391d-4e3f-8dce-93dbd5e87524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:43.000109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b4d1a372-391d-4e3f-8dce-93dbd5e87524 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:43.002570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b4d1a372-391d-4e3f-8dce-93dbd5e87524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:43.105930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1113/2230] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:43.130600 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fba07-36c5-4a0d-a072-c32bb447511c admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:43.138790 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-618fba07-36c5-4a0d-a072-c32bb447511c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:43.195712 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:43.267697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fba07-36c5-4a0d-a072-c32bb447511c admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:43.273883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8ada7-32cb-4fef-89f0-bf78534e2c9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:43.274526 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8ada7-32cb-4fef-89f0-bf78534e2c9e service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:43.274809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8ada7-32cb-4fef-89f0-bf78534e2c9e service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:43.275142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8ada7-32cb-4fef-89f0-bf78534e2c9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:43.301828 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8ada7-32cb-4fef-89f0-bf78534e2c9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:43.303403 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8ada7-32cb-4fef-89f0-bf78534e2c9e service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:43.327281 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1118/2231] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:43.795701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1a372-391d-4e3f-8dce-93dbd5e87524 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:43.797223 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b4d1a372-391d-4e3f-8dce-93dbd5e87524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:43.818456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1a372-391d-4e3f-8dce-93dbd5e87524 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:43.834395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b173e-a883-4882-b055-512f25f8f3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:43.835136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b173e-a883-4882-b055-512f25f8f3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:43.835426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b173e-a883-4882-b055-512f25f8f3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:43.835795 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b173e-a883-4882-b055-512f25f8f3f9 admin admin] PATH_INFO: `/v3/users/5e1477f4266b4e2b8f7d815f57419f63` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:43.837554 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b173e-a883-4882-b055-512f25f8f3f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e1477f4266b4e2b8f7d815f57419f63)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:43.839938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b173e-a883-4882-b055-512f25f8f3f9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:43.866523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8ada7-32cb-4fef-89f0-bf78534e2c9e service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:43.881738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8ada7-32cb-4fef-89f0-bf78534e2c9e service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:43.893204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa4857-815a-4bd5-988a-c154a0f8fc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:43.895312 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa4857-815a-4bd5-988a-c154a0f8fc1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:43.895514 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa4857-815a-4bd5-988a-c154a0f8fc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:43.895803 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa4857-815a-4bd5-988a-c154a0f8fc1e admin admin] PATH_INFO: `/v3/users/413b1193b8784a2b8acad597c8aa8c6b` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:43.899738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa4857-815a-4bd5-988a-c154a0f8fc1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=413b1193b8784a2b8acad597c8aa8c6b)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:43.904943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa4857-815a-4bd5-988a-c154a0f8fc1e admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:43.934249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3a3b173e-a883-4882-b055-512f25f8f3f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e1477f4266b4e2b8f7d815f57419f63'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:43.955631 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3a3b173e-a883-4882-b055-512f25f8f3f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e1477f4266b4e2b8f7d815f57419f63'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:43.956710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3a3b173e-a883-4882-b055-512f25f8f3f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e1477f4266b4e2b8f7d815f57419f63'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:43.957824 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3a3b173e-a883-4882-b055-512f25f8f3f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e1477f4266b4e2b8f7d815f57419f63'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:43.975274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3a3b173e-a883-4882-b055-512f25f8f3f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e1477f4266b4e2b8f7d815f57419f63'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:44.017280 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1114/2232] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:43 2022] DELETE /identity/v3/users/5e1477f4266b4e2b8f7d815f57419f63 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:44.018999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-33fa4857-815a-4bd5-988a-c154a0f8fc1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '413b1193b8784a2b8acad597c8aa8c6b'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:44.022376 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5a583-5875-4764-9a0d-25bed23f4049 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:44.022563 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5a583-5875-4764-9a0d-25bed23f4049 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:44.022843 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5a583-5875-4764-9a0d-25bed23f4049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:44.038134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-33fa4857-815a-4bd5-988a-c154a0f8fc1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '413b1193b8784a2b8acad597c8aa8c6b'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:44.039193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-33fa4857-815a-4bd5-988a-c154a0f8fc1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '413b1193b8784a2b8acad597c8aa8c6b'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:44.040079 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-33fa4857-815a-4bd5-988a-c154a0f8fc1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '413b1193b8784a2b8acad597c8aa8c6b'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:44.056635 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-33fa4857-815a-4bd5-988a-c154a0f8fc1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '413b1193b8784a2b8acad597c8aa8c6b'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:44.058363 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:44.072495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2ba5a583-5875-4764-9a0d-25bed23f4049 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:44.073740 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2ba5a583-5875-4764-9a0d-25bed23f4049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:44.096047 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1119/2233] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:43 2022] DELETE /identity/v3/users/413b1193b8784a2b8acad597c8aa8c6b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:44.100455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278292aa-7c1c-4ad9-a392-fef86dbc7bd4 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:44.101740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278292aa-7c1c-4ad9-a392-fef86dbc7bd4 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:44.102022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278292aa-7c1c-4ad9-a392-fef86dbc7bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:44.142430 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-278292aa-7c1c-4ad9-a392-fef86dbc7bd4 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:44.145491 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-278292aa-7c1c-4ad9-a392-fef86dbc7bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:44.197100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1115/2234] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:44.215843 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5a583-5875-4764-9a0d-25bed23f4049 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:44.218630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2ba5a583-5875-4764-9a0d-25bed23f4049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:44.276000 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1120/2235] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:44.317671 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278292aa-7c1c-4ad9-a392-fef86dbc7bd4 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:44.319480 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-278292aa-7c1c-4ad9-a392-fef86dbc7bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:44.350391 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5a583-5875-4764-9a0d-25bed23f4049 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:44.419535 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:44.448805 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278292aa-7c1c-4ad9-a392-fef86dbc7bd4 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:44.458481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e34c6-e07e-4b43-9497-4b2657902d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:44.459161 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e34c6-e07e-4b43-9497-4b2657902d1d service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:44.459446 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e34c6-e07e-4b43-9497-4b2657902d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:44.459722 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e34c6-e07e-4b43-9497-4b2657902d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:44.469821 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe99245-ed50-4d23-90a9-9926305b983b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:44.472687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe99245-ed50-4d23-90a9-9926305b983b service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:44.473419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe99245-ed50-4d23-90a9-9926305b983b service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:44.473710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe99245-ed50-4d23-90a9-9926305b983b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:44.483939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e34c6-e07e-4b43-9497-4b2657902d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:44.485422 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e34c6-e07e-4b43-9497-4b2657902d1d service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:44.508846 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe99245-ed50-4d23-90a9-9926305b983b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:44.508846 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe99245-ed50-4d23-90a9-9926305b983b service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:44.515513 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1121/2236] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:44.552033 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1116/2237] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 10:47:45.987396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e34c6-e07e-4b43-9497-4b2657902d1d service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:45.989738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-af2e34c6-e07e-4b43-9497-4b2657902d1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:46.020609 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe99245-ed50-4d23-90a9-9926305b983b service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:46.026363 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4fe99245-ed50-4d23-90a9-9926305b983b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:46.043947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e34c6-e07e-4b43-9497-4b2657902d1d service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:46.052383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe99245-ed50-4d23-90a9-9926305b983b service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:46.063333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf2190-cdc3-4c52-8b41-c43bf5b8be37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:46.063992 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf2190-cdc3-4c52-8b41-c43bf5b8be37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:46.064271 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf2190-cdc3-4c52-8b41-c43bf5b8be37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:46.064568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf2190-cdc3-4c52-8b41-c43bf5b8be37 admin admin] PATH_INFO: `/v3/projects/5b4dde8fa08441f8a6c5148c7caf6b35` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:46.067563 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf2190-cdc3-4c52-8b41-c43bf5b8be37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b4dde8fa08441f8a6c5148c7caf6b35)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:46.068467 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a55785-ba6c-48df-a329-106bd8c2999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:46.069475 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a55785-ba6c-48df-a329-106bd8c2999c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:46.070096 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a55785-ba6c-48df-a329-106bd8c2999c admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:46.070438 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf2190-cdc3-4c52-8b41-c43bf5b8be37 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:46.070991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a55785-ba6c-48df-a329-106bd8c2999c admin admin] PATH_INFO: `/v3/projects/7e609dbf54ff4bce943045caae52884b` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:46.078931 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a55785-ba6c-48df-a329-106bd8c2999c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e609dbf54ff4bce943045caae52884b)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:46.081523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a55785-ba6c-48df-a329-106bd8c2999c admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:46.230343 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f8a55785-ba6c-48df-a329-106bd8c2999c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e609dbf54ff4bce943045caae52884b', 'request_id': 'req-f8a55785-ba6c-48df-a329-106bd8c2999c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:46.243838 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f8a55785-ba6c-48df-a329-106bd8c2999c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e609dbf54ff4bce943045caae52884b', 'request_id': 'req-f8a55785-ba6c-48df-a329-106bd8c2999c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:46.270343 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f8a55785-ba6c-48df-a329-106bd8c2999c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e609dbf54ff4bce943045caae52884b', 'request_id': 'req-f8a55785-ba6c-48df-a329-106bd8c2999c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:46.341573 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5ddf2190-cdc3-4c52-8b41-c43bf5b8be37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b4dde8fa08441f8a6c5148c7caf6b35', 'request_id': 'req-5ddf2190-cdc3-4c52-8b41-c43bf5b8be37'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:46.342683 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f8a55785-ba6c-48df-a329-106bd8c2999c admin admin] The token cache is being invalidate because project 7e609dbf54ff4bce943045caae52884b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:46.344029 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f8a55785-ba6c-48df-a329-106bd8c2999c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:46.345586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f8a55785-ba6c-48df-a329-106bd8c2999c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:46.354362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1122/2238] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:45 2022] DELETE /identity/v3/projects/7e609dbf54ff4bce943045caae52884b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:46.361813 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a55785-ba6c-48df-a329-106bd8c2999c admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:46.376332 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f8a55785-ba6c-48df-a329-106bd8c2999c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:46.388205 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5ddf2190-cdc3-4c52-8b41-c43bf5b8be37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b4dde8fa08441f8a6c5148c7caf6b35', 'request_id': 'req-5ddf2190-cdc3-4c52-8b41-c43bf5b8be37'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:46.408934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5ddf2190-cdc3-4c52-8b41-c43bf5b8be37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b4dde8fa08441f8a6c5148c7caf6b35', 'request_id': 'req-5ddf2190-cdc3-4c52-8b41-c43bf5b8be37'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:46.412292 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:46.461724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5ddf2190-cdc3-4c52-8b41-c43bf5b8be37 admin admin] The token cache is being invalidate because project 5b4dde8fa08441f8a6c5148c7caf6b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:46.462122 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5ddf2190-cdc3-4c52-8b41-c43bf5b8be37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:46.465899 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5ddf2190-cdc3-4c52-8b41-c43bf5b8be37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:46.468389 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1117/2239] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:46 2022] DELETE /identity/v3/projects/5b4dde8fa08441f8a6c5148c7caf6b35 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:46.469285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf2190-cdc3-4c52-8b41-c43bf5b8be37 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:46.476169 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5ddf2190-cdc3-4c52-8b41-c43bf5b8be37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:46.564317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a55785-ba6c-48df-a329-106bd8c2999c admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:46.681888 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf2190-cdc3-4c52-8b41-c43bf5b8be37 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:46.694430 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beccb68-e09d-4f91-af1e-d55aa122efdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:46.697438 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beccb68-e09d-4f91-af1e-d55aa122efdc service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:46.697722 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beccb68-e09d-4f91-af1e-d55aa122efdc service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:46.698617 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beccb68-e09d-4f91-af1e-d55aa122efdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:46.709903 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2beccb68-e09d-4f91-af1e-d55aa122efdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:46.725382 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752de67d-0216-4424-b8d0-f48ab84296b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:46.726052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752de67d-0216-4424-b8d0-f48ab84296b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:46.726338 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752de67d-0216-4424-b8d0-f48ab84296b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:46.726610 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752de67d-0216-4424-b8d0-f48ab84296b1 admin admin] PATH_INFO: `/v3/users/6ab865ac78ef48c28ec0ce6c1e4c672c` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:46.731131 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752de67d-0216-4424-b8d0-f48ab84296b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab865ac78ef48c28ec0ce6c1e4c672c)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:46.736676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752de67d-0216-4424-b8d0-f48ab84296b1 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:46.790988 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:46.819823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beccb68-e09d-4f91-af1e-d55aa122efdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:46.822110 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beccb68-e09d-4f91-af1e-d55aa122efdc service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:46.840974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1118/2240] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:46.842510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beccb68-e09d-4f91-af1e-d55aa122efdc service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:46.844762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2beccb68-e09d-4f91-af1e-d55aa122efdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:46.852954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-752de67d-0216-4424-b8d0-f48ab84296b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab865ac78ef48c28ec0ce6c1e4c672c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:46.865067 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-752de67d-0216-4424-b8d0-f48ab84296b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab865ac78ef48c28ec0ce6c1e4c672c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:46.866229 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-752de67d-0216-4424-b8d0-f48ab84296b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab865ac78ef48c28ec0ce6c1e4c672c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:46.867951 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-752de67d-0216-4424-b8d0-f48ab84296b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab865ac78ef48c28ec0ce6c1e4c672c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:46.873702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beccb68-e09d-4f91-af1e-d55aa122efdc service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:46.885410 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-752de67d-0216-4424-b8d0-f48ab84296b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab865ac78ef48c28ec0ce6c1e4c672c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:46.886206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6af72-5060-4700-9a03-a23868e70a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:46.888319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6af72-5060-4700-9a03-a23868e70a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:46.888633 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6af72-5060-4700-9a03-a23868e70a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:46.888912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6af72-5060-4700-9a03-a23868e70a60 admin admin] PATH_INFO: `/v3/users/255e9428d4b247b6b50837d62d1ee0d8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:46.892117 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6af72-5060-4700-9a03-a23868e70a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=255e9428d4b247b6b50837d62d1ee0d8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:46.897786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6af72-5060-4700-9a03-a23868e70a60 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:46.943566 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1123/2241] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:46 2022] DELETE /identity/v3/users/6ab865ac78ef48c28ec0ce6c1e4c672c => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:47.009249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-56c6af72-5060-4700-9a03-a23868e70a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '255e9428d4b247b6b50837d62d1ee0d8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:47.023386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-56c6af72-5060-4700-9a03-a23868e70a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '255e9428d4b247b6b50837d62d1ee0d8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:47.024382 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-56c6af72-5060-4700-9a03-a23868e70a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '255e9428d4b247b6b50837d62d1ee0d8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:47.025063 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-56c6af72-5060-4700-9a03-a23868e70a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '255e9428d4b247b6b50837d62d1ee0d8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:47.042624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-56c6af72-5060-4700-9a03-a23868e70a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '255e9428d4b247b6b50837d62d1ee0d8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:47.097047 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1119/2242] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:46 2022] DELETE /identity/v3/users/255e9428d4b247b6b50837d62d1ee0d8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:48.291306 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752de67d-0216-4424-b8d0-f48ab84296b1 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:48.293649 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-752de67d-0216-4424-b8d0-f48ab84296b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:48.400326 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752de67d-0216-4424-b8d0-f48ab84296b1 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:48.534063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98b7e2-5f44-42ee-9d0f-2cf5de75fc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:48.534715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98b7e2-5f44-42ee-9d0f-2cf5de75fc1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:48.534996 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98b7e2-5f44-42ee-9d0f-2cf5de75fc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:48.535652 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98b7e2-5f44-42ee-9d0f-2cf5de75fc1c admin admin] PATH_INFO: `/v3/projects/79438d06371a446e9bdd6e6796455bc2` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:48.538278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98b7e2-5f44-42ee-9d0f-2cf5de75fc1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=79438d06371a446e9bdd6e6796455bc2)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:48.542481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98b7e2-5f44-42ee-9d0f-2cf5de75fc1c admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:48.681383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:48.689611 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6af72-5060-4700-9a03-a23868e70a60 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:48.691824 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-56c6af72-5060-4700-9a03-a23868e70a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:48.699162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-7c98b7e2-5f44-42ee-9d0f-2cf5de75fc1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79438d06371a446e9bdd6e6796455bc2', 'request_id': 'req-7c98b7e2-5f44-42ee-9d0f-2cf5de75fc1c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:48.721728 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6af72-5060-4700-9a03-a23868e70a60 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:48.738201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-7c98b7e2-5f44-42ee-9d0f-2cf5de75fc1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79438d06371a446e9bdd6e6796455bc2', 'request_id': 'req-7c98b7e2-5f44-42ee-9d0f-2cf5de75fc1c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:48.752173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:48.763562 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-7c98b7e2-5f44-42ee-9d0f-2cf5de75fc1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79438d06371a446e9bdd6e6796455bc2', 'request_id': 'req-7c98b7e2-5f44-42ee-9d0f-2cf5de75fc1c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:48.815720 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-7c98b7e2-5f44-42ee-9d0f-2cf5de75fc1c admin admin] The token cache is being invalidate because project 79438d06371a446e9bdd6e6796455bc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:48.816158 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-7c98b7e2-5f44-42ee-9d0f-2cf5de75fc1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:48.817172 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-7c98b7e2-5f44-42ee-9d0f-2cf5de75fc1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:48.824863 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1124/2243] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:48 2022] DELETE /identity/v3/projects/79438d06371a446e9bdd6e6796455bc2 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:48.827102 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0b9c8-fcdf-44dd-95a8-fa39978ea48d None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:48.827868 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0b9c8-fcdf-44dd-95a8-fa39978ea48d None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:48.827868 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0b9c8-fcdf-44dd-95a8-fa39978ea48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:48.886105 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-1ca0b9c8-fcdf-44dd-95a8-fa39978ea48d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:48.891058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-1ca0b9c8-fcdf-44dd-95a8-fa39978ea48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:48.954030 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f364d-acca-4a8c-a54a-f5b250c03c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:48.954900 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f364d-acca-4a8c-a54a-f5b250c03c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:48.955374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f364d-acca-4a8c-a54a-f5b250c03c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:48.957106 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f364d-acca-4a8c-a54a-f5b250c03c77 admin admin] PATH_INFO: `/v3/projects/190d6305caec4d149228676ea7bd5291` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:48.963047 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f364d-acca-4a8c-a54a-f5b250c03c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=190d6305caec4d149228676ea7bd5291)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:48.966566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f364d-acca-4a8c-a54a-f5b250c03c77 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:49.080961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1125/2244] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:49.089977 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eb0c1-c7be-40fc-96e5-0c5d745205fe None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:49.090336 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eb0c1-c7be-40fc-96e5-0c5d745205fe None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:49.090617 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eb0c1-c7be-40fc-96e5-0c5d745205fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:49.149764 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-ed9eb0c1-c7be-40fc-96e5-0c5d745205fe None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:49.151066 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ed9eb0c1-c7be-40fc-96e5-0c5d745205fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:49.171919 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-736f364d-acca-4a8c-a54a-f5b250c03c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '190d6305caec4d149228676ea7bd5291', 'request_id': 'req-736f364d-acca-4a8c-a54a-f5b250c03c77'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:49.209727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-736f364d-acca-4a8c-a54a-f5b250c03c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '190d6305caec4d149228676ea7bd5291', 'request_id': 'req-736f364d-acca-4a8c-a54a-f5b250c03c77'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:49.236665 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-736f364d-acca-4a8c-a54a-f5b250c03c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '190d6305caec4d149228676ea7bd5291', 'request_id': 'req-736f364d-acca-4a8c-a54a-f5b250c03c77'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:49.301686 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1126/2245] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:49.305808 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9eb0c1-c7be-40fc-96e5-0c5d745205fe None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:49.325706 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9eb0c1-c7be-40fc-96e5-0c5d745205fe None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:49.330269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-736f364d-acca-4a8c-a54a-f5b250c03c77 admin admin] The token cache is being invalidate because project 190d6305caec4d149228676ea7bd5291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:49.333031 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-736f364d-acca-4a8c-a54a-f5b250c03c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:49.335672 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-736f364d-acca-4a8c-a54a-f5b250c03c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:49.339505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34795d1a-b0ac-4e0a-b306-1ae7b189fe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:49.340136 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34795d1a-b0ac-4e0a-b306-1ae7b189fe6c admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:49.340416 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34795d1a-b0ac-4e0a-b306-1ae7b189fe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:49.340718 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34795d1a-b0ac-4e0a-b306-1ae7b189fe6c admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:49.341388 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34795d1a-b0ac-4e0a-b306-1ae7b189fe6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:49.341693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34795d1a-b0ac-4e0a-b306-1ae7b189fe6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:49.346926 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1120/2246] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:48 2022] DELETE /identity/v3/projects/190d6305caec4d149228676ea7bd5291 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:49.347581 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34795d1a-b0ac-4e0a-b306-1ae7b189fe6c admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:49.350229 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb99804-d39d-4161-a911-7514b25be206 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:49.350698 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb99804-d39d-4161-a911-7514b25be206 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:49.351499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb99804-d39d-4161-a911-7514b25be206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:49.378404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1127/2247] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:47:49.383455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34795d1a-b0ac-4e0a-b306-1ae7b189fe6c admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:49.390308 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-34795d1a-b0ac-4e0a-b306-1ae7b189fe6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:49.394625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-eeb99804-d39d-4161-a911-7514b25be206 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:49.395913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-eeb99804-d39d-4161-a911-7514b25be206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:49.406763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1121/2248] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:49.418802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dce30-b88c-496e-8598-1449eb48a56d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:49.419805 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dce30-b88c-496e-8598-1449eb48a56d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:49.420237 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dce30-b88c-496e-8598-1449eb48a56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:49.455814 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34795d1a-b0ac-4e0a-b306-1ae7b189fe6c admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:49.471554 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-326dce30-b88c-496e-8598-1449eb48a56d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:49.474508 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-326dce30-b88c-496e-8598-1449eb48a56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:49.480773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582b46a-52fa-49ec-aa37-faa86dcb329e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:49.481499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582b46a-52fa-49ec-aa37-faa86dcb329e admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:49.481858 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582b46a-52fa-49ec-aa37-faa86dcb329e admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:49.482215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582b46a-52fa-49ec-aa37-faa86dcb329e admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:49.483560 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582b46a-52fa-49ec-aa37-faa86dcb329e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:49.485598 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582b46a-52fa-49ec-aa37-faa86dcb329e admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:49.493065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1122/2249] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:49.495092 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dce30-b88c-496e-8598-1449eb48a56d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:49.513212 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dce30-b88c-496e-8598-1449eb48a56d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:49.527822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996eb3cf-50ce-4336-9e12-a2070351c9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:49.528889 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eb3cf-50ce-4336-9e12-a2070351c9cd admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:49.529443 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eb3cf-50ce-4336-9e12-a2070351c9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:49.530791 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eb3cf-50ce-4336-9e12-a2070351c9cd admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:49.531645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996eb3cf-50ce-4336-9e12-a2070351c9cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:49.532420 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996eb3cf-50ce-4336-9e12-a2070351c9cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:49.536250 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996eb3cf-50ce-4336-9e12-a2070351c9cd admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:49.555527 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1128/2250] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:49 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:49.559509 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582b46a-52fa-49ec-aa37-faa86dcb329e admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:49.571364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1123/2251] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:47:49.573491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996eb3cf-50ce-4336-9e12-a2070351c9cd admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:49.602017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996eb3cf-50ce-4336-9e12-a2070351c9cd admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:49.666748 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:49.715547 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582b46a-52fa-49ec-aa37-faa86dcb329e admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:49.728819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ea48b-7ed4-47cf-9e1f-44cfbe0f450d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:49.729649 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ea48b-7ed4-47cf-9e1f-44cfbe0f450d admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:49.730014 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ea48b-7ed4-47cf-9e1f-44cfbe0f450d admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:49.730357 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ea48b-7ed4-47cf-9e1f-44cfbe0f450d admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:49.731111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ea48b-7ed4-47cf-9e1f-44cfbe0f450d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:49.732069 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b846db8-a459-48f3-9ba2-77e2fd617ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:49.733453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ea48b-7ed4-47cf-9e1f-44cfbe0f450d admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:49.736878 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b846db8-a459-48f3-9ba2-77e2fd617ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:49.737172 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b846db8-a459-48f3-9ba2-77e2fd617ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:49.737454 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b846db8-a459-48f3-9ba2-77e2fd617ed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:49.738116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b846db8-a459-48f3-9ba2-77e2fd617ed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:49.751737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b846db8-a459-48f3-9ba2-77e2fd617ed1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:49.783386 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1129/2252] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:49 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:47:49.788393 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ea48b-7ed4-47cf-9e1f-44cfbe0f450d admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:49.802069 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:49.812700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ea48b-7ed4-47cf-9e1f-44cfbe0f450d admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:49.822548 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1124/2253] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:49 2022] POST /identity/v3/projects => generated 385 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:49.824740 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc29de9-8e4b-4306-bf02-f1fae524da1a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:49.825078 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc29de9-8e4b-4306-bf02-f1fae524da1a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:49.825355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc29de9-8e4b-4306-bf02-f1fae524da1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:49.826960 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4204de-1da9-4341-96c9-8c9679d1d357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:49.827678 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4204de-1da9-4341-96c9-8c9679d1d357 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:49.827889 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4204de-1da9-4341-96c9-8c9679d1d357 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:49.828126 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4204de-1da9-4341-96c9-8c9679d1d357 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:49.828813 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4204de-1da9-4341-96c9-8c9679d1d357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:49.831839 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4204de-1da9-4341-96c9-8c9679d1d357 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:49.847475 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1130/2254] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:49.848793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4204de-1da9-4341-96c9-8c9679d1d357 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:49.876719 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4204de-1da9-4341-96c9-8c9679d1d357 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:49.903594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-bcc29de9-8e4b-4306-bf02-f1fae524da1a None None] MFA Rules not processed for user `80be130a10624a81bd3e874a3745b571`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:49.905657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bcc29de9-8e4b-4306-bf02-f1fae524da1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:50.025160 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94445450-4cc6-408d-af69-bbcbbf538678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:50.025938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94445450-4cc6-408d-af69-bbcbbf538678 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:50.026329 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94445450-4cc6-408d-af69-bbcbbf538678 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:50.026710 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94445450-4cc6-408d-af69-bbcbbf538678 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:50.027478 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94445450-4cc6-408d-af69-bbcbbf538678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:50.029590 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94445450-4cc6-408d-af69-bbcbbf538678 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:50.084743 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1125/2255] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:50.085125 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1131/2256] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:49 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:50.086150 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc29de9-8e4b-4306-bf02-f1fae524da1a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:50.089117 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94445450-4cc6-408d-af69-bbcbbf538678 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:50.108008 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc29de9-8e4b-4306-bf02-f1fae524da1a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:50.115438 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518bf1c-8415-4d01-8e67-fc32983e32db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:50.116319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518bf1c-8415-4d01-8e67-fc32983e32db admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:50.116777 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518bf1c-8415-4d01-8e67-fc32983e32db admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:50.117208 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518bf1c-8415-4d01-8e67-fc32983e32db admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:50.118006 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518bf1c-8415-4d01-8e67-fc32983e32db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:50.118196 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94445450-4cc6-408d-af69-bbcbbf538678 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:50.120614 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518bf1c-8415-4d01-8e67-fc32983e32db admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:50.135159 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15a222-2594-4c3b-9045-c81b9561f902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:50.136049 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15a222-2594-4c3b-9045-c81b9561f902 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:50.136049 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15a222-2594-4c3b-9045-c81b9561f902 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:50.136318 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15a222-2594-4c3b-9045-c81b9561f902 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:50.136754 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1126/2257] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:50.137007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15a222-2594-4c3b-9045-c81b9561f902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:50.137922 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518bf1c-8415-4d01-8e67-fc32983e32db admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:50.138839 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15a222-2594-4c3b-9045-c81b9561f902 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:50.141479 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5518bf1c-8415-4d01-8e67-fc32983e32db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:50.162923 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1132/2258] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:50.162923 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15a222-2594-4c3b-9045-c81b9561f902 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:50.192718 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15a222-2594-4c3b-9045-c81b9561f902 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:50.198391 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5229834-1a0c-49bb-9525-29f425de9c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:50.199069 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5229834-1a0c-49bb-9525-29f425de9c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:50.199349 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5229834-1a0c-49bb-9525-29f425de9c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:50.199623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5229834-1a0c-49bb-9525-29f425de9c67 admin admin] PATH_INFO: `/v3/projects/77951c03fcbd44b69dc0ad316c46826e/users/5097308a05d04453a49890a8b8ab5804/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:50.250783 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5229834-1a0c-49bb-9525-29f425de9c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77951c03fcbd44b69dc0ad316c46826e, user_id=5097308a05d04453a49890a8b8ab5804, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:50.254386 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5229834-1a0c-49bb-9525-29f425de9c67 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:50.259831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518bf1c-8415-4d01-8e67-fc32983e32db admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:50.269644 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6748a5-f749-4afa-910e-512cebd37883 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:50.270493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6748a5-f749-4afa-910e-512cebd37883 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:50.270897 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6748a5-f749-4afa-910e-512cebd37883 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:50.271428 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6748a5-f749-4afa-910e-512cebd37883 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:50.277779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1133/2259] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:50 2022] PUT /identity/v3/projects/77951c03fcbd44b69dc0ad316c46826e/users/5097308a05d04453a49890a8b8ab5804/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:50.278705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5229834-1a0c-49bb-9525-29f425de9c67 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:50.286517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6748a5-f749-4afa-910e-512cebd37883 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:50.289014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6748a5-f749-4afa-910e-512cebd37883 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:50.319378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1127/2260] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:50.321455 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf34787-1265-47cd-8854-ebdbbeac42e9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:50.323489 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf34787-1265-47cd-8854-ebdbbeac42e9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:50.326377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf34787-1265-47cd-8854-ebdbbeac42e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:50.416537 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5229834-1a0c-49bb-9525-29f425de9c67 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:50.430331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90381967-ccda-405e-85a9-172c9fd9c3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:50.431042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90381967-ccda-405e-85a9-172c9fd9c3ea admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:50.431423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90381967-ccda-405e-85a9-172c9fd9c3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:50.431699 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90381967-ccda-405e-85a9-172c9fd9c3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:50.432356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90381967-ccda-405e-85a9-172c9fd9c3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:50.434111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90381967-ccda-405e-85a9-172c9fd9c3ea admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:50.452206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-cbf34787-1265-47cd-8854-ebdbbeac42e9 None None] MFA Rules not processed for user `5097308a05d04453a49890a8b8ab5804`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:50.457164 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1134/2261] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:50.461368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90381967-ccda-405e-85a9-172c9fd9c3ea admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:50.462528 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cbf34787-1265-47cd-8854-ebdbbeac42e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:50.490980 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90381967-ccda-405e-85a9-172c9fd9c3ea admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:50.506532 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c68560-18ef-48a7-98f9-1b18f4f3cde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:50.507288 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c68560-18ef-48a7-98f9-1b18f4f3cde3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:50.507583 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c68560-18ef-48a7-98f9-1b18f4f3cde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:50.508663 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c68560-18ef-48a7-98f9-1b18f4f3cde3 admin admin] PATH_INFO: `/v3/projects/88b19b19ea5744688526c9fc7c7201dc/users/75647fae96ef475d9ba703aa1d6b0cae/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:50.514254 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:50.541999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c68560-18ef-48a7-98f9-1b18f4f3cde3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b19b19ea5744688526c9fc7c7201dc, user_id=75647fae96ef475d9ba703aa1d6b0cae, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:50.550410 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c68560-18ef-48a7-98f9-1b18f4f3cde3 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:50.584728 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1135/2262] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:50 2022] PUT /identity/v3/projects/88b19b19ea5744688526c9fc7c7201dc/users/75647fae96ef475d9ba703aa1d6b0cae/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:50.587869 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c6de6-0f5a-4f7f-be74-d58fcd3fb7df None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:50.588174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c6de6-0f5a-4f7f-be74-d58fcd3fb7df None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:50.588456 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c6de6-0f5a-4f7f-be74-d58fcd3fb7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:50.677072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:50.684455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-b07c6de6-0f5a-4f7f-be74-d58fcd3fb7df None None] MFA Rules not processed for user `75647fae96ef475d9ba703aa1d6b0cae`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:50.686020 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b07c6de6-0f5a-4f7f-be74-d58fcd3fb7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:50.722888 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1128/2263] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:50.732012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf34787-1265-47cd-8854-ebdbbeac42e9 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:50.735561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cbf34787-1265-47cd-8854-ebdbbeac42e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:50.911767 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1136/2264] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:47:50.912739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c6de6-0f5a-4f7f-be74-d58fcd3fb7df None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:50.916999 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf34787-1265-47cd-8854-ebdbbeac42e9 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:50.922702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b07c6de6-0f5a-4f7f-be74-d58fcd3fb7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:51.131065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74954c0f-0fa9-4446-a401-fa2f0577cb73 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28614526d50d4201b93b20df45465d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:51.136226 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74954c0f-0fa9-4446-a401-fa2f0577cb73 service glance] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:51.136535 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74954c0f-0fa9-4446-a401-fa2f0577cb73 service glance] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:51.136823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74954c0f-0fa9-4446-a401-fa2f0577cb73 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:51.171722 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c6de6-0f5a-4f7f-be74-d58fcd3fb7df None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:51.186247 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bcd2e-1c4f-4dbb-b093-9f67d60b4f4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:51.187959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bcd2e-1c4f-4dbb-b093-9f67d60b4f4c service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:51.188242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bcd2e-1c4f-4dbb-b093-9f67d60b4f4c service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:51.188518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bcd2e-1c4f-4dbb-b093-9f67d60b4f4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:51.197451 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9e3bcd2e-1c4f-4dbb-b093-9f67d60b4f4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:51.264588 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74954c0f-0fa9-4446-a401-fa2f0577cb73 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:51.266463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74954c0f-0fa9-4446-a401-fa2f0577cb73 service glance] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:51.295046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1129/2265] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:51.296106 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74954c0f-0fa9-4446-a401-fa2f0577cb73 service glance] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:51.297675 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-74954c0f-0fa9-4446-a401-fa2f0577cb73 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:51.334634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74954c0f-0fa9-4446-a401-fa2f0577cb73 service glance] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:51.340971 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d06a9-3195-4707-a6f8-fc94f2962c4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:51.342068 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d06a9-3195-4707-a6f8-fc94f2962c4b service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:51.343683 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d06a9-3195-4707-a6f8-fc94f2962c4b service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:51.343683 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d06a9-3195-4707-a6f8-fc94f2962c4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:51.356637 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d06a9-3195-4707-a6f8-fc94f2962c4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:51.359185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d06a9-3195-4707-a6f8-fc94f2962c4b service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:51.379410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1130/2266] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:51.446086 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bcd2e-1c4f-4dbb-b093-9f67d60b4f4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:51.447552 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bcd2e-1c4f-4dbb-b093-9f67d60b4f4c service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:51.481584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1137/2267] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:52.532968 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d06a9-3195-4707-a6f8-fc94f2962c4b service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:52.535382 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cc9d06a9-3195-4707-a6f8-fc94f2962c4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:52.630452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:52.741078 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d06a9-3195-4707-a6f8-fc94f2962c4b service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:52.758375 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3926b-efc5-4269-9b4a-5de99073fd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:52.761042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3926b-efc5-4269-9b4a-5de99073fd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:52.762113 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3926b-efc5-4269-9b4a-5de99073fd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:52.768353 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3926b-efc5-4269-9b4a-5de99073fd24 admin admin] PATH_INFO: `/v3/users/61fa435422584fc39b293565b573c352` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:52.773428 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3926b-efc5-4269-9b4a-5de99073fd24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61fa435422584fc39b293565b573c352)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:52.777219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3926b-efc5-4269-9b4a-5de99073fd24 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:52.901418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-23b3926b-efc5-4269-9b4a-5de99073fd24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61fa435422584fc39b293565b573c352'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:52.917855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bfcd8-39fe-49c9-bf6f-a43ed1668193 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:52.918577 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bfcd8-39fe-49c9-bf6f-a43ed1668193 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:52.918868 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bfcd8-39fe-49c9-bf6f-a43ed1668193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:52.935598 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-23b3926b-efc5-4269-9b4a-5de99073fd24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61fa435422584fc39b293565b573c352'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:52.937759 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-23b3926b-efc5-4269-9b4a-5de99073fd24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61fa435422584fc39b293565b573c352'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:52.938969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-23b3926b-efc5-4269-9b4a-5de99073fd24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61fa435422584fc39b293565b573c352'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:52.970368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-23b3926b-efc5-4269-9b4a-5de99073fd24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61fa435422584fc39b293565b573c352'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:53.004591 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-6f5bfcd8-39fe-49c9-bf6f-a43ed1668193 None None] MFA Rules not processed for user `a69e7a31a0024c48ae272459e11278ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:53.008353 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6f5bfcd8-39fe-49c9-bf6f-a43ed1668193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:53.024438 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1131/2268] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:52 2022] DELETE /identity/v3/users/61fa435422584fc39b293565b573c352 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:53.026293 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fc84e-7de0-452f-9359-7567d6b544aa None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:53.029017 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fc84e-7de0-452f-9359-7567d6b544aa None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:53.030687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fc84e-7de0-452f-9359-7567d6b544aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:53.042511 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:53.083487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d56fc84e-7de0-452f-9359-7567d6b544aa None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:53.084750 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d56fc84e-7de0-452f-9359-7567d6b544aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:53.184536 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1138/2269] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:53.185551 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bfcd8-39fe-49c9-bf6f-a43ed1668193 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:53.187274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6f5bfcd8-39fe-49c9-bf6f-a43ed1668193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:53.217037 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bfcd8-39fe-49c9-bf6f-a43ed1668193 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:53.297795 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1132/2270] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:53.314011 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fc84e-7de0-452f-9359-7567d6b544aa None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:53.315496 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d56fc84e-7de0-452f-9359-7567d6b544aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:53.409699 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af948cf3-c3bd-452f-adec-4d6276dadf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:53.410943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af948cf3-c3bd-452f-adec-4d6276dadf73 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:53.411632 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af948cf3-c3bd-452f-adec-4d6276dadf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:53.412632 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af948cf3-c3bd-452f-adec-4d6276dadf73 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:53.413814 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af948cf3-c3bd-452f-adec-4d6276dadf73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:53.418910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af948cf3-c3bd-452f-adec-4d6276dadf73 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:53.492335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fc84e-7de0-452f-9359-7567d6b544aa None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:53.503097 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84530aa8-5b82-43ec-b049-a4f26ea45a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:53.503744 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84530aa8-5b82-43ec-b049-a4f26ea45a62 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:53.504109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84530aa8-5b82-43ec-b049-a4f26ea45a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:53.504398 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84530aa8-5b82-43ec-b049-a4f26ea45a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:53.518531 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:53.528012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84530aa8-5b82-43ec-b049-a4f26ea45a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:53.533955 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84530aa8-5b82-43ec-b049-a4f26ea45a62 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:53.542079 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1139/2271] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:53 2022] POST /identity/v3/projects => generated 383 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:53.555860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af948cf3-c3bd-452f-adec-4d6276dadf73 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:53.559305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1133/2272] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:53.763884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af948cf3-c3bd-452f-adec-4d6276dadf73 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:53.797191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2091a-1777-4d34-ad25-53432127e6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:53.797741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2091a-1777-4d34-ad25-53432127e6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:53.798021 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2091a-1777-4d34-ad25-53432127e6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:53.798296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2091a-1777-4d34-ad25-53432127e6c0 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:53.798950 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2091a-1777-4d34-ad25-53432127e6c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:53.800985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2091a-1777-4d34-ad25-53432127e6c0 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:53.837081 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1140/2273] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:53 2022] POST /identity/v3/users => generated 298 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:53.841511 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84530aa8-5b82-43ec-b049-a4f26ea45a62 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:53.898419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84530aa8-5b82-43ec-b049-a4f26ea45a62 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:53.921245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008067fe-9ade-4a79-aeae-86c5ad99fcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:53.923420 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008067fe-9ade-4a79-aeae-86c5ad99fcaa admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:53.923774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008067fe-9ade-4a79-aeae-86c5ad99fcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:53.928014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008067fe-9ade-4a79-aeae-86c5ad99fcaa admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:53.930200 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008067fe-9ade-4a79-aeae-86c5ad99fcaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:53.937978 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008067fe-9ade-4a79-aeae-86c5ad99fcaa admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:53.968714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2091a-1777-4d34-ad25-53432127e6c0 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:53.970655 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1134/2274] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:54.010360 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2091a-1777-4d34-ad25-53432127e6c0 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:54.030641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2074ff5-3c1e-46a5-a79b-25fb21d4a25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:54.031784 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2074ff5-3c1e-46a5-a79b-25fb21d4a25c admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:54.032473 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2074ff5-3c1e-46a5-a79b-25fb21d4a25c admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:54.032970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2074ff5-3c1e-46a5-a79b-25fb21d4a25c admin admin] PATH_INFO: `/v3/projects/d4fff18590704769974f9c6c9dcc3c45/users/67d0ad36cf8947048b233799813a5435/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:54.075532 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2074ff5-3c1e-46a5-a79b-25fb21d4a25c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4fff18590704769974f9c6c9dcc3c45, user_id=67d0ad36cf8947048b233799813a5435, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:54.078964 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2074ff5-3c1e-46a5-a79b-25fb21d4a25c admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:54.110664 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1141/2275] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:53 2022] PUT /identity/v3/projects/d4fff18590704769974f9c6c9dcc3c45/users/67d0ad36cf8947048b233799813a5435/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:54.114968 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008067fe-9ade-4a79-aeae-86c5ad99fcaa admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:54.130823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008067fe-9ade-4a79-aeae-86c5ad99fcaa admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:54.190143 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e4ef6-2b9a-4590-b4b4-58217d64a499 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:54.190435 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e4ef6-2b9a-4590-b4b4-58217d64a499 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:54.190717 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e4ef6-2b9a-4590-b4b4-58217d64a499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:54.211470 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:54.229189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-ac9e4ef6-2b9a-4590-b4b4-58217d64a499 None None] MFA Rules not processed for user `80be130a10624a81bd3e874a3745b571`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:54.231560 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ac9e4ef6-2b9a-4590-b4b4-58217d64a499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:54.246198 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cfdf9-80a4-45ec-8f22-3cc12e3f0bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:54.247290 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cfdf9-80a4-45ec-8f22-3cc12e3f0bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:54.247740 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cfdf9-80a4-45ec-8f22-3cc12e3f0bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:54.248092 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cfdf9-80a4-45ec-8f22-3cc12e3f0bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:54.249663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cfdf9-80a4-45ec-8f22-3cc12e3f0bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:54.252064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cfdf9-80a4-45ec-8f22-3cc12e3f0bd8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:54.272412 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1135/2276] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:54.275029 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cfdf9-80a4-45ec-8f22-3cc12e3f0bd8 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:54.278981 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cb5cfdf9-80a4-45ec-8f22-3cc12e3f0bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:54.296560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cfdf9-80a4-45ec-8f22-3cc12e3f0bd8 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:54.306382 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa725b5-ffa0-4885-a8ad-acc5c8f19cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:54.307045 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa725b5-ffa0-4885-a8ad-acc5c8f19cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:54.307367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa725b5-ffa0-4885-a8ad-acc5c8f19cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:54.307651 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa725b5-ffa0-4885-a8ad-acc5c8f19cfd admin admin] PATH_INFO: `/v3/projects/f5f2f637da044945a873ad2709b32817` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:54.309041 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa725b5-ffa0-4885-a8ad-acc5c8f19cfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5f2f637da044945a873ad2709b32817)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:54.311842 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa725b5-ffa0-4885-a8ad-acc5c8f19cfd admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:54.340480 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1142/2277] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:54.341541 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e4ef6-2b9a-4590-b4b4-58217d64a499 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:54.359394 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e4ef6-2b9a-4590-b4b4-58217d64a499 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:54.367840 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a06b87-7f28-4ec7-8d32-be4a3c9d57b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:54.369005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a06b87-7f28-4ec7-8d32-be4a3c9d57b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:54.369379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a06b87-7f28-4ec7-8d32-be4a3c9d57b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:54.369798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a06b87-7f28-4ec7-8d32-be4a3c9d57b0 admin admin] PATH_INFO: `/v3/projects/d4fff18590704769974f9c6c9dcc3c45/users/67d0ad36cf8947048b233799813a5435/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:54.372392 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a06b87-7f28-4ec7-8d32-be4a3c9d57b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4fff18590704769974f9c6c9dcc3c45, user_id=67d0ad36cf8947048b233799813a5435, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:54.376143 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a06b87-7f28-4ec7-8d32-be4a3c9d57b0 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:54.392587 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1143/2278] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:54 2022] PUT /identity/v3/projects/d4fff18590704769974f9c6c9dcc3c45/users/67d0ad36cf8947048b233799813a5435/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:54.414642 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8aa725b5-ffa0-4885-a8ad-acc5c8f19cfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5f2f637da044945a873ad2709b32817', 'request_id': 'req-8aa725b5-ffa0-4885-a8ad-acc5c8f19cfd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:54.427256 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8aa725b5-ffa0-4885-a8ad-acc5c8f19cfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5f2f637da044945a873ad2709b32817', 'request_id': 'req-8aa725b5-ffa0-4885-a8ad-acc5c8f19cfd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:54.439760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8aa725b5-ffa0-4885-a8ad-acc5c8f19cfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5f2f637da044945a873ad2709b32817', 'request_id': 'req-8aa725b5-ffa0-4885-a8ad-acc5c8f19cfd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:54.456633 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8aa725b5-ffa0-4885-a8ad-acc5c8f19cfd admin admin] The token cache is being invalidate because project f5f2f637da044945a873ad2709b32817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:54.457855 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8aa725b5-ffa0-4885-a8ad-acc5c8f19cfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:54.458620 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8aa725b5-ffa0-4885-a8ad-acc5c8f19cfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:54.460923 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1136/2279] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:54 2022] DELETE /identity/v3/projects/f5f2f637da044945a873ad2709b32817 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:54.464817 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a06b87-7f28-4ec7-8d32-be4a3c9d57b0 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:54.467488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-02a06b87-7f28-4ec7-8d32-be4a3c9d57b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:54.592927 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a06b87-7f28-4ec7-8d32-be4a3c9d57b0 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:54.671866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00217242-77b4-4742-b40c-b4d4327caa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:54.672532 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217242-77b4-4742-b40c-b4d4327caa0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:54.672842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217242-77b4-4742-b40c-b4d4327caa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:54.673124 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217242-77b4-4742-b40c-b4d4327caa0f admin admin] PATH_INFO: `/v3/users/44ef9423e9194322a62d11f467891fc6` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:54.674362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00217242-77b4-4742-b40c-b4d4327caa0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ef9423e9194322a62d11f467891fc6)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:54.676539 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00217242-77b4-4742-b40c-b4d4327caa0f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:54.736941 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:54.742126 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-00217242-77b4-4742-b40c-b4d4327caa0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ef9423e9194322a62d11f467891fc6'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:54.756791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-00217242-77b4-4742-b40c-b4d4327caa0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ef9423e9194322a62d11f467891fc6'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:54.758708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-00217242-77b4-4742-b40c-b4d4327caa0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ef9423e9194322a62d11f467891fc6'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:54.759473 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-00217242-77b4-4742-b40c-b4d4327caa0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ef9423e9194322a62d11f467891fc6'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:54.772338 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-00217242-77b4-4742-b40c-b4d4327caa0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ef9423e9194322a62d11f467891fc6'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:54.812055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1144/2280] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:54 2022] DELETE /identity/v3/users/44ef9423e9194322a62d11f467891fc6 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:55.328281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa725b5-ffa0-4885-a8ad-acc5c8f19cfd admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:55.359161 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa725b5-ffa0-4885-a8ad-acc5c8f19cfd admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:55.507581 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ec027-300b-4da4-b39b-b7f9f4fd632f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:55.508255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ec027-300b-4da4-b39b-b7f9f4fd632f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:55.508535 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ec027-300b-4da4-b39b-b7f9f4fd632f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:55.508836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ec027-300b-4da4-b39b-b7f9f4fd632f admin admin] PATH_INFO: `/v3/projects/2551c5e8c531401a96fd9128944194b5` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:55.511235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ec027-300b-4da4-b39b-b7f9f4fd632f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2551c5e8c531401a96fd9128944194b5)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:55.513236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ec027-300b-4da4-b39b-b7f9f4fd632f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:55.533550 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:55.638974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a00ec027-300b-4da4-b39b-b7f9f4fd632f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2551c5e8c531401a96fd9128944194b5', 'request_id': 'req-a00ec027-300b-4da4-b39b-b7f9f4fd632f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:55.656692 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a00ec027-300b-4da4-b39b-b7f9f4fd632f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2551c5e8c531401a96fd9128944194b5', 'request_id': 'req-a00ec027-300b-4da4-b39b-b7f9f4fd632f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:55.669784 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a00ec027-300b-4da4-b39b-b7f9f4fd632f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2551c5e8c531401a96fd9128944194b5', 'request_id': 'req-a00ec027-300b-4da4-b39b-b7f9f4fd632f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:55.744159 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a00ec027-300b-4da4-b39b-b7f9f4fd632f admin admin] The token cache is being invalidate because project 2551c5e8c531401a96fd9128944194b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:47:55.746605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a00ec027-300b-4da4-b39b-b7f9f4fd632f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:55.747763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a00ec027-300b-4da4-b39b-b7f9f4fd632f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:55.772659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1137/2281] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:47:55 2022] DELETE /identity/v3/projects/2551c5e8c531401a96fd9128944194b5 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:55.777497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0d3d0-f6cd-420e-8925-35f9fb4d5812 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:55.778380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0d3d0-f6cd-420e-8925-35f9fb4d5812 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:55.778846 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0d3d0-f6cd-420e-8925-35f9fb4d5812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:55.855214 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-64c0d3d0-f6cd-420e-8925-35f9fb4d5812 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:55.856558 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-64c0d3d0-f6cd-420e-8925-35f9fb4d5812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:56.101473 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1145/2282] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:56.110770 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6c1e-5bfc-40f5-875b-ed5fa3afdef3 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:56.111236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6c1e-5bfc-40f5-875b-ed5fa3afdef3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:56.111654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6c1e-5bfc-40f5-875b-ed5fa3afdef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:56.159687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-377c6c1e-5bfc-40f5-875b-ed5fa3afdef3 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:56.159687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-377c6c1e-5bfc-40f5-875b-ed5fa3afdef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:56.220087 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1138/2283] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:56.221521 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0d3d0-f6cd-420e-8925-35f9fb4d5812 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:56.236819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0d3d0-f6cd-420e-8925-35f9fb4d5812 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:56.255877 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14651cf-a3bf-459a-871a-ab2c9c6d3599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:56.256796 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14651cf-a3bf-459a-871a-ab2c9c6d3599 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:56.257523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14651cf-a3bf-459a-871a-ab2c9c6d3599 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:56.257994 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14651cf-a3bf-459a-871a-ab2c9c6d3599 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:56.260355 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14651cf-a3bf-459a-871a-ab2c9c6d3599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:47:56.261277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14651cf-a3bf-459a-871a-ab2c9c6d3599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:56.266249 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14651cf-a3bf-459a-871a-ab2c9c6d3599 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:56.340301 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1146/2284] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:47:56.346296 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c6c1e-5bfc-40f5-875b-ed5fa3afdef3 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:56.358602 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c6c1e-5bfc-40f5-875b-ed5fa3afdef3 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:56.366033 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d827f0-b986-4d67-8c25-ee7caddd5729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:56.366938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d827f0-b986-4d67-8c25-ee7caddd5729 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:56.367372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d827f0-b986-4d67-8c25-ee7caddd5729 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:56.368171 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d827f0-b986-4d67-8c25-ee7caddd5729 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:56.369052 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d827f0-b986-4d67-8c25-ee7caddd5729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:56.371470 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d827f0-b986-4d67-8c25-ee7caddd5729 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:56.437161 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1139/2285] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:47:56 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:47:56.441576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14651cf-a3bf-459a-871a-ab2c9c6d3599 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:56.463695 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14651cf-a3bf-459a-871a-ab2c9c6d3599 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:56.619196 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9aa787-ddb6-45df-a8a6-81f100870e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:56.619843 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aa787-ddb6-45df-a8a6-81f100870e2b admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:56.620175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aa787-ddb6-45df-a8a6-81f100870e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:56.620458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aa787-ddb6-45df-a8a6-81f100870e2b admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:56.621168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9aa787-ddb6-45df-a8a6-81f100870e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:56.623154 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9aa787-ddb6-45df-a8a6-81f100870e2b admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:56.656206 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1147/2286] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:47:56 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:47:56.660121 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d827f0-b986-4d67-8c25-ee7caddd5729 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:56.673503 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d827f0-b986-4d67-8c25-ee7caddd5729 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:56.682563 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062eda9-6da9-45fa-b734-e319181fe3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:56.683323 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062eda9-6da9-45fa-b734-e319181fe3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:56.684013 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062eda9-6da9-45fa-b734-e319181fe3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:56.684013 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062eda9-6da9-45fa-b734-e319181fe3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:56.684719 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062eda9-6da9-45fa-b734-e319181fe3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:56.687415 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062eda9-6da9-45fa-b734-e319181fe3e0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:56.701062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1140/2287] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:56.704857 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9aa787-ddb6-45df-a8a6-81f100870e2b admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:56.739319 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9aa787-ddb6-45df-a8a6-81f100870e2b admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:56.747737 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00022c58-ae15-495d-b874-fd70fea8d099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:56.750848 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00022c58-ae15-495d-b874-fd70fea8d099 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:56.750848 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00022c58-ae15-495d-b874-fd70fea8d099 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:56.750848 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00022c58-ae15-495d-b874-fd70fea8d099 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:56.750848 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00022c58-ae15-495d-b874-fd70fea8d099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:56.753319 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00022c58-ae15-495d-b874-fd70fea8d099 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:56.771703 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1148/2288] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:47:56.775444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062eda9-6da9-45fa-b734-e319181fe3e0 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:56.793060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062eda9-6da9-45fa-b734-e319181fe3e0 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:56.803714 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0eb64-fb1d-4fb8-a8d3-96ae5dadb634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:56.804636 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0eb64-fb1d-4fb8-a8d3-96ae5dadb634 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:56.809287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0eb64-fb1d-4fb8-a8d3-96ae5dadb634 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:56.810495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0eb64-fb1d-4fb8-a8d3-96ae5dadb634 admin admin] PATH_INFO: `/v3/projects/4450bab37828476081a02d2330f757b6/users/5bc0f95a9c0640b9a1e8a36f87f5b9e1/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:56.844437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0eb64-fb1d-4fb8-a8d3-96ae5dadb634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4450bab37828476081a02d2330f757b6, user_id=5bc0f95a9c0640b9a1e8a36f87f5b9e1, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:56.848440 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0eb64-fb1d-4fb8-a8d3-96ae5dadb634 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:56.881224 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1141/2289] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:47:56 2022] PUT /identity/v3/projects/4450bab37828476081a02d2330f757b6/users/5bc0f95a9c0640b9a1e8a36f87f5b9e1/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:56.894478 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93be6c9-9af2-48ba-ae35-0ce470b4dc22 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:56.894941 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93be6c9-9af2-48ba-ae35-0ce470b4dc22 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:56.895231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93be6c9-9af2-48ba-ae35-0ce470b4dc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:56.959550 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-a93be6c9-9af2-48ba-ae35-0ce470b4dc22 None None] MFA Rules not processed for user `5bc0f95a9c0640b9a1e8a36f87f5b9e1`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:56.962828 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a93be6c9-9af2-48ba-ae35-0ce470b4dc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:57.019571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:57.154214 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1149/2290] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:47:57.168145 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0eb64-fb1d-4fb8-a8d3-96ae5dadb634 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:57.171188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4aa0eb64-fb1d-4fb8-a8d3-96ae5dadb634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:57.351388 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0eb64-fb1d-4fb8-a8d3-96ae5dadb634 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:57.363163 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b75a6c-4c9e-4fd0-a13b-b11f3af39cd8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28614526d50d4201b93b20df45465d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:57.364103 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75a6c-4c9e-4fd0-a13b-b11f3af39cd8 service glance] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:57.364389 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75a6c-4c9e-4fd0-a13b-b11f3af39cd8 service glance] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:57.364693 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75a6c-4c9e-4fd0-a13b-b11f3af39cd8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:57.402001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b75a6c-4c9e-4fd0-a13b-b11f3af39cd8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:57.405569 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b75a6c-4c9e-4fd0-a13b-b11f3af39cd8 service glance] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:57.445304 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1142/2291] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:47:58.934497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93be6c9-9af2-48ba-ae35-0ce470b4dc22 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:58.936468 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a93be6c9-9af2-48ba-ae35-0ce470b4dc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:59.131933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93be6c9-9af2-48ba-ae35-0ce470b4dc22 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:59.145649 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba427b-6d96-44eb-9943-ae90bebbbcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:59.146685 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba427b-6d96-44eb-9943-ae90bebbbcd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:59.147202 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba427b-6d96-44eb-9943-ae90bebbbcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:59.147679 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba427b-6d96-44eb-9943-ae90bebbbcd7 admin admin] PATH_INFO: `/v3/users/75647fae96ef475d9ba703aa1d6b0cae` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:59.149153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba427b-6d96-44eb-9943-ae90bebbbcd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75647fae96ef475d9ba703aa1d6b0cae)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:59.151619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba427b-6d96-44eb-9943-ae90bebbbcd7 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:59.260160 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f7ba427b-6d96-44eb-9943-ae90bebbbcd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75647fae96ef475d9ba703aa1d6b0cae'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:59.276972 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f7ba427b-6d96-44eb-9943-ae90bebbbcd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75647fae96ef475d9ba703aa1d6b0cae'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:59.278318 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f7ba427b-6d96-44eb-9943-ae90bebbbcd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75647fae96ef475d9ba703aa1d6b0cae'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:59.280660 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f7ba427b-6d96-44eb-9943-ae90bebbbcd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75647fae96ef475d9ba703aa1d6b0cae'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:59.302722 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f7ba427b-6d96-44eb-9943-ae90bebbbcd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75647fae96ef475d9ba703aa1d6b0cae'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:47:59.332514 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1150/2292] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:47:58 2022] DELETE /identity/v3/users/75647fae96ef475d9ba703aa1d6b0cae => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:47:59.336722 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f11481-c246-422d-b93e-5426eba5885c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:59.338043 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f11481-c246-422d-b93e-5426eba5885c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:59.338478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f11481-c246-422d-b93e-5426eba5885c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:59.397646 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a5f11481-c246-422d-b93e-5426eba5885c None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:47:59.399595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a5f11481-c246-422d-b93e-5426eba5885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:59.437853 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:59.612730 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1143/2293] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:47:59.621920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba427b-6d96-44eb-9943-ae90bebbbcd7 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:47:59.624126 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f7ba427b-6d96-44eb-9943-ae90bebbbcd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:47:59.810191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:47:59.853200 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba427b-6d96-44eb-9943-ae90bebbbcd7 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:47:59.861981 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4017fa-954f-4f5a-b119-ac8009d7b930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:47:59.868452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4017fa-954f-4f5a-b119-ac8009d7b930 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:47:59.868944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4017fa-954f-4f5a-b119-ac8009d7b930 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:47:59.869343 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4017fa-954f-4f5a-b119-ac8009d7b930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:47:59.891329 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4017fa-954f-4f5a-b119-ac8009d7b930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:47:59.894441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4017fa-954f-4f5a-b119-ac8009d7b930 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:47:59.919743 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1151/2294] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:47:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:48:00.660319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f11481-c246-422d-b93e-5426eba5885c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:00.662872 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a5f11481-c246-422d-b93e-5426eba5885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:00.687177 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f11481-c246-422d-b93e-5426eba5885c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:00.700868 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c759f5-d396-49d3-9896-e73eb3b27add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:00.702254 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c759f5-d396-49d3-9896-e73eb3b27add admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:00.705049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c759f5-d396-49d3-9896-e73eb3b27add admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:00.721920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c759f5-d396-49d3-9896-e73eb3b27add admin admin] PATH_INFO: `/v3/projects/88b19b19ea5744688526c9fc7c7201dc` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:00.725950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c759f5-d396-49d3-9896-e73eb3b27add admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b19b19ea5744688526c9fc7c7201dc)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:00.728222 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c759f5-d396-49d3-9896-e73eb3b27add admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:00.854410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-46c759f5-d396-49d3-9896-e73eb3b27add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b19b19ea5744688526c9fc7c7201dc', 'request_id': 'req-46c759f5-d396-49d3-9896-e73eb3b27add'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:00.865180 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-46c759f5-d396-49d3-9896-e73eb3b27add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b19b19ea5744688526c9fc7c7201dc', 'request_id': 'req-46c759f5-d396-49d3-9896-e73eb3b27add'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:00.877742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-46c759f5-d396-49d3-9896-e73eb3b27add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b19b19ea5744688526c9fc7c7201dc', 'request_id': 'req-46c759f5-d396-49d3-9896-e73eb3b27add'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:00.905805 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-46c759f5-d396-49d3-9896-e73eb3b27add admin admin] The token cache is being invalidate because project 88b19b19ea5744688526c9fc7c7201dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:48:00.906109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-46c759f5-d396-49d3-9896-e73eb3b27add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:00.907953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-46c759f5-d396-49d3-9896-e73eb3b27add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:00.922480 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1144/2295] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:48:00 2022] DELETE /identity/v3/projects/88b19b19ea5744688526c9fc7c7201dc => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:00.928780 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064df31-a50e-4c53-9c3b-d9bb8fb982be None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:00.929505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064df31-a50e-4c53-9c3b-d9bb8fb982be None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:00.929505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064df31-a50e-4c53-9c3b-d9bb8fb982be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:01.008664 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-3064df31-a50e-4c53-9c3b-d9bb8fb982be None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:01.010006 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3064df31-a50e-4c53-9c3b-d9bb8fb982be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:01.135041 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1152/2296] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:01.142919 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd223405-88a9-442f-a4ed-2a32f8682c1d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:01.143410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd223405-88a9-442f-a4ed-2a32f8682c1d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:01.143812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd223405-88a9-442f-a4ed-2a32f8682c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:01.187788 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-fd223405-88a9-442f-a4ed-2a32f8682c1d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:01.189166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fd223405-88a9-442f-a4ed-2a32f8682c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:01.225614 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1145/2297] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:01.230124 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064df31-a50e-4c53-9c3b-d9bb8fb982be None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:01.241308 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064df31-a50e-4c53-9c3b-d9bb8fb982be None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:01.247001 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ed938-58af-4afc-a22f-6c31253b7c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:01.247627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ed938-58af-4afc-a22f-6c31253b7c1c admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:01.247978 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ed938-58af-4afc-a22f-6c31253b7c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:01.248715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ed938-58af-4afc-a22f-6c31253b7c1c admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:01.249398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ed938-58af-4afc-a22f-6c31253b7c1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:48:01.250105 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ed938-58af-4afc-a22f-6c31253b7c1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:01.251324 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ed938-58af-4afc-a22f-6c31253b7c1c admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:01.279657 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1153/2298] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:48:01.281134 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd223405-88a9-442f-a4ed-2a32f8682c1d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:01.293628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd223405-88a9-442f-a4ed-2a32f8682c1d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:01.298776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52f8d4-1eea-417e-a272-5a9e08d7648f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:01.299472 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52f8d4-1eea-417e-a272-5a9e08d7648f admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:01.300375 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52f8d4-1eea-417e-a272-5a9e08d7648f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:01.300685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52f8d4-1eea-417e-a272-5a9e08d7648f admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:01.301591 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52f8d4-1eea-417e-a272-5a9e08d7648f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:01.303498 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52f8d4-1eea-417e-a272-5a9e08d7648f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:01.338542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1146/2299] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:48:01 2022] POST /identity/v3/projects => generated 359 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:48:01.343221 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ed938-58af-4afc-a22f-6c31253b7c1c admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:01.356080 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ed938-58af-4afc-a22f-6c31253b7c1c admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:01.512250 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc552e-3438-4a9d-a364-8ab749f285d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:01.513015 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc552e-3438-4a9d-a364-8ab749f285d2 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:01.513538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc552e-3438-4a9d-a364-8ab749f285d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:01.514086 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc552e-3438-4a9d-a364-8ab749f285d2 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:01.515311 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc552e-3438-4a9d-a364-8ab749f285d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:01.518516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc552e-3438-4a9d-a364-8ab749f285d2 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:01.582554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1154/2300] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:48:01 2022] POST /identity/v3/users => generated 280 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:48:01.583822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52f8d4-1eea-417e-a272-5a9e08d7648f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:01.597999 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52f8d4-1eea-417e-a272-5a9e08d7648f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:01.613275 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f6691-072a-4938-8412-5722eb76dd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:01.614513 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f6691-072a-4938-8412-5722eb76dd87 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:01.615810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f6691-072a-4938-8412-5722eb76dd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:01.617318 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f6691-072a-4938-8412-5722eb76dd87 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:01.618691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f6691-072a-4938-8412-5722eb76dd87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:01.633668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f6691-072a-4938-8412-5722eb76dd87 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:01.665840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1147/2301] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:48:01.671261 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc552e-3438-4a9d-a364-8ab749f285d2 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:01.683180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc552e-3438-4a9d-a364-8ab749f285d2 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:01.697983 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe07c9-b94b-43ea-8b0d-58a9ccaaf4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:01.698621 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe07c9-b94b-43ea-8b0d-58a9ccaaf4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:01.698919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe07c9-b94b-43ea-8b0d-58a9ccaaf4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:01.699429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe07c9-b94b-43ea-8b0d-58a9ccaaf4d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:01.701819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe07c9-b94b-43ea-8b0d-58a9ccaaf4d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:01.702830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe07c9-b94b-43ea-8b0d-58a9ccaaf4d1 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:01.751151 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1155/2302] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:48:01.751484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f6691-072a-4938-8412-5722eb76dd87 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:01.772367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f6691-072a-4938-8412-5722eb76dd87 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:01.796527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc52f6-76f0-4c1b-b129-a4903d9b417f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:01.797246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc52f6-76f0-4c1b-b129-a4903d9b417f admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:01.797536 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc52f6-76f0-4c1b-b129-a4903d9b417f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:01.797804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc52f6-76f0-4c1b-b129-a4903d9b417f admin admin] PATH_INFO: `/v3/projects/7fcac4fdb2314b6dab166d72549bf146/users/711932ba977e4aa1b791d7fb35725abb/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:01.851824 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc52f6-76f0-4c1b-b129-a4903d9b417f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcac4fdb2314b6dab166d72549bf146, user_id=711932ba977e4aa1b791d7fb35725abb, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:01.862138 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc52f6-76f0-4c1b-b129-a4903d9b417f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:01.900508 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1148/2303] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:48:01 2022] PUT /identity/v3/projects/7fcac4fdb2314b6dab166d72549bf146/users/711932ba977e4aa1b791d7fb35725abb/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:01.918422 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed134d33-85a8-47d7-aa6f-cd93849563f8 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:01.918707 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed134d33-85a8-47d7-aa6f-cd93849563f8 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:01.918983 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed134d33-85a8-47d7-aa6f-cd93849563f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:02.038031 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-ed134d33-85a8-47d7-aa6f-cd93849563f8 None None] MFA Rules not processed for user `711932ba977e4aa1b791d7fb35725abb`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:02.041935 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ed134d33-85a8-47d7-aa6f-cd93849563f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:02.259717 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:02.387594 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1156/2304] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:02.451081 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc52f6-76f0-4c1b-b129-a4903d9b417f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:02.454360 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-edfc52f6-76f0-4c1b-b129-a4903d9b417f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:02.614540 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc52f6-76f0-4c1b-b129-a4903d9b417f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:02.621183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2b298-3484-4e72-bfc9-257fb0f530af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:02.624298 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2b298-3484-4e72-bfc9-257fb0f530af service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:02.624678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2b298-3484-4e72-bfc9-257fb0f530af service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:02.624963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2b298-3484-4e72-bfc9-257fb0f530af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:02.632228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:02.637738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2b298-3484-4e72-bfc9-257fb0f530af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:02.641145 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2b298-3484-4e72-bfc9-257fb0f530af service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:02.658576 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1149/2305] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:48:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:48:02.678200 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed134d33-85a8-47d7-aa6f-cd93849563f8 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:02.775217 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed134d33-85a8-47d7-aa6f-cd93849563f8 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:02.781779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8807191-bb29-4793-804c-5ff948dddb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:02.782572 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8807191-bb29-4793-804c-5ff948dddb85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:02.783015 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8807191-bb29-4793-804c-5ff948dddb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:02.783373 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8807191-bb29-4793-804c-5ff948dddb85 admin admin] PATH_INFO: `/v3/users/711932ba977e4aa1b791d7fb35725abb` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:02.784894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8807191-bb29-4793-804c-5ff948dddb85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=711932ba977e4aa1b791d7fb35725abb)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:02.787013 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8807191-bb29-4793-804c-5ff948dddb85 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:02.865052 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a8807191-bb29-4793-804c-5ff948dddb85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '711932ba977e4aa1b791d7fb35725abb'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:02.874614 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a8807191-bb29-4793-804c-5ff948dddb85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '711932ba977e4aa1b791d7fb35725abb'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:02.875344 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a8807191-bb29-4793-804c-5ff948dddb85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '711932ba977e4aa1b791d7fb35725abb'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:02.876414 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a8807191-bb29-4793-804c-5ff948dddb85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '711932ba977e4aa1b791d7fb35725abb'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:02.890895 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a8807191-bb29-4793-804c-5ff948dddb85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '711932ba977e4aa1b791d7fb35725abb'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:02.920275 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1157/2306] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:48:02 2022] DELETE /identity/v3/users/711932ba977e4aa1b791d7fb35725abb => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:02.925605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb0298-dcc0-4d3a-a6ea-56ac6eaba854 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:02.927196 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb0298-dcc0-4d3a-a6ea-56ac6eaba854 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:02.927818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb0298-dcc0-4d3a-a6ea-56ac6eaba854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:02.959413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-8eeb0298-dcc0-4d3a-a6ea-56ac6eaba854 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:02.961160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8eeb0298-dcc0-4d3a-a6ea-56ac6eaba854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:03.097636 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1150/2307] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:03.107170 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8807191-bb29-4793-804c-5ff948dddb85 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:03.110810 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a8807191-bb29-4793-804c-5ff948dddb85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:03.250086 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8807191-bb29-4793-804c-5ff948dddb85 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:03.277662 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd4317-fab0-4785-ad25-fad233b385b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:03.278523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd4317-fab0-4785-ad25-fad233b385b8 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:03.279041 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd4317-fab0-4785-ad25-fad233b385b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:03.279465 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd4317-fab0-4785-ad25-fad233b385b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:03.306915 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd4317-fab0-4785-ad25-fad233b385b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:03.308910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd4317-fab0-4785-ad25-fad233b385b8 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:03.332038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:03.346896 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1158/2308] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:48:04.405371 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb0298-dcc0-4d3a-a6ea-56ac6eaba854 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:04.406858 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8eeb0298-dcc0-4d3a-a6ea-56ac6eaba854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:04.437711 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb0298-dcc0-4d3a-a6ea-56ac6eaba854 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:04.456411 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf5e76-fb4e-4110-9d2a-c3f8a65fb94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:04.457930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf5e76-fb4e-4110-9d2a-c3f8a65fb94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:04.458389 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf5e76-fb4e-4110-9d2a-c3f8a65fb94c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:04.459233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf5e76-fb4e-4110-9d2a-c3f8a65fb94c admin admin] PATH_INFO: `/v3/projects/7fcac4fdb2314b6dab166d72549bf146` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:04.462741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf5e76-fb4e-4110-9d2a-c3f8a65fb94c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fcac4fdb2314b6dab166d72549bf146)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:04.465870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf5e76-fb4e-4110-9d2a-c3f8a65fb94c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:04.569227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c9bf5e76-fb4e-4110-9d2a-c3f8a65fb94c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fcac4fdb2314b6dab166d72549bf146', 'request_id': 'req-c9bf5e76-fb4e-4110-9d2a-c3f8a65fb94c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:04.577286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c9bf5e76-fb4e-4110-9d2a-c3f8a65fb94c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fcac4fdb2314b6dab166d72549bf146', 'request_id': 'req-c9bf5e76-fb4e-4110-9d2a-c3f8a65fb94c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:04.591652 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c9bf5e76-fb4e-4110-9d2a-c3f8a65fb94c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fcac4fdb2314b6dab166d72549bf146', 'request_id': 'req-c9bf5e76-fb4e-4110-9d2a-c3f8a65fb94c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:04.606807 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c9bf5e76-fb4e-4110-9d2a-c3f8a65fb94c admin admin] The token cache is being invalidate because project 7fcac4fdb2314b6dab166d72549bf146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:48:04.607001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c9bf5e76-fb4e-4110-9d2a-c3f8a65fb94c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:04.607806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c9bf5e76-fb4e-4110-9d2a-c3f8a65fb94c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:04.616687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1151/2309] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:48:04 2022] DELETE /identity/v3/projects/7fcac4fdb2314b6dab166d72549bf146 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:05.225222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a6667-817d-4ec3-ac10-004c04e4d9c1 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:05.225627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a6667-817d-4ec3-ac10-004c04e4d9c1 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:05.225773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a6667-817d-4ec3-ac10-004c04e4d9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:05.289426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-117a6667-817d-4ec3-ac10-004c04e4d9c1 None None] MFA Rules not processed for user `67d0ad36cf8947048b233799813a5435`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:05.296459 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-117a6667-817d-4ec3-ac10-004c04e4d9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:05.470475 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1159/2310] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:06.599787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf5e76-fb4e-4110-9d2a-c3f8a65fb94c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:06.601233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c9bf5e76-fb4e-4110-9d2a-c3f8a65fb94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:06.694313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf5e76-fb4e-4110-9d2a-c3f8a65fb94c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:06.704467 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d0b53-644a-46df-a166-9afcbb0c99bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28614526d50d4201b93b20df45465d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:06.705088 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d0b53-644a-46df-a166-9afcbb0c99bb service glance] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:06.705366 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d0b53-644a-46df-a166-9afcbb0c99bb service glance] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:06.705665 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d0b53-644a-46df-a166-9afcbb0c99bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:06.718741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6c8d0b53-644a-46df-a166-9afcbb0c99bb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:06.762014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:06.846032 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d0b53-644a-46df-a166-9afcbb0c99bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:06.851794 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d0b53-644a-46df-a166-9afcbb0c99bb service glance] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:06.863496 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1152/2311] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:48:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 10:48:07.117685 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63fb0c-67c6-4b2c-ba51-dd0b6d331973 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:07.118545 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63fb0c-67c6-4b2c-ba51-dd0b6d331973 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:07.118968 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63fb0c-67c6-4b2c-ba51-dd0b6d331973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:07.155745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-1a63fb0c-67c6-4b2c-ba51-dd0b6d331973 None None] MFA Rules not processed for user `bdc800f1d4174b5cba4f6f496207ec95`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:07.157723 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-1a63fb0c-67c6-4b2c-ba51-dd0b6d331973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:07.284311 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1160/2312] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 10:48:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:07.364064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d0b53-644a-46df-a166-9afcbb0c99bb service glance] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:07.366187 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6c8d0b53-644a-46df-a166-9afcbb0c99bb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:07.445249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d0b53-644a-46df-a166-9afcbb0c99bb service glance] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:07.450127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a464b-ac71-4168-b5fc-cefc39eec758 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ff72290fd14ddaba6ed757051e182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:07.450733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a464b-ac71-4168-b5fc-cefc39eec758 service swift] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:07.451038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a464b-ac71-4168-b5fc-cefc39eec758 service swift] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:07.451435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a464b-ac71-4168-b5fc-cefc39eec758 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:07.466346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a464b-ac71-4168-b5fc-cefc39eec758 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:07.467974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a464b-ac71-4168-b5fc-cefc39eec758 service swift] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:07.476625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1153/2313] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 10:48:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 10:48:16.582120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b5480-e1bb-48c1-879b-600f3c563f18 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:16.583397 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b5480-e1bb-48c1-879b-600f3c563f18 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:16.583827 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b5480-e1bb-48c1-879b-600f3c563f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:16.634989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e82b5480-e1bb-48c1-879b-600f3c563f18 None None] MFA Rules not processed for user `2465a3ec985c4bacb213ad86ad45ab8f`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:16.637048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e82b5480-e1bb-48c1-879b-600f3c563f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:16.716177 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1161/2314] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:17.473321 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=45 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:18.117741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a464b-ac71-4168-b5fc-cefc39eec758 service swift] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:18.119181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6c8a464b-ac71-4168-b5fc-cefc39eec758 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:18.225731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a464b-ac71-4168-b5fc-cefc39eec758 service swift] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:18.241644 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d892d2-19ba-4afd-8212-599d805a9783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:18.243175 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d892d2-19ba-4afd-8212-599d805a9783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:18.244820 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d892d2-19ba-4afd-8212-599d805a9783 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:18.245207 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d892d2-19ba-4afd-8212-599d805a9783 admin admin] PATH_INFO: `/v3/users/5097308a05d04453a49890a8b8ab5804` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:18.248353 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d892d2-19ba-4afd-8212-599d805a9783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5097308a05d04453a49890a8b8ab5804)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:18.252312 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d892d2-19ba-4afd-8212-599d805a9783 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:18.374476 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-48d892d2-19ba-4afd-8212-599d805a9783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5097308a05d04453a49890a8b8ab5804'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:18.396595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-48d892d2-19ba-4afd-8212-599d805a9783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5097308a05d04453a49890a8b8ab5804'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:18.397427 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-48d892d2-19ba-4afd-8212-599d805a9783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5097308a05d04453a49890a8b8ab5804'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:18.398296 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-48d892d2-19ba-4afd-8212-599d805a9783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5097308a05d04453a49890a8b8ab5804'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:18.409649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-48d892d2-19ba-4afd-8212-599d805a9783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5097308a05d04453a49890a8b8ab5804'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:18.453729 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1154/2315] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:48:18 2022] DELETE /identity/v3/users/5097308a05d04453a49890a8b8ab5804 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:18.463262 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdbc7e-6ca0-41c4-8b3e-cec0238484bd None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:18.464000 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdbc7e-6ca0-41c4-8b3e-cec0238484bd None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:18.464084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdbc7e-6ca0-41c4-8b3e-cec0238484bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:18.512248 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-c8cdbc7e-6ca0-41c4-8b3e-cec0238484bd None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:18.514757 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c8cdbc7e-6ca0-41c4-8b3e-cec0238484bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:18.580269 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:18.662135 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1162/2316] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:18.678321 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d892d2-19ba-4afd-8212-599d805a9783 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:18.683221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-48d892d2-19ba-4afd-8212-599d805a9783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:18.804137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d892d2-19ba-4afd-8212-599d805a9783 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:18.807926 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8977f7-e7eb-4639-b444-fe77a740e7fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:18.808686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8977f7-e7eb-4639-b444-fe77a740e7fd service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:18.809096 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8977f7-e7eb-4639-b444-fe77a740e7fd service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:18.809501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8977f7-e7eb-4639-b444-fe77a740e7fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:18.826498 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8977f7-e7eb-4639-b444-fe77a740e7fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:18.828623 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8977f7-e7eb-4639-b444-fe77a740e7fd service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:18.839428 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1155/2317] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:48:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:48:19.540890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cdbc7e-6ca0-41c4-8b3e-cec0238484bd None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:19.542261 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c8cdbc7e-6ca0-41c4-8b3e-cec0238484bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:19.561131 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cdbc7e-6ca0-41c4-8b3e-cec0238484bd None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:19.586933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6de4c-9e13-42e0-89ac-f2b4e1626e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:19.588138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6de4c-9e13-42e0-89ac-f2b4e1626e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:19.589858 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6de4c-9e13-42e0-89ac-f2b4e1626e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:19.590162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6de4c-9e13-42e0-89ac-f2b4e1626e94 admin admin] PATH_INFO: `/v3/projects/77951c03fcbd44b69dc0ad316c46826e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:19.592781 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6de4c-9e13-42e0-89ac-f2b4e1626e94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77951c03fcbd44b69dc0ad316c46826e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:19.595198 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6de4c-9e13-42e0-89ac-f2b4e1626e94 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:19.639276 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662d1ff-98f2-4edd-bcfa-2f6a1cfa813f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:19.639649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662d1ff-98f2-4edd-bcfa-2f6a1cfa813f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:19.640173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662d1ff-98f2-4edd-bcfa-2f6a1cfa813f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:19.681940 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e9a6de4c-9e13-42e0-89ac-f2b4e1626e94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77951c03fcbd44b69dc0ad316c46826e', 'request_id': 'req-e9a6de4c-9e13-42e0-89ac-f2b4e1626e94'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:19.689096 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-5662d1ff-98f2-4edd-bcfa-2f6a1cfa813f None None] MFA Rules not processed for user `a69e7a31a0024c48ae272459e11278ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:19.691712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5662d1ff-98f2-4edd-bcfa-2f6a1cfa813f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:19.694432 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e9a6de4c-9e13-42e0-89ac-f2b4e1626e94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77951c03fcbd44b69dc0ad316c46826e', 'request_id': 'req-e9a6de4c-9e13-42e0-89ac-f2b4e1626e94'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:19.729252 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e9a6de4c-9e13-42e0-89ac-f2b4e1626e94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77951c03fcbd44b69dc0ad316c46826e', 'request_id': 'req-e9a6de4c-9e13-42e0-89ac-f2b4e1626e94'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:19.744263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:19.752653 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e9a6de4c-9e13-42e0-89ac-f2b4e1626e94 admin admin] The token cache is being invalidate because project 77951c03fcbd44b69dc0ad316c46826e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:48:19.753065 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e9a6de4c-9e13-42e0-89ac-f2b4e1626e94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:19.754304 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-e9a6de4c-9e13-42e0-89ac-f2b4e1626e94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:19.757282 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1163/2318] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:48:19 2022] DELETE /identity/v3/projects/77951c03fcbd44b69dc0ad316c46826e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:19.761782 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e75d9e-4286-4ec4-baab-0ba1068db7a2 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:19.762067 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e75d9e-4286-4ec4-baab-0ba1068db7a2 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:19.762346 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e75d9e-4286-4ec4-baab-0ba1068db7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:19.814192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-85e75d9e-4286-4ec4-baab-0ba1068db7a2 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:19.817625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-85e75d9e-4286-4ec4-baab-0ba1068db7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:19.837019 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1156/2319] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:19.940594 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1164/2320] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:48:19.946025 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064715f-5a42-431b-880a-3cadf21fe7a4 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:19.946527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064715f-5a42-431b-880a-3cadf21fe7a4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:19.946902 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064715f-5a42-431b-880a-3cadf21fe7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:19.995716 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a064715f-5a42-431b-880a-3cadf21fe7a4 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:19.999144 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a064715f-5a42-431b-880a-3cadf21fe7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:20.028601 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1157/2321] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:20.031156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e75d9e-4286-4ec4-baab-0ba1068db7a2 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:20.055898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e75d9e-4286-4ec4-baab-0ba1068db7a2 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:20.070558 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f2948-e763-40c7-9b4a-84e8f5e8bdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:20.071321 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f2948-e763-40c7-9b4a-84e8f5e8bdcf admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:20.071605 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f2948-e763-40c7-9b4a-84e8f5e8bdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:20.071881 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f2948-e763-40c7-9b4a-84e8f5e8bdcf admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:20.076256 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f2948-e763-40c7-9b4a-84e8f5e8bdcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:48:20.076620 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f2948-e763-40c7-9b4a-84e8f5e8bdcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:20.078401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f2948-e763-40c7-9b4a-84e8f5e8bdcf admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:20.111112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1165/2322] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:48:20.115274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064715f-5a42-431b-880a-3cadf21fe7a4 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:20.133158 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064715f-5a42-431b-880a-3cadf21fe7a4 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:20.146206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362ea46-e674-4e82-898d-7b29bf3863ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:20.148405 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362ea46-e674-4e82-898d-7b29bf3863ae admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:20.149241 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362ea46-e674-4e82-898d-7b29bf3863ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:20.149241 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362ea46-e674-4e82-898d-7b29bf3863ae admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:20.151171 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362ea46-e674-4e82-898d-7b29bf3863ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:20.154256 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362ea46-e674-4e82-898d-7b29bf3863ae admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:20.222402 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1158/2323] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:48:20 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:48:20.242572 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f2948-e763-40c7-9b4a-84e8f5e8bdcf admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:20.256642 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f2948-e763-40c7-9b4a-84e8f5e8bdcf admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:20.354047 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:20.388215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb808e-0e2d-4e3f-ad07-445e1d246e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:20.389149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb808e-0e2d-4e3f-ad07-445e1d246e7f admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:20.389576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb808e-0e2d-4e3f-ad07-445e1d246e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:20.390158 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb808e-0e2d-4e3f-ad07-445e1d246e7f admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:20.391723 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb808e-0e2d-4e3f-ad07-445e1d246e7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:20.396022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb808e-0e2d-4e3f-ad07-445e1d246e7f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:20.437700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1166/2324] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:48:20 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:48:20.441980 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362ea46-e674-4e82-898d-7b29bf3863ae admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:20.456027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362ea46-e674-4e82-898d-7b29bf3863ae admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:20.462392 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bddcb-5c3e-4995-afc9-2d38650b67f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:20.463529 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bddcb-5c3e-4995-afc9-2d38650b67f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:20.464268 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bddcb-5c3e-4995-afc9-2d38650b67f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:20.464822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bddcb-5c3e-4995-afc9-2d38650b67f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:20.467455 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bddcb-5c3e-4995-afc9-2d38650b67f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:20.470758 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bddcb-5c3e-4995-afc9-2d38650b67f4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:20.486059 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1159/2325] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:48:20.496044 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb808e-0e2d-4e3f-ad07-445e1d246e7f admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:20.515912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb808e-0e2d-4e3f-ad07-445e1d246e7f admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:20.522726 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369b74c-3d0b-49f6-824c-cde77122a23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:20.523706 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369b74c-3d0b-49f6-824c-cde77122a23a admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:20.524108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369b74c-3d0b-49f6-824c-cde77122a23a admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:20.524644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369b74c-3d0b-49f6-824c-cde77122a23a admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:20.526387 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369b74c-3d0b-49f6-824c-cde77122a23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:20.529558 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369b74c-3d0b-49f6-824c-cde77122a23a admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:20.548883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1167/2326] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 10:48:20.553762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bddcb-5c3e-4995-afc9-2d38650b67f4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:20.565967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bddcb-5c3e-4995-afc9-2d38650b67f4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:20.571065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa76296-47b7-4597-a157-b14a821f5c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:20.571850 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76296-47b7-4597-a157-b14a821f5c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:20.572234 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76296-47b7-4597-a157-b14a821f5c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:20.573376 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76296-47b7-4597-a157-b14a821f5c0c admin admin] PATH_INFO: `/v3/projects/8549633ee70d487cb794d25f376b7b06/users/62f125b7547443a88850aabedd7eedfa/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:20.595274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa76296-47b7-4597-a157-b14a821f5c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8549633ee70d487cb794d25f376b7b06, user_id=62f125b7547443a88850aabedd7eedfa, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:20.598314 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa76296-47b7-4597-a157-b14a821f5c0c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:20.631754 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1160/2327] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:48:20 2022] PUT /identity/v3/projects/8549633ee70d487cb794d25f376b7b06/users/62f125b7547443a88850aabedd7eedfa/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:20.633368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c849bd-da16-4970-8141-5635c5d74169 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:20.634598 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c849bd-da16-4970-8141-5635c5d74169 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:20.635359 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c849bd-da16-4970-8141-5635c5d74169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:20.681186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e6c849bd-da16-4970-8141-5635c5d74169 None None] MFA Rules not processed for user `62f125b7547443a88850aabedd7eedfa`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:20.684290 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e6c849bd-da16-4970-8141-5635c5d74169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:20.864228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa76296-47b7-4597-a157-b14a821f5c0c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:20.864827 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1168/2328] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:20.964079 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa76296-47b7-4597-a157-b14a821f5c0c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:20.976108 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c653ea-1d91-4d27-ad65-92dfb20834ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:20.976756 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c653ea-1d91-4d27-ad65-92dfb20834ec admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:20.977041 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c653ea-1d91-4d27-ad65-92dfb20834ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:20.977314 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c653ea-1d91-4d27-ad65-92dfb20834ec admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:20.982874 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c653ea-1d91-4d27-ad65-92dfb20834ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:20.986363 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c653ea-1d91-4d27-ad65-92dfb20834ec admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:21.030156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1161/2329] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:48:20 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:48:21.034119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c849bd-da16-4970-8141-5635c5d74169 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:21.047582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c849bd-da16-4970-8141-5635c5d74169 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:21.113361 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f142b4-0bfa-4cdd-95fd-097fe5dfe02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:21.113990 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f142b4-0bfa-4cdd-95fd-097fe5dfe02f admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:21.114970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f142b4-0bfa-4cdd-95fd-097fe5dfe02f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:21.115338 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f142b4-0bfa-4cdd-95fd-097fe5dfe02f admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:21.115995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f142b4-0bfa-4cdd-95fd-097fe5dfe02f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:21.118311 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f142b4-0bfa-4cdd-95fd-097fe5dfe02f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:21.142843 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1169/2330] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:48:21 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:48:21.147242 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c653ea-1d91-4d27-ad65-92dfb20834ec admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:21.159209 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c653ea-1d91-4d27-ad65-92dfb20834ec admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:21.164373 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d535d6-e7b7-4ccb-8263-e97f884ab890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:21.165045 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d535d6-e7b7-4ccb-8263-e97f884ab890 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:21.165324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d535d6-e7b7-4ccb-8263-e97f884ab890 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:21.165611 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d535d6-e7b7-4ccb-8263-e97f884ab890 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:21.166263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d535d6-e7b7-4ccb-8263-e97f884ab890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:21.167999 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d535d6-e7b7-4ccb-8263-e97f884ab890 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:21.181659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1162/2331] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:48:21.186146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f142b4-0bfa-4cdd-95fd-097fe5dfe02f admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:21.196762 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f142b4-0bfa-4cdd-95fd-097fe5dfe02f admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:21.201647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e2902-2884-4800-b324-45b4f7ea055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:21.202326 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e2902-2884-4800-b324-45b4f7ea055a admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:21.202603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e2902-2884-4800-b324-45b4f7ea055a admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:21.203050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e2902-2884-4800-b324-45b4f7ea055a admin admin] PATH_INFO: `/v3/projects/a6327132b85f4fe18b17e8907ad9c970/users/16608ac10c8848718a568dc9c0775a7d/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:21.221628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e2902-2884-4800-b324-45b4f7ea055a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6327132b85f4fe18b17e8907ad9c970, user_id=16608ac10c8848718a568dc9c0775a7d, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:21.224390 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e2902-2884-4800-b324-45b4f7ea055a admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:21.243156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1170/2332] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:48:21 2022] PUT /identity/v3/projects/a6327132b85f4fe18b17e8907ad9c970/users/16608ac10c8848718a568dc9c0775a7d/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:21.248345 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d535d6-e7b7-4ccb-8263-e97f884ab890 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:21.259962 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d535d6-e7b7-4ccb-8263-e97f884ab890 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:21.353812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:21.414029 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbf050-9592-4e23-bfc6-eed6022911a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:21.414657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbf050-9592-4e23-bfc6-eed6022911a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:21.414943 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbf050-9592-4e23-bfc6-eed6022911a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:21.415218 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbf050-9592-4e23-bfc6-eed6022911a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:21.415870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbf050-9592-4e23-bfc6-eed6022911a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:21.417483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbf050-9592-4e23-bfc6-eed6022911a6 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:21.449352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1163/2333] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:48:21.452258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e2902-2884-4800-b324-45b4f7ea055a admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:21.468882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e2902-2884-4800-b324-45b4f7ea055a admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:21.482410 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a0867-2ce3-4a0d-b1a7-0af45cadce54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:21.483106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a0867-2ce3-4a0d-b1a7-0af45cadce54 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:21.483395 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a0867-2ce3-4a0d-b1a7-0af45cadce54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:21.483676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a0867-2ce3-4a0d-b1a7-0af45cadce54 admin admin] PATH_INFO: `/v3/projects/a6327132b85f4fe18b17e8907ad9c970/users/16608ac10c8848718a568dc9c0775a7d/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:21.488067 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a0867-2ce3-4a0d-b1a7-0af45cadce54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6327132b85f4fe18b17e8907ad9c970, user_id=16608ac10c8848718a568dc9c0775a7d, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:21.498437 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a0867-2ce3-4a0d-b1a7-0af45cadce54 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:21.524592 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1171/2334] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:48:21 2022] PUT /identity/v3/projects/a6327132b85f4fe18b17e8907ad9c970/users/16608ac10c8848718a568dc9c0775a7d/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:48:21.533909 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332d083-7298-4911-99e7-4879881f754c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:21.534295 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332d083-7298-4911-99e7-4879881f754c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:21.534622 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332d083-7298-4911-99e7-4879881f754c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:21.571464 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a332d083-7298-4911-99e7-4879881f754c None None] MFA Rules not processed for user `16608ac10c8848718a568dc9c0775a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:21.573766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a332d083-7298-4911-99e7-4879881f754c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:21.689870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1164/2335] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:21.705112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a0867-2ce3-4a0d-b1a7-0af45cadce54 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:21.707179 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0f9a0867-2ce3-4a0d-b1a7-0af45cadce54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:21.713938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:21.779954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a0867-2ce3-4a0d-b1a7-0af45cadce54 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:21.783874 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ef06d-e81f-46a8-9b2b-c407e3ac1132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:21.784705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ef06d-e81f-46a8-9b2b-c407e3ac1132 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:21.785131 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ef06d-e81f-46a8-9b2b-c407e3ac1132 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:21.785409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ef06d-e81f-46a8-9b2b-c407e3ac1132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:21.861096 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ef06d-e81f-46a8-9b2b-c407e3ac1132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:21.862629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ef06d-e81f-46a8-9b2b-c407e3ac1132 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:21.885792 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1172/2336] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:48:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:48:22.240078 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332d083-7298-4911-99e7-4879881f754c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:22.241576 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a332d083-7298-4911-99e7-4879881f754c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:22.393345 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332d083-7298-4911-99e7-4879881f754c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:22.400295 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35690b8-0a2b-4879-abfe-64e5a6cf2ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:22.401045 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35690b8-0a2b-4879-abfe-64e5a6cf2ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:22.401410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35690b8-0a2b-4879-abfe-64e5a6cf2ded admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:22.401752 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35690b8-0a2b-4879-abfe-64e5a6cf2ded admin admin] PATH_INFO: `/v3/users/936f87df21764327a82fa50d33b68e9f` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:22.403039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35690b8-0a2b-4879-abfe-64e5a6cf2ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=936f87df21764327a82fa50d33b68e9f)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:22.406313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35690b8-0a2b-4879-abfe-64e5a6cf2ded admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:22.520057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b35690b8-0a2b-4879-abfe-64e5a6cf2ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '936f87df21764327a82fa50d33b68e9f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:22.534752 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b35690b8-0a2b-4879-abfe-64e5a6cf2ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '936f87df21764327a82fa50d33b68e9f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:22.535444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b35690b8-0a2b-4879-abfe-64e5a6cf2ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '936f87df21764327a82fa50d33b68e9f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:22.536308 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b35690b8-0a2b-4879-abfe-64e5a6cf2ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '936f87df21764327a82fa50d33b68e9f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:22.561995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:22.567337 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b35690b8-0a2b-4879-abfe-64e5a6cf2ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '936f87df21764327a82fa50d33b68e9f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:22.594612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1165/2337] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:48:22 2022] DELETE /identity/v3/users/936f87df21764327a82fa50d33b68e9f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:48:22.806858 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ef06d-e81f-46a8-9b2b-c407e3ac1132 service cinder] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:22.823907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ef06d-e81f-46a8-9b2b-c407e3ac1132 service cinder] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:22.911127 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2c173-5ba8-4cba-b435-d07647503efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:22.912961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2c173-5ba8-4cba-b435-d07647503efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:22.913635 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2c173-5ba8-4cba-b435-d07647503efe admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:22.913969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2c173-5ba8-4cba-b435-d07647503efe admin admin] PATH_INFO: `/v3/projects/9fcdbb4f8b1d422b9470121d11147e8d` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:22.915162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2c173-5ba8-4cba-b435-d07647503efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fcdbb4f8b1d422b9470121d11147e8d)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:22.917526 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2c173-5ba8-4cba-b435-d07647503efe admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:22.981047 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f5b2c173-5ba8-4cba-b435-d07647503efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fcdbb4f8b1d422b9470121d11147e8d', 'request_id': 'req-f5b2c173-5ba8-4cba-b435-d07647503efe'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:22.984718 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ddaa3-433f-4c7d-bfd9-381c598d9113 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:22.985004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ddaa3-433f-4c7d-bfd9-381c598d9113 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:22.985287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ddaa3-433f-4c7d-bfd9-381c598d9113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:22.988269 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f5b2c173-5ba8-4cba-b435-d07647503efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fcdbb4f8b1d422b9470121d11147e8d', 'request_id': 'req-f5b2c173-5ba8-4cba-b435-d07647503efe'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:22.998134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f5b2c173-5ba8-4cba-b435-d07647503efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fcdbb4f8b1d422b9470121d11147e8d', 'request_id': 'req-f5b2c173-5ba8-4cba-b435-d07647503efe'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:23.000539 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:23.013953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-672ddaa3-433f-4c7d-bfd9-381c598d9113 None None] MFA Rules not processed for user `bdc800f1d4174b5cba4f6f496207ec95`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:23.015419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-672ddaa3-433f-4c7d-bfd9-381c598d9113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:23.017395 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f5b2c173-5ba8-4cba-b435-d07647503efe admin admin] The token cache is being invalidate because project 9fcdbb4f8b1d422b9470121d11147e8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:48:23.017743 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f5b2c173-5ba8-4cba-b435-d07647503efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:23.019933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f5b2c173-5ba8-4cba-b435-d07647503efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:23.021804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1173/2338] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:48:22 2022] DELETE /identity/v3/projects/9fcdbb4f8b1d422b9470121d11147e8d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:23.027025 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2c173-5ba8-4cba-b435-d07647503efe admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:23.029637 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f5b2c173-5ba8-4cba-b435-d07647503efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:23.116003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2c173-5ba8-4cba-b435-d07647503efe admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:23.117817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1166/2339] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 10:48:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:48:23.121807 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b518b-3027-4f19-a93f-469c3085ab6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:23.123531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b518b-3027-4f19-a93f-469c3085ab6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:23.123757 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b518b-3027-4f19-a93f-469c3085ab6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:23.124038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b518b-3027-4f19-a93f-469c3085ab6e admin admin] PATH_INFO: `/v3/users/980f993f8398468fba96cbe806ae9e5a` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:23.125294 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b518b-3027-4f19-a93f-469c3085ab6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=980f993f8398468fba96cbe806ae9e5a)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:23.127560 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b518b-3027-4f19-a93f-469c3085ab6e admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:23.132293 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ddaa3-433f-4c7d-bfd9-381c598d9113 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:23.134831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-672ddaa3-433f-4c7d-bfd9-381c598d9113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:23.181269 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0c1b518b-3027-4f19-a93f-469c3085ab6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '980f993f8398468fba96cbe806ae9e5a'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:23.192020 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0c1b518b-3027-4f19-a93f-469c3085ab6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '980f993f8398468fba96cbe806ae9e5a'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:23.192761 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0c1b518b-3027-4f19-a93f-469c3085ab6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '980f993f8398468fba96cbe806ae9e5a'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:23.193525 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0c1b518b-3027-4f19-a93f-469c3085ab6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '980f993f8398468fba96cbe806ae9e5a'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:23.201649 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0c1b518b-3027-4f19-a93f-469c3085ab6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '980f993f8398468fba96cbe806ae9e5a'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:23.222692 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1174/2340] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:48:23 2022] DELETE /identity/v3/users/980f993f8398468fba96cbe806ae9e5a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:23.224912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ddaa3-433f-4c7d-bfd9-381c598d9113 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:23.297527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d5220-f2e8-430b-aa67-630196fa5c1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ff72290fd14ddaba6ed757051e182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:23.298763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d5220-f2e8-430b-aa67-630196fa5c1e service swift] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:23.299053 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d5220-f2e8-430b-aa67-630196fa5c1e service swift] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:23.299326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d5220-f2e8-430b-aa67-630196fa5c1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:23.301573 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ad2d5220-f2e8-430b-aa67-630196fa5c1e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:23.338183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:23.376576 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d5220-f2e8-430b-aa67-630196fa5c1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:23.379022 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d5220-f2e8-430b-aa67-630196fa5c1e service swift] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:23.391376 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1167/2341] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 10:48:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 10:48:23.455561 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b518b-3027-4f19-a93f-469c3085ab6e admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:23.456850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0c1b518b-3027-4f19-a93f-469c3085ab6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:23.634307 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b518b-3027-4f19-a93f-469c3085ab6e admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:23.651103 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a211ebe-f288-4081-8589-e71d53dae7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:23.651769 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a211ebe-f288-4081-8589-e71d53dae7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:23.652045 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a211ebe-f288-4081-8589-e71d53dae7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:23.652349 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a211ebe-f288-4081-8589-e71d53dae7f9 admin admin] PATH_INFO: `/v3/projects/91568bf133da4b97bb2dd2218d76cb57` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:23.653565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a211ebe-f288-4081-8589-e71d53dae7f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91568bf133da4b97bb2dd2218d76cb57)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:23.655535 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a211ebe-f288-4081-8589-e71d53dae7f9 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:23.682308 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:23.806942 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8a211ebe-f288-4081-8589-e71d53dae7f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91568bf133da4b97bb2dd2218d76cb57', 'request_id': 'req-8a211ebe-f288-4081-8589-e71d53dae7f9'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:23.828037 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8a211ebe-f288-4081-8589-e71d53dae7f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91568bf133da4b97bb2dd2218d76cb57', 'request_id': 'req-8a211ebe-f288-4081-8589-e71d53dae7f9'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:23.855000 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8a211ebe-f288-4081-8589-e71d53dae7f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91568bf133da4b97bb2dd2218d76cb57', 'request_id': 'req-8a211ebe-f288-4081-8589-e71d53dae7f9'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:23.883731 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8a211ebe-f288-4081-8589-e71d53dae7f9 admin admin] The token cache is being invalidate because project 91568bf133da4b97bb2dd2218d76cb57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:48:23.884235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8a211ebe-f288-4081-8589-e71d53dae7f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:23.885513 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8a211ebe-f288-4081-8589-e71d53dae7f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:23.895317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1175/2342] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:48:23 2022] DELETE /identity/v3/projects/91568bf133da4b97bb2dd2218d76cb57 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:23.897605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af2cb2-edfc-40d2-851d-5de8a0b452f8 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:23.898119 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af2cb2-edfc-40d2-851d-5de8a0b452f8 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:23.898549 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af2cb2-edfc-40d2-851d-5de8a0b452f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:23.943834 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f8af2cb2-edfc-40d2-851d-5de8a0b452f8 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:23.945048 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f8af2cb2-edfc-40d2-851d-5de8a0b452f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:24.208418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1168/2343] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:24.209670 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb3c26-29a7-47de-a0d0-6b40bfcb1fcc None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:24.209902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb3c26-29a7-47de-a0d0-6b40bfcb1fcc None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:24.210201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb3c26-29a7-47de-a0d0-6b40bfcb1fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:24.284325 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-dacb3c26-29a7-47de-a0d0-6b40bfcb1fcc None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:24.286191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-dacb3c26-29a7-47de-a0d0-6b40bfcb1fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:24.331307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af2cb2-edfc-40d2-851d-5de8a0b452f8 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:24.345680 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1176/2344] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:24.346493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af2cb2-edfc-40d2-851d-5de8a0b452f8 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:24.369007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8cfc5-d6bf-4af1-b710-b927bed38d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:24.370543 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8cfc5-d6bf-4af1-b710-b927bed38d73 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:24.370940 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8cfc5-d6bf-4af1-b710-b927bed38d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:24.371238 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8cfc5-d6bf-4af1-b710-b927bed38d73 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:24.372146 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8cfc5-d6bf-4af1-b710-b927bed38d73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:48:24.373046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8cfc5-d6bf-4af1-b710-b927bed38d73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:24.378619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8cfc5-d6bf-4af1-b710-b927bed38d73 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:24.415667 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1169/2345] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:48:24.417247 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb3c26-29a7-47de-a0d0-6b40bfcb1fcc None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:24.435139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb3c26-29a7-47de-a0d0-6b40bfcb1fcc None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:24.469523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63198ca0-5a5d-4e83-b183-b35202d1fd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:24.470041 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63198ca0-5a5d-4e83-b183-b35202d1fd40 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:24.470331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63198ca0-5a5d-4e83-b183-b35202d1fd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:24.470646 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63198ca0-5a5d-4e83-b183-b35202d1fd40 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:24.475266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63198ca0-5a5d-4e83-b183-b35202d1fd40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:24.477284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63198ca0-5a5d-4e83-b183-b35202d1fd40 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:24.556091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1177/2346] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:48:24 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:48:24.560031 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8cfc5-d6bf-4af1-b710-b927bed38d73 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:24.571342 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8cfc5-d6bf-4af1-b710-b927bed38d73 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:24.721964 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac4f43-7d8b-4832-9d4a-76efd8ade9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:24.722943 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac4f43-7d8b-4832-9d4a-76efd8ade9ca admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:24.723431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac4f43-7d8b-4832-9d4a-76efd8ade9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:24.723845 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac4f43-7d8b-4832-9d4a-76efd8ade9ca admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:24.724743 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac4f43-7d8b-4832-9d4a-76efd8ade9ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:24.727506 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac4f43-7d8b-4832-9d4a-76efd8ade9ca admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:24.763769 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1170/2347] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:48:24 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:48:24.768436 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63198ca0-5a5d-4e83-b183-b35202d1fd40 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:24.785703 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63198ca0-5a5d-4e83-b183-b35202d1fd40 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:24.811993 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01b68a-e68c-42ea-8d5e-5bef55b93844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:24.814763 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01b68a-e68c-42ea-8d5e-5bef55b93844 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:24.816127 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01b68a-e68c-42ea-8d5e-5bef55b93844 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:24.817352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01b68a-e68c-42ea-8d5e-5bef55b93844 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:24.820235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01b68a-e68c-42ea-8d5e-5bef55b93844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:24.826057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01b68a-e68c-42ea-8d5e-5bef55b93844 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:24.850753 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1178/2348] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:48:24.855012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac4f43-7d8b-4832-9d4a-76efd8ade9ca admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:24.880684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac4f43-7d8b-4832-9d4a-76efd8ade9ca admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:24.891459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63978d36-086f-4986-bbdc-33d3e7eb0b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:24.894459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63978d36-086f-4986-bbdc-33d3e7eb0b96 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:24.894459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63978d36-086f-4986-bbdc-33d3e7eb0b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:24.894459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63978d36-086f-4986-bbdc-33d3e7eb0b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:24.894459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63978d36-086f-4986-bbdc-33d3e7eb0b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:24.895740 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63978d36-086f-4986-bbdc-33d3e7eb0b96 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:24.915540 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1171/2349] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:48:24.916790 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01b68a-e68c-42ea-8d5e-5bef55b93844 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:24.935993 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01b68a-e68c-42ea-8d5e-5bef55b93844 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:24.949592 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2544787-54b7-4b25-b04d-7471715b41b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:24.950349 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2544787-54b7-4b25-b04d-7471715b41b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:24.950635 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2544787-54b7-4b25-b04d-7471715b41b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:24.950932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2544787-54b7-4b25-b04d-7471715b41b5 admin admin] PATH_INFO: `/v3/projects/8c998f2e5ea242cf94cf153ae99249aa/users/de831d5265d347a194aaabeb744fcbe1/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:24.975503 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63978d36-086f-4986-bbdc-33d3e7eb0b96 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:24.978160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-63978d36-086f-4986-bbdc-33d3e7eb0b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:24.989452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2544787-54b7-4b25-b04d-7471715b41b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c998f2e5ea242cf94cf153ae99249aa, user_id=de831d5265d347a194aaabeb744fcbe1, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:24.992534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2544787-54b7-4b25-b04d-7471715b41b5 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:24.995233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63978d36-086f-4986-bbdc-33d3e7eb0b96 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:25.000390 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcfd08-e939-4574-86ad-fb79faee83e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:25.002057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcfd08-e939-4574-86ad-fb79faee83e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:25.002330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcfd08-e939-4574-86ad-fb79faee83e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:25.002596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcfd08-e939-4574-86ad-fb79faee83e2 admin admin] PATH_INFO: `/v3/users/62f125b7547443a88850aabedd7eedfa` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:25.004631 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcfd08-e939-4574-86ad-fb79faee83e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62f125b7547443a88850aabedd7eedfa)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:25.007020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcfd08-e939-4574-86ad-fb79faee83e2 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:25.022309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1179/2350] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:48:24 2022] PUT /identity/v3/projects/8c998f2e5ea242cf94cf153ae99249aa/users/de831d5265d347a194aaabeb744fcbe1/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:25.034934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b105c-1e68-48bf-837c-07a3ce6109e6 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:25.035222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b105c-1e68-48bf-837c-07a3ce6109e6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:25.035508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b105c-1e68-48bf-837c-07a3ce6109e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:25.062584 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:25.107029 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-f46b105c-1e68-48bf-837c-07a3ce6109e6 None None] MFA Rules not processed for user `de831d5265d347a194aaabeb744fcbe1`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:25.111716 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f46b105c-1e68-48bf-837c-07a3ce6109e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:25.112252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d6fcfd08-e939-4574-86ad-fb79faee83e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62f125b7547443a88850aabedd7eedfa'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:25.124032 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d6fcfd08-e939-4574-86ad-fb79faee83e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62f125b7547443a88850aabedd7eedfa'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:25.124877 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d6fcfd08-e939-4574-86ad-fb79faee83e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62f125b7547443a88850aabedd7eedfa'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:25.125695 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d6fcfd08-e939-4574-86ad-fb79faee83e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62f125b7547443a88850aabedd7eedfa'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:25.137054 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d6fcfd08-e939-4574-86ad-fb79faee83e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62f125b7547443a88850aabedd7eedfa'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:25.162319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1172/2351] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:48:24 2022] DELETE /identity/v3/users/62f125b7547443a88850aabedd7eedfa => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:25.166501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8075587-2c71-4771-8456-bbc4a7bca5b9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:25.167083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8075587-2c71-4771-8456-bbc4a7bca5b9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:25.167517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8075587-2c71-4771-8456-bbc4a7bca5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:25.198138 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1180/2352] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:48:25.206667 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b105c-1e68-48bf-837c-07a3ce6109e6 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:25.208301 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f46b105c-1e68-48bf-837c-07a3ce6109e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:25.228438 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b8075587-2c71-4771-8456-bbc4a7bca5b9 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:25.229716 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b8075587-2c71-4771-8456-bbc4a7bca5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:25.243013 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:25.316438 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b105c-1e68-48bf-837c-07a3ce6109e6 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:25.334768 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1173/2353] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:48:25.346782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8075587-2c71-4771-8456-bbc4a7bca5b9 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:25.348741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b8075587-2c71-4771-8456-bbc4a7bca5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:25.434847 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94062a8-ce26-4fda-89f7-e7202ed3b516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:25.437807 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94062a8-ce26-4fda-89f7-e7202ed3b516 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:25.438323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94062a8-ce26-4fda-89f7-e7202ed3b516 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:25.439700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94062a8-ce26-4fda-89f7-e7202ed3b516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:25.469474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8075587-2c71-4771-8456-bbc4a7bca5b9 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:25.474308 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa6bd5-086e-4fce-b713-4c74f2f181b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:25.475134 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa6bd5-086e-4fce-b713-4c74f2f181b9 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:25.475759 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa6bd5-086e-4fce-b713-4c74f2f181b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:25.476116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa6bd5-086e-4fce-b713-4c74f2f181b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:25.505342 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa6bd5-086e-4fce-b713-4c74f2f181b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:25.508459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa6bd5-086e-4fce-b713-4c74f2f181b9 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:25.544279 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1174/2354] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:48:25.581611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94062a8-ce26-4fda-89f7-e7202ed3b516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:25.587470 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94062a8-ce26-4fda-89f7-e7202ed3b516 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:25.616945 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1181/2355] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:48:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 10:48:25.651604 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa6bd5-086e-4fce-b713-4c74f2f181b9 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:25.654173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-28aa6bd5-086e-4fce-b713-4c74f2f181b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:25.674336 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa6bd5-086e-4fce-b713-4c74f2f181b9 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:25.682256 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fea850-238d-4bfa-bee1-92e85e7596a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:25.682986 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fea850-238d-4bfa-bee1-92e85e7596a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:25.683975 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fea850-238d-4bfa-bee1-92e85e7596a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:25.684251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fea850-238d-4bfa-bee1-92e85e7596a5 admin admin] PATH_INFO: `/v3/users/de831d5265d347a194aaabeb744fcbe1` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:25.686374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fea850-238d-4bfa-bee1-92e85e7596a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de831d5265d347a194aaabeb744fcbe1)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:25.689630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fea850-238d-4bfa-bee1-92e85e7596a5 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:25.773917 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:25.777680 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-60fea850-238d-4bfa-bee1-92e85e7596a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de831d5265d347a194aaabeb744fcbe1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:25.792019 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-60fea850-238d-4bfa-bee1-92e85e7596a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de831d5265d347a194aaabeb744fcbe1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:25.792957 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-60fea850-238d-4bfa-bee1-92e85e7596a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de831d5265d347a194aaabeb744fcbe1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:25.794512 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-60fea850-238d-4bfa-bee1-92e85e7596a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de831d5265d347a194aaabeb744fcbe1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:25.804986 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-60fea850-238d-4bfa-bee1-92e85e7596a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de831d5265d347a194aaabeb744fcbe1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:25.853289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50edea5-4203-454b-9229-386f26b681b1 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:25.853289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50edea5-4203-454b-9229-386f26b681b1 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:25.853289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50edea5-4203-454b-9229-386f26b681b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:25.854141 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1175/2356] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:48:25 2022] DELETE /identity/v3/users/de831d5265d347a194aaabeb744fcbe1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:25.875347 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-f50edea5-4203-454b-9229-386f26b681b1 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:25.876762 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f50edea5-4203-454b-9229-386f26b681b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:25.973612 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1182/2357] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:25.986531 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fea850-238d-4bfa-bee1-92e85e7596a5 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:25.988482 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-60fea850-238d-4bfa-bee1-92e85e7596a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:26.092031 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50edea5-4203-454b-9229-386f26b681b1 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:26.094827 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f50edea5-4203-454b-9229-386f26b681b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:26.117120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50edea5-4203-454b-9229-386f26b681b1 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:26.125278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fea850-238d-4bfa-bee1-92e85e7596a5 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:26.129873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc194516-f12d-4fa5-839b-3a07ab0db904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:26.130774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc194516-f12d-4fa5-839b-3a07ab0db904 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:26.131225 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc194516-f12d-4fa5-839b-3a07ab0db904 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:26.131839 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc194516-f12d-4fa5-839b-3a07ab0db904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:26.145894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd042fd-a538-43e0-a325-30b1718dd396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:26.147285 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc194516-f12d-4fa5-839b-3a07ab0db904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:26.147413 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd042fd-a538-43e0-a325-30b1718dd396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:26.147696 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd042fd-a538-43e0-a325-30b1718dd396 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:26.147979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd042fd-a538-43e0-a325-30b1718dd396 admin admin] PATH_INFO: `/v3/projects/8549633ee70d487cb794d25f376b7b06` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:26.149749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc194516-f12d-4fa5-839b-3a07ab0db904 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:26.154069 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd042fd-a538-43e0-a325-30b1718dd396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8549633ee70d487cb794d25f376b7b06)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:26.156060 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd042fd-a538-43e0-a325-30b1718dd396 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:26.162380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1176/2358] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:48:26.234665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:26.276270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-cfd042fd-a538-43e0-a325-30b1718dd396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8549633ee70d487cb794d25f376b7b06', 'request_id': 'req-cfd042fd-a538-43e0-a325-30b1718dd396'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:26.295652 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-cfd042fd-a538-43e0-a325-30b1718dd396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8549633ee70d487cb794d25f376b7b06', 'request_id': 'req-cfd042fd-a538-43e0-a325-30b1718dd396'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:26.310002 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-cfd042fd-a538-43e0-a325-30b1718dd396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8549633ee70d487cb794d25f376b7b06', 'request_id': 'req-cfd042fd-a538-43e0-a325-30b1718dd396'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:26.348098 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-cfd042fd-a538-43e0-a325-30b1718dd396 admin admin] The token cache is being invalidate because project 8549633ee70d487cb794d25f376b7b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:48:26.348501 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-cfd042fd-a538-43e0-a325-30b1718dd396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:26.351449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-cfd042fd-a538-43e0-a325-30b1718dd396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:26.358046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1183/2359] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:48:26 2022] DELETE /identity/v3/projects/8549633ee70d487cb794d25f376b7b06 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:48:26.359385 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc194516-f12d-4fa5-839b-3a07ab0db904 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:26.373520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc194516-f12d-4fa5-839b-3a07ab0db904 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:26.506063 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ee2cb-a815-453c-b2cf-963610b58ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:26.506731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ee2cb-a815-453c-b2cf-963610b58ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:26.507071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ee2cb-a815-453c-b2cf-963610b58ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:26.507409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ee2cb-a815-453c-b2cf-963610b58ae5 admin admin] PATH_INFO: `/v3/users/16608ac10c8848718a568dc9c0775a7d` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:26.509969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ee2cb-a815-453c-b2cf-963610b58ae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16608ac10c8848718a568dc9c0775a7d)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:26.512178 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ee2cb-a815-453c-b2cf-963610b58ae5 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:26.582941 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd042fd-a538-43e0-a325-30b1718dd396 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:26.584765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-cfd042fd-a538-43e0-a325-30b1718dd396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:26.606114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e58ee2cb-a815-453c-b2cf-963610b58ae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16608ac10c8848718a568dc9c0775a7d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:26.607129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd042fd-a538-43e0-a325-30b1718dd396 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:26.615712 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac5b08-86ab-4a05-803b-4fecedde052f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:26.616381 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac5b08-86ab-4a05-803b-4fecedde052f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:26.616837 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac5b08-86ab-4a05-803b-4fecedde052f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:26.617334 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac5b08-86ab-4a05-803b-4fecedde052f admin admin] PATH_INFO: `/v3/users/5bc0f95a9c0640b9a1e8a36f87f5b9e1` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:26.619034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e58ee2cb-a815-453c-b2cf-963610b58ae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16608ac10c8848718a568dc9c0775a7d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:26.619954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac5b08-86ab-4a05-803b-4fecedde052f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bc0f95a9c0640b9a1e8a36f87f5b9e1)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:26.621955 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac5b08-86ab-4a05-803b-4fecedde052f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:26.624213 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e58ee2cb-a815-453c-b2cf-963610b58ae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16608ac10c8848718a568dc9c0775a7d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:26.624988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e58ee2cb-a815-453c-b2cf-963610b58ae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16608ac10c8848718a568dc9c0775a7d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:26.638525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e58ee2cb-a815-453c-b2cf-963610b58ae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16608ac10c8848718a568dc9c0775a7d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:26.645679 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:26.677811 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1177/2360] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:48:26 2022] DELETE /identity/v3/users/16608ac10c8848718a568dc9c0775a7d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:26.717770 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ee2cb-a815-453c-b2cf-963610b58ae5 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:26.720063 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e58ee2cb-a815-453c-b2cf-963610b58ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:26.756665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6aac5b08-86ab-4a05-803b-4fecedde052f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bc0f95a9c0640b9a1e8a36f87f5b9e1'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:26.773379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6aac5b08-86ab-4a05-803b-4fecedde052f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bc0f95a9c0640b9a1e8a36f87f5b9e1'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:26.774095 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6aac5b08-86ab-4a05-803b-4fecedde052f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bc0f95a9c0640b9a1e8a36f87f5b9e1'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:26.774777 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6aac5b08-86ab-4a05-803b-4fecedde052f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bc0f95a9c0640b9a1e8a36f87f5b9e1'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:26.788705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6aac5b08-86ab-4a05-803b-4fecedde052f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bc0f95a9c0640b9a1e8a36f87f5b9e1'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:26.828720 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1184/2361] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:48:26 2022] DELETE /identity/v3/users/5bc0f95a9c0640b9a1e8a36f87f5b9e1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:26.834192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e626cd5-53a2-43a5-be59-6f3e385c206d None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:26.834736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e626cd5-53a2-43a5-be59-6f3e385c206d None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:26.836279 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e626cd5-53a2-43a5-be59-6f3e385c206d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:26.875003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-8e626cd5-53a2-43a5-be59-6f3e385c206d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:26.877168 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8e626cd5-53a2-43a5-be59-6f3e385c206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:26.898657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ee2cb-a815-453c-b2cf-963610b58ae5 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:27.031522 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1185/2362] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:27.042417 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e626cd5-53a2-43a5-be59-6f3e385c206d None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:27.043957 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8e626cd5-53a2-43a5-be59-6f3e385c206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:27.063375 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422f55a-3f6b-44b0-92f6-c96958fb7d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:27.065663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422f55a-3f6b-44b0-92f6-c96958fb7d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:27.066419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422f55a-3f6b-44b0-92f6-c96958fb7d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:27.067132 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422f55a-3f6b-44b0-92f6-c96958fb7d60 admin admin] PATH_INFO: `/v3/projects/8c998f2e5ea242cf94cf153ae99249aa` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:27.073330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422f55a-3f6b-44b0-92f6-c96958fb7d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c998f2e5ea242cf94cf153ae99249aa)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:27.091349 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422f55a-3f6b-44b0-92f6-c96958fb7d60 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:27.105170 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:27.159842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e626cd5-53a2-43a5-be59-6f3e385c206d None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:27.169708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7409304-c3b6-4eef-8c5c-c1ba7d6ce27c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:27.170495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7409304-c3b6-4eef-8c5c-c1ba7d6ce27c service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:27.171334 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7409304-c3b6-4eef-8c5c-c1ba7d6ce27c service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:27.171334 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7409304-c3b6-4eef-8c5c-c1ba7d6ce27c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:27.208613 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7409304-c3b6-4eef-8c5c-c1ba7d6ce27c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:27.215528 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6422f55a-3f6b-44b0-92f6-c96958fb7d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c998f2e5ea242cf94cf153ae99249aa', 'request_id': 'req-6422f55a-3f6b-44b0-92f6-c96958fb7d60'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:27.217515 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7409304-c3b6-4eef-8c5c-c1ba7d6ce27c service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:27.234759 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6422f55a-3f6b-44b0-92f6-c96958fb7d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c998f2e5ea242cf94cf153ae99249aa', 'request_id': 'req-6422f55a-3f6b-44b0-92f6-c96958fb7d60'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:27.241134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1186/2363] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 10:48:27.245571 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6422f55a-3f6b-44b0-92f6-c96958fb7d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c998f2e5ea242cf94cf153ae99249aa', 'request_id': 'req-6422f55a-3f6b-44b0-92f6-c96958fb7d60'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:27.287812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6422f55a-3f6b-44b0-92f6-c96958fb7d60 admin admin] The token cache is being invalidate because project 8c998f2e5ea242cf94cf153ae99249aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:48:27.288791 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6422f55a-3f6b-44b0-92f6-c96958fb7d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:27.292741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6422f55a-3f6b-44b0-92f6-c96958fb7d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:27.295589 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1178/2364] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:48:26 2022] DELETE /identity/v3/projects/8c998f2e5ea242cf94cf153ae99249aa => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:27.301452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54bd28-ccf3-4f60-954f-414c0edeab36 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:27.301963 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54bd28-ccf3-4f60-954f-414c0edeab36 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:27.302362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54bd28-ccf3-4f60-954f-414c0edeab36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:27.344358 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-3f54bd28-ccf3-4f60-954f-414c0edeab36 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:27.346007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3f54bd28-ccf3-4f60-954f-414c0edeab36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:27.398685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422f55a-3f6b-44b0-92f6-c96958fb7d60 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:27.400356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6422f55a-3f6b-44b0-92f6-c96958fb7d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:27.488051 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:27.536362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1187/2365] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:27.543757 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67884e5-f635-4e68-9099-8c2687e94d46 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:27.544664 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67884e5-f635-4e68-9099-8c2687e94d46 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:27.545136 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67884e5-f635-4e68-9099-8c2687e94d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:27.569524 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-a67884e5-f635-4e68-9099-8c2687e94d46 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:27.571408 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a67884e5-f635-4e68-9099-8c2687e94d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:27.597770 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1188/2366] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:27.598860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67884e5-f635-4e68-9099-8c2687e94d46 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:27.603133 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422f55a-3f6b-44b0-92f6-c96958fb7d60 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:27.609672 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638dbc5f-3a3e-4b24-8f5a-5408ebc398b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:27.610909 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dbc5f-3a3e-4b24-8f5a-5408ebc398b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:27.611394 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dbc5f-3a3e-4b24-8f5a-5408ebc398b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:27.611875 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dbc5f-3a3e-4b24-8f5a-5408ebc398b7 admin admin] PATH_INFO: `/v3/projects/a6327132b85f4fe18b17e8907ad9c970` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:27.613281 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638dbc5f-3a3e-4b24-8f5a-5408ebc398b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6327132b85f4fe18b17e8907ad9c970)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:27.615503 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638dbc5f-3a3e-4b24-8f5a-5408ebc398b7 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:27.617446 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67884e5-f635-4e68-9099-8c2687e94d46 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:27.623386 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916dd9ef-d151-464f-ab3c-6e082f0b2508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:27.624005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dd9ef-d151-464f-ab3c-6e082f0b2508 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:27.624298 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dd9ef-d151-464f-ab3c-6e082f0b2508 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:27.624626 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dd9ef-d151-464f-ab3c-6e082f0b2508 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:27.625362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916dd9ef-d151-464f-ab3c-6e082f0b2508 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:48:27.625624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916dd9ef-d151-464f-ab3c-6e082f0b2508 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:27.627837 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916dd9ef-d151-464f-ab3c-6e082f0b2508 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:27.645379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1189/2367] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:48:27.651798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916dd9ef-d151-464f-ab3c-6e082f0b2508 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:27.666132 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916dd9ef-d151-464f-ab3c-6e082f0b2508 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:27.681845 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-638dbc5f-3a3e-4b24-8f5a-5408ebc398b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6327132b85f4fe18b17e8907ad9c970', 'request_id': 'req-638dbc5f-3a3e-4b24-8f5a-5408ebc398b7'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:27.690169 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-638dbc5f-3a3e-4b24-8f5a-5408ebc398b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6327132b85f4fe18b17e8907ad9c970', 'request_id': 'req-638dbc5f-3a3e-4b24-8f5a-5408ebc398b7'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:27.702824 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-638dbc5f-3a3e-4b24-8f5a-5408ebc398b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6327132b85f4fe18b17e8907ad9c970', 'request_id': 'req-638dbc5f-3a3e-4b24-8f5a-5408ebc398b7'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:27.734675 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-638dbc5f-3a3e-4b24-8f5a-5408ebc398b7 admin admin] The token cache is being invalidate because project a6327132b85f4fe18b17e8907ad9c970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:48:27.735835 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-638dbc5f-3a3e-4b24-8f5a-5408ebc398b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:27.746703 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-638dbc5f-3a3e-4b24-8f5a-5408ebc398b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:27.756835 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1179/2368] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:48:27 2022] DELETE /identity/v3/projects/a6327132b85f4fe18b17e8907ad9c970 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:27.764583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b77fb4-a0df-44d6-adfb-d370d45d3817 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:27.765600 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b77fb4-a0df-44d6-adfb-d370d45d3817 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:27.766843 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b77fb4-a0df-44d6-adfb-d370d45d3817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:27.819108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271f630-5eaa-46ba-8c59-0b06330ea50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:27.820436 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a8b77fb4-a0df-44d6-adfb-d370d45d3817 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:27.822125 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271f630-5eaa-46ba-8c59-0b06330ea50e admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:27.822451 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271f630-5eaa-46ba-8c59-0b06330ea50e admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:27.822731 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271f630-5eaa-46ba-8c59-0b06330ea50e admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:27.823601 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271f630-5eaa-46ba-8c59-0b06330ea50e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:27.824325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a8b77fb4-a0df-44d6-adfb-d370d45d3817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:27.832043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271f630-5eaa-46ba-8c59-0b06330ea50e admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:27.835861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1180/2369] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:27.845852 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b06a60-8f1f-4aef-b6b9-51a5f865098d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:27.846682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b06a60-8f1f-4aef-b6b9-51a5f865098d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:27.849241 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b06a60-8f1f-4aef-b6b9-51a5f865098d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:27.902351 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1190/2370] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:48:27 2022] POST /identity/v3/projects => generated 373 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:48:27.905814 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271f630-5eaa-46ba-8c59-0b06330ea50e admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:27.909204 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-24b06a60-8f1f-4aef-b6b9-51a5f865098d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:27.909587 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-1271f630-5eaa-46ba-8c59-0b06330ea50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:27.913056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-24b06a60-8f1f-4aef-b6b9-51a5f865098d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:28.025363 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1181/2371] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:28.030381 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b06a60-8f1f-4aef-b6b9-51a5f865098d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:28.039437 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:28.051898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b06a60-8f1f-4aef-b6b9-51a5f865098d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:28.061333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db44e2-a2d9-47ca-b1b2-a02d28a19ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:28.064048 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db44e2-a2d9-47ca-b1b2-a02d28a19ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:28.064416 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db44e2-a2d9-47ca-b1b2-a02d28a19ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:28.065487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db44e2-a2d9-47ca-b1b2-a02d28a19ad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:28.068023 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db44e2-a2d9-47ca-b1b2-a02d28a19ad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:48:28.068505 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db44e2-a2d9-47ca-b1b2-a02d28a19ad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:28.071423 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db44e2-a2d9-47ca-b1b2-a02d28a19ad6 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:28.086210 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271f630-5eaa-46ba-8c59-0b06330ea50e admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:28.094629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61a302-b34b-46d6-b5a1-4a37e2e7b4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:28.095705 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61a302-b34b-46d6-b5a1-4a37e2e7b4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:28.096260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61a302-b34b-46d6-b5a1-4a37e2e7b4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:28.096860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61a302-b34b-46d6-b5a1-4a37e2e7b4e2 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:28.097784 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61a302-b34b-46d6-b5a1-4a37e2e7b4e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:28.100676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61a302-b34b-46d6-b5a1-4a37e2e7b4e2 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:28.113019 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1182/2372] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:48:28.114691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db44e2-a2d9-47ca-b1b2-a02d28a19ad6 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:28.135023 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1191/2373] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:48:27 2022] POST /identity/v3/users => generated 287 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:48:28.140510 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61a302-b34b-46d6-b5a1-4a37e2e7b4e2 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:28.151594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db44e2-a2d9-47ca-b1b2-a02d28a19ad6 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:28.162982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61a302-b34b-46d6-b5a1-4a37e2e7b4e2 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:28.170573 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7725ce1-dfa6-4334-bb27-f5116b975b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:28.171278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7725ce1-dfa6-4334-bb27-f5116b975b17 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:28.171563 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7725ce1-dfa6-4334-bb27-f5116b975b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:28.171853 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7725ce1-dfa6-4334-bb27-f5116b975b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:28.172505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f6743-5fe8-445d-8ef3-c1cf55160cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:28.172659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7725ce1-dfa6-4334-bb27-f5116b975b17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:28.173749 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f6743-5fe8-445d-8ef3-c1cf55160cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:28.174599 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f6743-5fe8-445d-8ef3-c1cf55160cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:28.175994 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f6743-5fe8-445d-8ef3-c1cf55160cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:28.177078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f6743-5fe8-445d-8ef3-c1cf55160cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:28.181223 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f6743-5fe8-445d-8ef3-c1cf55160cd1 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:28.185195 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7725ce1-dfa6-4334-bb27-f5116b975b17 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:28.208859 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1192/2374] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 10:48:28.210601 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f6743-5fe8-445d-8ef3-c1cf55160cd1 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:28.249069 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f6743-5fe8-445d-8ef3-c1cf55160cd1 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:28.254160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1183/2375] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:48:28 2022] POST /identity/v3/projects => generated 397 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:48:28.255992 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7725ce1-dfa6-4334-bb27-f5116b975b17 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:28.282894 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:28.343058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6be579-15e2-475a-813b-6178290a3099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:28.345249 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6be579-15e2-475a-813b-6178290a3099 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:28.345793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6be579-15e2-475a-813b-6178290a3099 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:28.347215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6be579-15e2-475a-813b-6178290a3099 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:28.348581 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6be579-15e2-475a-813b-6178290a3099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:28.350819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6be579-15e2-475a-813b-6178290a3099 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:28.374948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1193/2376] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:48:28.380193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6be579-15e2-475a-813b-6178290a3099 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:28.396822 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6be579-15e2-475a-813b-6178290a3099 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:28.397331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7725ce1-dfa6-4334-bb27-f5116b975b17 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:28.402702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819061c-52e2-4a69-9290-349924af7bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:28.403470 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819061c-52e2-4a69-9290-349924af7bbd admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:28.403787 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defb9c5-863b-45e0-b802-5b28411b22bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:28.403926 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819061c-52e2-4a69-9290-349924af7bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:28.404156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819061c-52e2-4a69-9290-349924af7bbd admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:28.405062 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defb9c5-863b-45e0-b802-5b28411b22bc admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:28.405204 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819061c-52e2-4a69-9290-349924af7bbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:28.405299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defb9c5-863b-45e0-b802-5b28411b22bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:28.405832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defb9c5-863b-45e0-b802-5b28411b22bc admin admin] PATH_INFO: `/v3/projects/6fb831412eda41139998b2c6e04e46dc/users/9e17700918324b63a5076b6d83549ecc/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:28.406774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819061c-52e2-4a69-9290-349924af7bbd admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:28.432581 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defb9c5-863b-45e0-b802-5b28411b22bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb831412eda41139998b2c6e04e46dc, user_id=9e17700918324b63a5076b6d83549ecc, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:28.432812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1184/2377] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:48:28 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:48:28.436986 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defb9c5-863b-45e0-b802-5b28411b22bc admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:28.437668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819061c-52e2-4a69-9290-349924af7bbd admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:28.449300 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819061c-52e2-4a69-9290-349924af7bbd admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:28.455473 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf5d81-3fc4-427f-b365-bbf35e6d6d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:28.456639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf5d81-3fc4-427f-b365-bbf35e6d6d22 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:28.457473 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf5d81-3fc4-427f-b365-bbf35e6d6d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:28.457791 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf5d81-3fc4-427f-b365-bbf35e6d6d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:28.458606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf5d81-3fc4-427f-b365-bbf35e6d6d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:28.460844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf5d81-3fc4-427f-b365-bbf35e6d6d22 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:28.479227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1185/2378] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:48:28.479426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1194/2379] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:48:28 2022] PUT /identity/v3/projects/6fb831412eda41139998b2c6e04e46dc/users/9e17700918324b63a5076b6d83549ecc/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:48:28.490207 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf5d81-3fc4-427f-b365-bbf35e6d6d22 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:28.492802 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee957e6-563c-4a0d-959b-7d4f202e956b None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:28.493143 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee957e6-563c-4a0d-959b-7d4f202e956b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:28.493982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee957e6-563c-4a0d-959b-7d4f202e956b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:28.502524 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf5d81-3fc4-427f-b365-bbf35e6d6d22 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:28.549160 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-fee957e6-563c-4a0d-959b-7d4f202e956b None None] MFA Rules not processed for user `9e17700918324b63a5076b6d83549ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:28.550838 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fee957e6-563c-4a0d-959b-7d4f202e956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:28.675453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec32b98-c5e0-471f-bba5-673c5ea4f54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:28.676421 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec32b98-c5e0-471f-bba5-673c5ea4f54e admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:28.676990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec32b98-c5e0-471f-bba5-673c5ea4f54e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:28.678033 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec32b98-c5e0-471f-bba5-673c5ea4f54e admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:28.679441 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec32b98-c5e0-471f-bba5-673c5ea4f54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:28.682500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec32b98-c5e0-471f-bba5-673c5ea4f54e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:28.694079 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1195/2380] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:28.694079 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee957e6-563c-4a0d-959b-7d4f202e956b None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:28.694585 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fee957e6-563c-4a0d-959b-7d4f202e956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:28.710881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1186/2381] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:48:28.719076 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec32b98-c5e0-471f-bba5-673c5ea4f54e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:28.732007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee957e6-563c-4a0d-959b-7d4f202e956b None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:28.735711 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec32b98-c5e0-471f-bba5-673c5ea4f54e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:28.737211 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e719126-846d-4de4-9cff-aab3185d08fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:28.738545 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e719126-846d-4de4-9cff-aab3185d08fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:28.738825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e719126-846d-4de4-9cff-aab3185d08fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:28.739097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e719126-846d-4de4-9cff-aab3185d08fb admin admin] PATH_INFO: `/v3/projects/4450bab37828476081a02d2330f757b6` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:28.740268 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e719126-846d-4de4-9cff-aab3185d08fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4450bab37828476081a02d2330f757b6)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:28.742219 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e719126-846d-4de4-9cff-aab3185d08fb admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:28.760879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025e220-53f0-4074-98cc-ea7bf65f2e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:28.761596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025e220-53f0-4074-98cc-ea7bf65f2e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:28.763366 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025e220-53f0-4074-98cc-ea7bf65f2e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:28.763655 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025e220-53f0-4074-98cc-ea7bf65f2e1c admin admin] PATH_INFO: `/v3/projects/cf94e86fe18a433d93ece511c5db66ef/users/8df5e24c6b07436c881812ff76ed2bbe/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:28.765090 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:28.786515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025e220-53f0-4074-98cc-ea7bf65f2e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf94e86fe18a433d93ece511c5db66ef, user_id=8df5e24c6b07436c881812ff76ed2bbe, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:28.795623 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025e220-53f0-4074-98cc-ea7bf65f2e1c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:28.825718 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4e719126-846d-4de4-9cff-aab3185d08fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4450bab37828476081a02d2330f757b6', 'request_id': 'req-4e719126-846d-4de4-9cff-aab3185d08fb'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:28.835637 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4e719126-846d-4de4-9cff-aab3185d08fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4450bab37828476081a02d2330f757b6', 'request_id': 'req-4e719126-846d-4de4-9cff-aab3185d08fb'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:28.836489 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1187/2382] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:48:28 2022] PUT /identity/v3/projects/cf94e86fe18a433d93ece511c5db66ef/users/8df5e24c6b07436c881812ff76ed2bbe/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:28.845976 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025e220-53f0-4074-98cc-ea7bf65f2e1c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:28.851112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4e719126-846d-4de4-9cff-aab3185d08fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4450bab37828476081a02d2330f757b6', 'request_id': 'req-4e719126-846d-4de4-9cff-aab3185d08fb'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:28.853291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2025e220-53f0-4074-98cc-ea7bf65f2e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:28.907684 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4e719126-846d-4de4-9cff-aab3185d08fb admin admin] The token cache is being invalidate because project 4450bab37828476081a02d2330f757b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:48:28.908297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4e719126-846d-4de4-9cff-aab3185d08fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:28.910244 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4e719126-846d-4de4-9cff-aab3185d08fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:28.914259 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1196/2383] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:48:28 2022] DELETE /identity/v3/projects/4450bab37828476081a02d2330f757b6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:28.920641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9253e-b768-4cc0-9a79-bc00c89c568a None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:28.920933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9253e-b768-4cc0-9a79-bc00c89c568a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:28.921221 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9253e-b768-4cc0-9a79-bc00c89c568a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:28.949182 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025e220-53f0-4074-98cc-ea7bf65f2e1c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:28.960620 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171aaf4-4f8f-4406-904f-7697db4c4747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:28.961585 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171aaf4-4f8f-4406-904f-7697db4c4747 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:28.962057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171aaf4-4f8f-4406-904f-7697db4c4747 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:28.964786 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171aaf4-4f8f-4406-904f-7697db4c4747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:28.967524 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3171aaf4-4f8f-4406-904f-7697db4c4747 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:29.005164 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-b5a9253e-b768-4cc0-9a79-bc00c89c568a None None] MFA Rules not processed for user `8df5e24c6b07436c881812ff76ed2bbe`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:29.006721 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b5a9253e-b768-4cc0-9a79-bc00c89c568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:29.016439 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:29.097730 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171aaf4-4f8f-4406-904f-7697db4c4747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:29.100283 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171aaf4-4f8f-4406-904f-7697db4c4747 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:29.118498 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1188/2384] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:48:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:48:29.119604 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88e6f3-8068-4150-ace9-99106e9d9287 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:29.119887 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88e6f3-8068-4150-ace9-99106e9d9287 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:29.120161 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88e6f3-8068-4150-ace9-99106e9d9287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:29.174236 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1197/2385] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:28 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:29.175289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9253e-b768-4cc0-9a79-bc00c89c568a None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:29.177995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b5a9253e-b768-4cc0-9a79-bc00c89c568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:29.178189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-1b88e6f3-8068-4150-ace9-99106e9d9287 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:29.179393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1b88e6f3-8068-4150-ace9-99106e9d9287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:29.333644 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1189/2386] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:29.333942 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88e6f3-8068-4150-ace9-99106e9d9287 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:29.355817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1b88e6f3-8068-4150-ace9-99106e9d9287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:29.409327 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88e6f3-8068-4150-ace9-99106e9d9287 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:29.419910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc6eb4-b31b-496c-bdf2-51506b4c101e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:29.420541 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc6eb4-b31b-496c-bdf2-51506b4c101e service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:29.420837 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc6eb4-b31b-496c-bdf2-51506b4c101e service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:29.421123 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc6eb4-b31b-496c-bdf2-51506b4c101e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:29.450947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9253e-b768-4cc0-9a79-bc00c89c568a None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:29.452856 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc6eb4-b31b-496c-bdf2-51506b4c101e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:29.454310 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc6eb4-b31b-496c-bdf2-51506b4c101e service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:29.466197 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0d500-7fee-4045-861c-cc8ca3237268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:29.466878 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0d500-7fee-4045-861c-cc8ca3237268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:29.467164 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0d500-7fee-4045-861c-cc8ca3237268 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:29.467441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0d500-7fee-4045-861c-cc8ca3237268 admin admin] PATH_INFO: `/v3/users/9e17700918324b63a5076b6d83549ecc` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:29.468827 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0d500-7fee-4045-861c-cc8ca3237268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e17700918324b63a5076b6d83549ecc)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:29.473473 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0d500-7fee-4045-861c-cc8ca3237268 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:29.482795 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1190/2387] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:48:29 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:48:29.496905 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df42a31-a631-4b93-89b2-6f4f15f9be82 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:29.497257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df42a31-a631-4b93-89b2-6f4f15f9be82 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:29.497536 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df42a31-a631-4b93-89b2-6f4f15f9be82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:29.568601 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-1df42a31-a631-4b93-89b2-6f4f15f9be82 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:29.570072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1df42a31-a631-4b93-89b2-6f4f15f9be82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:29.607222 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1191/2388] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:29.613076 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:29.617356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df42a31-a631-4b93-89b2-6f4f15f9be82 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:29.639008 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a0d0d500-7fee-4045-861c-cc8ca3237268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e17700918324b63a5076b6d83549ecc'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:29.662656 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a0d0d500-7fee-4045-861c-cc8ca3237268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e17700918324b63a5076b6d83549ecc'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:29.663485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a0d0d500-7fee-4045-861c-cc8ca3237268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e17700918324b63a5076b6d83549ecc'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:29.664284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a0d0d500-7fee-4045-861c-cc8ca3237268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e17700918324b63a5076b6d83549ecc'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:29.674444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df42a31-a631-4b93-89b2-6f4f15f9be82 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:29.679267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a0d0d500-7fee-4045-861c-cc8ca3237268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e17700918324b63a5076b6d83549ecc'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:29.698126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f903ac1-9a99-4ad0-b400-1d7cd80aa00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:29.699019 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f903ac1-9a99-4ad0-b400-1d7cd80aa00e admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:29.699413 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f903ac1-9a99-4ad0-b400-1d7cd80aa00e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:29.699799 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f903ac1-9a99-4ad0-b400-1d7cd80aa00e admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:29.701086 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f903ac1-9a99-4ad0-b400-1d7cd80aa00e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:48:29.708624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f903ac1-9a99-4ad0-b400-1d7cd80aa00e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:29.710428 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f903ac1-9a99-4ad0-b400-1d7cd80aa00e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:29.751690 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1198/2389] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:48:29 2022] DELETE /identity/v3/users/9e17700918324b63a5076b6d83549ecc => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:29.753624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a828fc-11f3-4539-aa90-651f17b56514 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:29.754078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a828fc-11f3-4539-aa90-651f17b56514 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:29.754514 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a828fc-11f3-4539-aa90-651f17b56514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:29.756671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1192/2390] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:48:29.757653 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f903ac1-9a99-4ad0-b400-1d7cd80aa00e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:29.765969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1f903ac1-9a99-4ad0-b400-1d7cd80aa00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:29.789732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e6a828fc-11f3-4539-aa90-651f17b56514 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:29.792261 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e6a828fc-11f3-4539-aa90-651f17b56514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:29.801326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f903ac1-9a99-4ad0-b400-1d7cd80aa00e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:29.914932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1199/2391] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:29.924260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a828fc-11f3-4539-aa90-651f17b56514 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:29.926848 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e6a828fc-11f3-4539-aa90-651f17b56514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:29.938821 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da534b9f-bc08-4276-ae0f-7a068ebea068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:29.939555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da534b9f-bc08-4276-ae0f-7a068ebea068 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:29.939897 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da534b9f-bc08-4276-ae0f-7a068ebea068 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:29.940247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da534b9f-bc08-4276-ae0f-7a068ebea068 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:29.940988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da534b9f-bc08-4276-ae0f-7a068ebea068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:29.943042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da534b9f-bc08-4276-ae0f-7a068ebea068 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:30.002314 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1193/2392] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:48:29 2022] POST /identity/v3/projects => generated 373 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:48:30.003812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da534b9f-bc08-4276-ae0f-7a068ebea068 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:30.036983 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:30.092712 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a828fc-11f3-4539-aa90-651f17b56514 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:30.139818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da534b9f-bc08-4276-ae0f-7a068ebea068 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:30.145568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7c050-afdd-4d91-9161-d8b60f2b8cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:30.146197 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7c050-afdd-4d91-9161-d8b60f2b8cbd admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:30.146599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7c050-afdd-4d91-9161-d8b60f2b8cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:30.146881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7c050-afdd-4d91-9161-d8b60f2b8cbd admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:30.147521 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7c050-afdd-4d91-9161-d8b60f2b8cbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:30.149735 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7c050-afdd-4d91-9161-d8b60f2b8cbd admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:30.176588 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1194/2393] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:48:30 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:48:30.179622 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7c050-afdd-4d91-9161-d8b60f2b8cbd admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:30.204946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7c050-afdd-4d91-9161-d8b60f2b8cbd admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:30.211889 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2191a1d-513b-4cd6-a9da-8fd5745bf18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:30.212830 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2191a1d-513b-4cd6-a9da-8fd5745bf18e admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:30.213192 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2191a1d-513b-4cd6-a9da-8fd5745bf18e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:30.213800 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2191a1d-513b-4cd6-a9da-8fd5745bf18e admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:30.215357 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2191a1d-513b-4cd6-a9da-8fd5745bf18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:30.218620 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2191a1d-513b-4cd6-a9da-8fd5745bf18e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:30.230939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1201d-b20f-4716-99cf-9b0d9e1a3b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:30.232866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1201d-b20f-4716-99cf-9b0d9e1a3b91 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:30.233220 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1201d-b20f-4716-99cf-9b0d9e1a3b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:30.234624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1201d-b20f-4716-99cf-9b0d9e1a3b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:30.235709 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1195/2394] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:48:30.239717 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2191a1d-513b-4cd6-a9da-8fd5745bf18e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:30.248033 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1201d-b20f-4716-99cf-9b0d9e1a3b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:30.249662 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1201d-b20f-4716-99cf-9b0d9e1a3b91 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:30.267497 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2191a1d-513b-4cd6-a9da-8fd5745bf18e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:30.274470 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1200/2395] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:48:30.278850 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72d334-42a1-4a88-981d-371334c11e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:30.279259 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72d334-42a1-4a88-981d-371334c11e6a admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:30.279759 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72d334-42a1-4a88-981d-371334c11e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:30.280040 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72d334-42a1-4a88-981d-371334c11e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:30.281155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72d334-42a1-4a88-981d-371334c11e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:30.282809 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72d334-42a1-4a88-981d-371334c11e6a admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:30.311204 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1196/2396] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:48:30.315631 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1201d-b20f-4716-99cf-9b0d9e1a3b91 service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:30.327389 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1201d-b20f-4716-99cf-9b0d9e1a3b91 service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:30.332910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d43ca-4be1-409a-a187-a19a8145ed34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:30.333700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d43ca-4be1-409a-a187-a19a8145ed34 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:30.334096 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d43ca-4be1-409a-a187-a19a8145ed34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:30.334432 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d43ca-4be1-409a-a187-a19a8145ed34 admin admin] PATH_INFO: `/v3/projects/a54faf1b3e4e465a8155dee4bd745723/users/b0507dd8413e46c8be5d766039047bbd/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:30.372410 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:30.386372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d43ca-4be1-409a-a187-a19a8145ed34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a54faf1b3e4e465a8155dee4bd745723, user_id=b0507dd8413e46c8be5d766039047bbd, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:30.389995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d43ca-4be1-409a-a187-a19a8145ed34 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:30.408622 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1201/2397] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:48:30 2022] PUT /identity/v3/projects/a54faf1b3e4e465a8155dee4bd745723/users/b0507dd8413e46c8be5d766039047bbd/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:30.427522 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9cd01-d269-4cc6-90e3-025e66a340e8 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:30.428085 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9cd01-d269-4cc6-90e3-025e66a340e8 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:30.428085 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9cd01-d269-4cc6-90e3-025e66a340e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:30.468637 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-92d9cd01-d269-4cc6-90e3-025e66a340e8 None None] MFA Rules not processed for user `b0507dd8413e46c8be5d766039047bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:30.470081 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-92d9cd01-d269-4cc6-90e3-025e66a340e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:30.577826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1197/2398] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:30.595019 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d43ca-4be1-409a-a187-a19a8145ed34 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:30.597575 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-986d43ca-4be1-409a-a187-a19a8145ed34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:30.757983 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9cd01-d269-4cc6-90e3-025e66a340e8 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:30.759953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-92d9cd01-d269-4cc6-90e3-025e66a340e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:30.772088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d43ca-4be1-409a-a187-a19a8145ed34 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:30.779638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a521f01-0fcf-482d-a6e8-3dcacb306417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:30.780278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a521f01-0fcf-482d-a6e8-3dcacb306417 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:30.780568 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a521f01-0fcf-482d-a6e8-3dcacb306417 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:30.780865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a521f01-0fcf-482d-a6e8-3dcacb306417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:30.791624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a521f01-0fcf-482d-a6e8-3dcacb306417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:30.793331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a521f01-0fcf-482d-a6e8-3dcacb306417 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:30.804460 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1202/2399] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:48:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:48:30.951776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9cd01-d269-4cc6-90e3-025e66a340e8 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:30.973171 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ccb7a-d90b-4d70-827a-ed6f815467cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:30.973834 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ccb7a-d90b-4d70-827a-ed6f815467cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:30.974118 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ccb7a-d90b-4d70-827a-ed6f815467cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:30.974392 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ccb7a-d90b-4d70-827a-ed6f815467cd admin admin] PATH_INFO: `/v3/projects/6fb831412eda41139998b2c6e04e46dc` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:30.977313 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ccb7a-d90b-4d70-827a-ed6f815467cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fb831412eda41139998b2c6e04e46dc)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:30.982628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ccb7a-d90b-4d70-827a-ed6f815467cd admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:30.996743 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:31.103133 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-407ccb7a-d90b-4d70-827a-ed6f815467cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb831412eda41139998b2c6e04e46dc', 'request_id': 'req-407ccb7a-d90b-4d70-827a-ed6f815467cd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:31.125571 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-407ccb7a-d90b-4d70-827a-ed6f815467cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb831412eda41139998b2c6e04e46dc', 'request_id': 'req-407ccb7a-d90b-4d70-827a-ed6f815467cd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:31.136842 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-407ccb7a-d90b-4d70-827a-ed6f815467cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb831412eda41139998b2c6e04e46dc', 'request_id': 'req-407ccb7a-d90b-4d70-827a-ed6f815467cd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:31.151318 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-407ccb7a-d90b-4d70-827a-ed6f815467cd admin admin] The token cache is being invalidate because project 6fb831412eda41139998b2c6e04e46dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:48:31.151685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-407ccb7a-d90b-4d70-827a-ed6f815467cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:31.152930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-407ccb7a-d90b-4d70-827a-ed6f815467cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:31.154827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1198/2400] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:48:30 2022] DELETE /identity/v3/projects/6fb831412eda41139998b2c6e04e46dc => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:48:31.159825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af13e0-4ec4-4be0-8d9e-fbd2e397b56b None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:31.160348 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af13e0-4ec4-4be0-8d9e-fbd2e397b56b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:31.160684 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af13e0-4ec4-4be0-8d9e-fbd2e397b56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:31.186337 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-b2af13e0-4ec4-4be0-8d9e-fbd2e397b56b None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:31.187645 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b2af13e0-4ec4-4be0-8d9e-fbd2e397b56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:31.280159 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1203/2401] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:31.287990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60e3dd-ad35-4fe8-a5fe-fe6532c11b64 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:31.288678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60e3dd-ad35-4fe8-a5fe-fe6532c11b64 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:31.289387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60e3dd-ad35-4fe8-a5fe-fe6532c11b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:31.315965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9c60e3dd-ad35-4fe8-a5fe-fe6532c11b64 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:31.317270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9c60e3dd-ad35-4fe8-a5fe-fe6532c11b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:31.330299 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1199/2402] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:31.334625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af13e0-4ec4-4be0-8d9e-fbd2e397b56b None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:31.347582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af13e0-4ec4-4be0-8d9e-fbd2e397b56b None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:31.359466 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11aa7b0-53e7-43d8-bb18-2795d33bb891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:31.360169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aa7b0-53e7-43d8-bb18-2795d33bb891 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:31.360590 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aa7b0-53e7-43d8-bb18-2795d33bb891 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:31.360944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aa7b0-53e7-43d8-bb18-2795d33bb891 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:31.361850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11aa7b0-53e7-43d8-bb18-2795d33bb891 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:48:31.362234 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11aa7b0-53e7-43d8-bb18-2795d33bb891 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:31.365021 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11aa7b0-53e7-43d8-bb18-2795d33bb891 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:31.383569 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1204/2403] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:48:31.387910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60e3dd-ad35-4fe8-a5fe-fe6532c11b64 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:31.399168 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60e3dd-ad35-4fe8-a5fe-fe6532c11b64 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:31.413530 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9000c8a-41c4-4221-919e-1543334822f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:31.414230 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9000c8a-41c4-4221-919e-1543334822f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:31.414580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9000c8a-41c4-4221-919e-1543334822f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:31.414922 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9000c8a-41c4-4221-919e-1543334822f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:31.415694 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9000c8a-41c4-4221-919e-1543334822f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:31.417692 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9000c8a-41c4-4221-919e-1543334822f3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:31.456954 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1200/2404] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:48:31 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:48:31.462761 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11aa7b0-53e7-43d8-bb18-2795d33bb891 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:31.476594 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11aa7b0-53e7-43d8-bb18-2795d33bb891 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:31.565274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e443f34-fc3c-47f5-b708-0b38929f312f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:31.565895 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e443f34-fc3c-47f5-b708-0b38929f312f admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:31.566199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e443f34-fc3c-47f5-b708-0b38929f312f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:31.566440 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e443f34-fc3c-47f5-b708-0b38929f312f admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:31.567432 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e443f34-fc3c-47f5-b708-0b38929f312f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:31.572751 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e443f34-fc3c-47f5-b708-0b38929f312f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:31.603640 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1205/2405] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:48:31 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:48:31.604936 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9000c8a-41c4-4221-919e-1543334822f3 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:31.620330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9000c8a-41c4-4221-919e-1543334822f3 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:31.626226 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73552a-e495-47c6-ac37-5bebf734862d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:31.626987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73552a-e495-47c6-ac37-5bebf734862d admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:31.627443 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73552a-e495-47c6-ac37-5bebf734862d admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:31.641479 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73552a-e495-47c6-ac37-5bebf734862d admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:31.642242 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73552a-e495-47c6-ac37-5bebf734862d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:31.643867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73552a-e495-47c6-ac37-5bebf734862d admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:31.674167 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1201/2406] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:48:31.678569 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e443f34-fc3c-47f5-b708-0b38929f312f admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:31.692565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e443f34-fc3c-47f5-b708-0b38929f312f admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:31.711007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f1d85-82ac-4d87-973e-991d1ecb7b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:31.711007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f1d85-82ac-4d87-973e-991d1ecb7b85 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:31.711007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f1d85-82ac-4d87-973e-991d1ecb7b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:31.711007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f1d85-82ac-4d87-973e-991d1ecb7b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:31.711444 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f1d85-82ac-4d87-973e-991d1ecb7b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:31.711444 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f1d85-82ac-4d87-973e-991d1ecb7b85 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:31.711444 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:31.729308 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1206/2407] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 10:48:31.734283 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73552a-e495-47c6-ac37-5bebf734862d admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:31.752221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73552a-e495-47c6-ac37-5bebf734862d admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:31.758284 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841043c2-fa58-4add-9799-907460926834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:31.759114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841043c2-fa58-4add-9799-907460926834 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:31.759398 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841043c2-fa58-4add-9799-907460926834 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:31.759679 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841043c2-fa58-4add-9799-907460926834 admin admin] PATH_INFO: `/v3/projects/a61767de32e64dde916b592f7d110765/users/c61f11bb71774e0cb9cb84ffcf657360/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:31.791430 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841043c2-fa58-4add-9799-907460926834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a61767de32e64dde916b592f7d110765, user_id=c61f11bb71774e0cb9cb84ffcf657360, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:31.798628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841043c2-fa58-4add-9799-907460926834 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:31.845291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1202/2408] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:48:31 2022] PUT /identity/v3/projects/a61767de32e64dde916b592f7d110765/users/c61f11bb71774e0cb9cb84ffcf657360/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:31.855893 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5d084-795d-42ad-85ca-690eb29a1e0c None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:31.856251 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5d084-795d-42ad-85ca-690eb29a1e0c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:31.856503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5d084-795d-42ad-85ca-690eb29a1e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:31.902155 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-68e5d084-795d-42ad-85ca-690eb29a1e0c None None] MFA Rules not processed for user `c61f11bb71774e0cb9cb84ffcf657360`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:31.904427 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-68e5d084-795d-42ad-85ca-690eb29a1e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:31.982143 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1207/2409] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:31.994093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841043c2-fa58-4add-9799-907460926834 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:31.995793 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-841043c2-fa58-4add-9799-907460926834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:32.073545 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841043c2-fa58-4add-9799-907460926834 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:32.078476 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90023cac-b11e-4660-ae70-d7607a519228 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:32.079090 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90023cac-b11e-4660-ae70-d7607a519228 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:32.079370 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90023cac-b11e-4660-ae70-d7607a519228 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:32.079671 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90023cac-b11e-4660-ae70-d7607a519228 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:32.093372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90023cac-b11e-4660-ae70-d7607a519228 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:32.094823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90023cac-b11e-4660-ae70-d7607a519228 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:32.105702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1203/2410] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:48:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:48:32.409805 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181a360-dbe1-48a1-8908-7ae589109096 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:32.410393 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181a360-dbe1-48a1-8908-7ae589109096 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:32.410393 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181a360-dbe1-48a1-8908-7ae589109096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:32.446191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-a181a360-dbe1-48a1-8908-7ae589109096 None None] MFA Rules not processed for user `b0507dd8413e46c8be5d766039047bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:32.447588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a181a360-dbe1-48a1-8908-7ae589109096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:32.560606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1208/2411] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:35.047857 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90023cac-b11e-4660-ae70-d7607a519228 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:35.049325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-90023cac-b11e-4660-ae70-d7607a519228 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:35.105596 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:35.139252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90023cac-b11e-4660-ae70-d7607a519228 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:35.145326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9dc31-489e-4f44-9b04-547550d219ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:35.146059 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9dc31-489e-4f44-9b04-547550d219ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:35.146350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9dc31-489e-4f44-9b04-547550d219ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:35.146626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9dc31-489e-4f44-9b04-547550d219ae admin admin] PATH_INFO: `/v3/users/8df5e24c6b07436c881812ff76ed2bbe` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:35.147926 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9dc31-489e-4f44-9b04-547550d219ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=8df5e24c6b07436c881812ff76ed2bbe)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:35.150003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9dc31-489e-4f44-9b04-547550d219ae admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:35.216473 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0ee9dc31-489e-4f44-9b04-547550d219ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8df5e24c6b07436c881812ff76ed2bbe'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:35.225772 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0ee9dc31-489e-4f44-9b04-547550d219ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8df5e24c6b07436c881812ff76ed2bbe'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:35.226870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0ee9dc31-489e-4f44-9b04-547550d219ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8df5e24c6b07436c881812ff76ed2bbe'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:35.228622 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0ee9dc31-489e-4f44-9b04-547550d219ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8df5e24c6b07436c881812ff76ed2bbe'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:35.238312 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0ee9dc31-489e-4f44-9b04-547550d219ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8df5e24c6b07436c881812ff76ed2bbe'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:35.266335 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1204/2412] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:48:35 2022] DELETE /identity/v3/users/8df5e24c6b07436c881812ff76ed2bbe => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:35.275931 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d6159-e38c-46f5-be7a-1e8dfe466ca1 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:35.276409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d6159-e38c-46f5-be7a-1e8dfe466ca1 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:35.276642 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d6159-e38c-46f5-be7a-1e8dfe466ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:35.304107 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-8d6d6159-e38c-46f5-be7a-1e8dfe466ca1 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:35.306172 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8d6d6159-e38c-46f5-be7a-1e8dfe466ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:35.414510 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1209/2413] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:35.430549 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9dc31-489e-4f44-9b04-547550d219ae admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:35.432072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0ee9dc31-489e-4f44-9b04-547550d219ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:35.496825 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9dc31-489e-4f44-9b04-547550d219ae admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:35.500355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4d61d-22d6-4d7c-a6ac-df446243853a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:35.501026 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4d61d-22d6-4d7c-a6ac-df446243853a service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:35.501356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4d61d-22d6-4d7c-a6ac-df446243853a service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:35.501744 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4d61d-22d6-4d7c-a6ac-df446243853a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:35.511571 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4d61d-22d6-4d7c-a6ac-df446243853a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:35.513583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4d61d-22d6-4d7c-a6ac-df446243853a service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:35.523319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1205/2414] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:48:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:48:36.162708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d6159-e38c-46f5-be7a-1e8dfe466ca1 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:36.164637 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8d6d6159-e38c-46f5-be7a-1e8dfe466ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:36.181385 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d6159-e38c-46f5-be7a-1e8dfe466ca1 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:36.187117 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8e8e1-5e03-4429-94fb-e504593cf8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:36.187750 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8e8e1-5e03-4429-94fb-e504593cf8f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:36.188031 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8e8e1-5e03-4429-94fb-e504593cf8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:36.188303 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8e8e1-5e03-4429-94fb-e504593cf8f5 admin admin] PATH_INFO: `/v3/projects/cf94e86fe18a433d93ece511c5db66ef` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:36.189461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8e8e1-5e03-4429-94fb-e504593cf8f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf94e86fe18a433d93ece511c5db66ef)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:36.191690 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8e8e1-5e03-4429-94fb-e504593cf8f5 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:36.224906 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:36.243013 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0fa8e8e1-5e03-4429-94fb-e504593cf8f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf94e86fe18a433d93ece511c5db66ef', 'request_id': 'req-0fa8e8e1-5e03-4429-94fb-e504593cf8f5'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:36.249390 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0fa8e8e1-5e03-4429-94fb-e504593cf8f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf94e86fe18a433d93ece511c5db66ef', 'request_id': 'req-0fa8e8e1-5e03-4429-94fb-e504593cf8f5'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:36.256865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0fa8e8e1-5e03-4429-94fb-e504593cf8f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf94e86fe18a433d93ece511c5db66ef', 'request_id': 'req-0fa8e8e1-5e03-4429-94fb-e504593cf8f5'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:36.267993 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0fa8e8e1-5e03-4429-94fb-e504593cf8f5 admin admin] The token cache is being invalidate because project cf94e86fe18a433d93ece511c5db66ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:48:36.268277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0fa8e8e1-5e03-4429-94fb-e504593cf8f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:36.268925 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-0fa8e8e1-5e03-4429-94fb-e504593cf8f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:36.270396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1210/2415] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:48:36 2022] DELETE /identity/v3/projects/cf94e86fe18a433d93ece511c5db66ef => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:43.957389 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4d61d-22d6-4d7c-a6ac-df446243853a service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:43.958868 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ebb4d61d-22d6-4d7c-a6ac-df446243853a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:43.972586 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4d61d-22d6-4d7c-a6ac-df446243853a service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:44.030677 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:44.038817 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bd1f9-a39d-4292-8fa3-e9e1096ccf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:44.039599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd1f9-a39d-4292-8fa3-e9e1096ccf80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:44.039899 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd1f9-a39d-4292-8fa3-e9e1096ccf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:44.040249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd1f9-a39d-4292-8fa3-e9e1096ccf80 admin admin] PATH_INFO: `/v3/users/c61f11bb71774e0cb9cb84ffcf657360` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:44.043783 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bd1f9-a39d-4292-8fa3-e9e1096ccf80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c61f11bb71774e0cb9cb84ffcf657360)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:44.045892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bd1f9-a39d-4292-8fa3-e9e1096ccf80 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:44.097759 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6b6bd1f9-a39d-4292-8fa3-e9e1096ccf80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c61f11bb71774e0cb9cb84ffcf657360'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:44.105498 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6b6bd1f9-a39d-4292-8fa3-e9e1096ccf80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c61f11bb71774e0cb9cb84ffcf657360'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:44.106673 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6b6bd1f9-a39d-4292-8fa3-e9e1096ccf80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c61f11bb71774e0cb9cb84ffcf657360'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:44.107296 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6b6bd1f9-a39d-4292-8fa3-e9e1096ccf80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c61f11bb71774e0cb9cb84ffcf657360'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:44.117070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6b6bd1f9-a39d-4292-8fa3-e9e1096ccf80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c61f11bb71774e0cb9cb84ffcf657360'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:44.134491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1206/2416] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:48:43 2022] DELETE /identity/v3/users/c61f11bb71774e0cb9cb84ffcf657360 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:44.139218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01f8df-8c6b-4f02-b42f-7a77012fda3a None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:44.139693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01f8df-8c6b-4f02-b42f-7a77012fda3a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:44.139788 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01f8df-8c6b-4f02-b42f-7a77012fda3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:44.160708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-fb01f8df-8c6b-4f02-b42f-7a77012fda3a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:44.161920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fb01f8df-8c6b-4f02-b42f-7a77012fda3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:44.226469 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1211/2417] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:48:44.243204 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bd1f9-a39d-4292-8fa3-e9e1096ccf80 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:44.246706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6b6bd1f9-a39d-4292-8fa3-e9e1096ccf80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:44.320795 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bd1f9-a39d-4292-8fa3-e9e1096ccf80 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:44.324946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f192ae-8f73-4f2c-8ea2-a0649387f0bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:44.325753 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f192ae-8f73-4f2c-8ea2-a0649387f0bf service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:44.326312 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f192ae-8f73-4f2c-8ea2-a0649387f0bf service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:44.326728 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f192ae-8f73-4f2c-8ea2-a0649387f0bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:44.338592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f192ae-8f73-4f2c-8ea2-a0649387f0bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:44.340841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f192ae-8f73-4f2c-8ea2-a0649387f0bf service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:44.353350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1207/2418] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:48:44.642999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01f8df-8c6b-4f02-b42f-7a77012fda3a None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:44.644801 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-fb01f8df-8c6b-4f02-b42f-7a77012fda3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:44.666238 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01f8df-8c6b-4f02-b42f-7a77012fda3a None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:44.671123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ce768-0645-4ff5-a0bb-3798fc44d1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:44.671765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ce768-0645-4ff5-a0bb-3798fc44d1a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:44.672048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ce768-0645-4ff5-a0bb-3798fc44d1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:44.672370 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ce768-0645-4ff5-a0bb-3798fc44d1a4 admin admin] PATH_INFO: `/v3/projects/a61767de32e64dde916b592f7d110765` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:44.673536 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ce768-0645-4ff5-a0bb-3798fc44d1a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a61767de32e64dde916b592f7d110765)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:44.676925 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ce768-0645-4ff5-a0bb-3798fc44d1a4 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:44.779979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-397ce768-0645-4ff5-a0bb-3798fc44d1a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a61767de32e64dde916b592f7d110765', 'request_id': 'req-397ce768-0645-4ff5-a0bb-3798fc44d1a4'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:44.787365 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-397ce768-0645-4ff5-a0bb-3798fc44d1a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a61767de32e64dde916b592f7d110765', 'request_id': 'req-397ce768-0645-4ff5-a0bb-3798fc44d1a4'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:44.796493 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-397ce768-0645-4ff5-a0bb-3798fc44d1a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a61767de32e64dde916b592f7d110765', 'request_id': 'req-397ce768-0645-4ff5-a0bb-3798fc44d1a4'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:44.811665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-397ce768-0645-4ff5-a0bb-3798fc44d1a4 admin admin] The token cache is being invalidate because project a61767de32e64dde916b592f7d110765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:48:44.811961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-397ce768-0645-4ff5-a0bb-3798fc44d1a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:44.812748 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-397ce768-0645-4ff5-a0bb-3798fc44d1a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:48:44.814640 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1212/2419] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:48:44 2022] DELETE /identity/v3/projects/a61767de32e64dde916b592f7d110765 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:48:46.178418 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195a705-14bd-4ed3-bfca-98904bf886a3 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:46.178903 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195a705-14bd-4ed3-bfca-98904bf886a3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:46.179000 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195a705-14bd-4ed3-bfca-98904bf886a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:46.198740 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2195a705-14bd-4ed3-bfca-98904bf886a3 None None] MFA Rules not processed for user `d0d2655f3c6a42898c67f82a697ef7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:46.199960 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2195a705-14bd-4ed3-bfca-98904bf886a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:46.257304 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1208/2420] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:48:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:53.552249 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ce768-0645-4ff5-a0bb-3798fc44d1a4 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:53.553741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-397ce768-0645-4ff5-a0bb-3798fc44d1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:53.595443 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:53.612240 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ce768-0645-4ff5-a0bb-3798fc44d1a4 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:53.615828 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badf8be-29dc-4e1b-82f4-5b13de6ec441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:53.616427 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badf8be-29dc-4e1b-82f4-5b13de6ec441 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:53.616738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badf8be-29dc-4e1b-82f4-5b13de6ec441 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:53.617012 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badf8be-29dc-4e1b-82f4-5b13de6ec441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:53.618678 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2badf8be-29dc-4e1b-82f4-5b13de6ec441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:53.680179 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2badf8be-29dc-4e1b-82f4-5b13de6ec441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:53.681644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2badf8be-29dc-4e1b-82f4-5b13de6ec441 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:53.691634 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1213/2421] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:48:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:48:56.250691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:48:57.135564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e96d4-8d91-404a-93fb-60c0dc86f1ef None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:57.135855 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e96d4-8d91-404a-93fb-60c0dc86f1ef None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:57.136185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e96d4-8d91-404a-93fb-60c0dc86f1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:57.159047 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a78e96d4-8d91-404a-93fb-60c0dc86f1ef None None] MFA Rules not processed for user `bdc800f1d4174b5cba4f6f496207ec95`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:57.161270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a78e96d4-8d91-404a-93fb-60c0dc86f1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:57.227976 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1209/2422] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 10:48:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:57.246008 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badf8be-29dc-4e1b-82f4-5b13de6ec441 service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:57.247647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2badf8be-29dc-4e1b-82f4-5b13de6ec441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:57.378785 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badf8be-29dc-4e1b-82f4-5b13de6ec441 service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:57.391559 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d837a-46cf-4a17-839c-8b61655f79f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ff72290fd14ddaba6ed757051e182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:57.392530 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d837a-46cf-4a17-839c-8b61655f79f9 service swift] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:57.393014 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d837a-46cf-4a17-839c-8b61655f79f9 service swift] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:57.393469 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d837a-46cf-4a17-839c-8b61655f79f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:57.403220 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d837a-46cf-4a17-839c-8b61655f79f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:57.405128 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d837a-46cf-4a17-839c-8b61655f79f9 service swift] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:57.420757 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1214/2423] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 10:48:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 10:48:58.014321 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabf424-598a-4753-a53c-422f849838c4 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:58.014785 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabf424-598a-4753-a53c-422f849838c4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:58.014882 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabf424-598a-4753-a53c-422f849838c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:58.038018 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-bbabf424-598a-4753-a53c-422f849838c4 None None] MFA Rules not processed for user `bdc800f1d4174b5cba4f6f496207ec95`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:58.039252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bbabf424-598a-4753-a53c-422f849838c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:58.047638 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1210/2424] 10.222.0.20 () {58 vars in 967 bytes} [Sun Sep 11 10:48:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:58.063040 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d837a-46cf-4a17-839c-8b61655f79f9 service swift] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:58.075685 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d837a-46cf-4a17-839c-8b61655f79f9 service swift] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:58.081816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09976815-f488-4896-9dae-f30cc93f5546 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ff72290fd14ddaba6ed757051e182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:58.082610 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09976815-f488-4896-9dae-f30cc93f5546 service swift] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:58.082914 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09976815-f488-4896-9dae-f30cc93f5546 service swift] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:58.083187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09976815-f488-4896-9dae-f30cc93f5546 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:58.092867 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09976815-f488-4896-9dae-f30cc93f5546 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:58.094825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09976815-f488-4896-9dae-f30cc93f5546 service swift] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:58.103812 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1215/2425] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 10:48:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 10:48:58.398882 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eef67-7b23-4369-885c-536e8b91c2b7 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:58.399231 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eef67-7b23-4369-885c-536e8b91c2b7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:58.399598 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eef67-7b23-4369-885c-536e8b91c2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:58.418842 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4c2eef67-7b23-4369-885c-536e8b91c2b7 None None] MFA Rules not processed for user `bdc800f1d4174b5cba4f6f496207ec95`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:58.420100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4c2eef67-7b23-4369-885c-536e8b91c2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:58.427514 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1211/2426] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 10:48:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:58.439970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09976815-f488-4896-9dae-f30cc93f5546 service swift] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:58.450944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09976815-f488-4896-9dae-f30cc93f5546 service swift] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:58.456108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc11e7-c2c6-4139-87b5-766b20e858d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ff72290fd14ddaba6ed757051e182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:58.456737 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc11e7-c2c6-4139-87b5-766b20e858d5 service swift] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:58.457021 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc11e7-c2c6-4139-87b5-766b20e858d5 service swift] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:58.457298 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc11e7-c2c6-4139-87b5-766b20e858d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:58.466457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc11e7-c2c6-4139-87b5-766b20e858d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:58.468136 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc11e7-c2c6-4139-87b5-766b20e858d5 service swift] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:58.476749 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1216/2427] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 10:48:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 10:48:58.853909 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e57233-5c9f-4ca3-a11f-dc748d265b9c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:58.854197 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e57233-5c9f-4ca3-a11f-dc748d265b9c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:58.854469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e57233-5c9f-4ca3-a11f-dc748d265b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:58.874684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-97e57233-5c9f-4ca3-a11f-dc748d265b9c None None] MFA Rules not processed for user `bdc800f1d4174b5cba4f6f496207ec95`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:48:58.875895 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-97e57233-5c9f-4ca3-a11f-dc748d265b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:48:58.883090 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1212/2428] 10.222.0.20 () {58 vars in 967 bytes} [Sun Sep 11 10:48:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:48:58.896331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc11e7-c2c6-4139-87b5-766b20e858d5 service swift] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:48:58.906645 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc11e7-c2c6-4139-87b5-766b20e858d5 service swift] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:48:58.911619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2d2d3-b5d8-49e9-8d8d-1ae4a5c87e81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ff72290fd14ddaba6ed757051e182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:48:58.912220 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2d2d3-b5d8-49e9-8d8d-1ae4a5c87e81 service swift] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:48:58.912501 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2d2d3-b5d8-49e9-8d8d-1ae4a5c87e81 service swift] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:48:58.912806 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2d2d3-b5d8-49e9-8d8d-1ae4a5c87e81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:48:58.921415 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2d2d3-b5d8-49e9-8d8d-1ae4a5c87e81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:48:58.923083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2d2d3-b5d8-49e9-8d8d-1ae4a5c87e81 service swift] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:48:58.931203 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1217/2429] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 10:48:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 10:49:01.067707 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e57233-5c9f-4ca3-a11f-dc748d265b9c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:49:01.069506 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-97e57233-5c9f-4ca3-a11f-dc748d265b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:49:01.139291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e57233-5c9f-4ca3-a11f-dc748d265b9c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:49:01.143787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60b7b4-b339-4b06-8d68-1309b848a050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:49:01.144420 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60b7b4-b339-4b06-8d68-1309b848a050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:49:01.144731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60b7b4-b339-4b06-8d68-1309b848a050 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:49:01.145012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60b7b4-b339-4b06-8d68-1309b848a050 admin admin] PATH_INFO: `/v3/users/b0507dd8413e46c8be5d766039047bbd` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:49:01.146147 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60b7b4-b339-4b06-8d68-1309b848a050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0507dd8413e46c8be5d766039047bbd)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:49:01.148085 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60b7b4-b339-4b06-8d68-1309b848a050 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:49:01.195855 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-af60b7b4-b339-4b06-8d68-1309b848a050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0507dd8413e46c8be5d766039047bbd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:49:01.203706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-af60b7b4-b339-4b06-8d68-1309b848a050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0507dd8413e46c8be5d766039047bbd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:49:01.204315 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-af60b7b4-b339-4b06-8d68-1309b848a050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0507dd8413e46c8be5d766039047bbd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:49:01.204927 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-af60b7b4-b339-4b06-8d68-1309b848a050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0507dd8413e46c8be5d766039047bbd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:49:01.211953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-af60b7b4-b339-4b06-8d68-1309b848a050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0507dd8413e46c8be5d766039047bbd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:49:01.231131 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1213/2430] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:49:01 2022] DELETE /identity/v3/users/b0507dd8413e46c8be5d766039047bbd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:49:01.235527 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838bbae-677a-41f2-95e5-08a2a1220e36 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:49:01.235995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838bbae-677a-41f2-95e5-08a2a1220e36 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:49:01.236234 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838bbae-677a-41f2-95e5-08a2a1220e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:49:01.255801 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e838bbae-677a-41f2-95e5-08a2a1220e36 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:49:01.257519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e838bbae-677a-41f2-95e5-08a2a1220e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:49:01.289935 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:01.321808 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1218/2431] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:49:01.336094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60b7b4-b339-4b06-8d68-1309b848a050 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:49:01.337534 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-af60b7b4-b339-4b06-8d68-1309b848a050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:49:01.344293 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:01.397777 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60b7b4-b339-4b06-8d68-1309b848a050 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:49:01.401377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b2317-f6db-4824-8553-17ba1ec1b8ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:49:01.402495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b2317-f6db-4824-8553-17ba1ec1b8ac service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:49:01.402769 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b2317-f6db-4824-8553-17ba1ec1b8ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:49:01.403034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b2317-f6db-4824-8553-17ba1ec1b8ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:49:01.411873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b2317-f6db-4824-8553-17ba1ec1b8ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:49:01.413326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b2317-f6db-4824-8553-17ba1ec1b8ac service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:49:01.423754 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1214/2432] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:49:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:49:01.635134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838bbae-677a-41f2-95e5-08a2a1220e36 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:49:01.642094 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e838bbae-677a-41f2-95e5-08a2a1220e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:49:01.657380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838bbae-677a-41f2-95e5-08a2a1220e36 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:49:01.670904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f87ee5-0215-406f-903b-620abc9c24eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:49:01.672145 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f87ee5-0215-406f-903b-620abc9c24eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:49:01.672434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f87ee5-0215-406f-903b-620abc9c24eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:49:01.675669 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f87ee5-0215-406f-903b-620abc9c24eb admin admin] PATH_INFO: `/v3/projects/a54faf1b3e4e465a8155dee4bd745723` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:49:01.677170 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f87ee5-0215-406f-903b-620abc9c24eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a54faf1b3e4e465a8155dee4bd745723)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:49:01.679077 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f87ee5-0215-406f-903b-620abc9c24eb admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:49:01.750028 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-85f87ee5-0215-406f-903b-620abc9c24eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a54faf1b3e4e465a8155dee4bd745723', 'request_id': 'req-85f87ee5-0215-406f-903b-620abc9c24eb'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:49:01.757087 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-85f87ee5-0215-406f-903b-620abc9c24eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a54faf1b3e4e465a8155dee4bd745723', 'request_id': 'req-85f87ee5-0215-406f-903b-620abc9c24eb'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:49:01.768005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-85f87ee5-0215-406f-903b-620abc9c24eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a54faf1b3e4e465a8155dee4bd745723', 'request_id': 'req-85f87ee5-0215-406f-903b-620abc9c24eb'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:49:01.784391 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-85f87ee5-0215-406f-903b-620abc9c24eb admin admin] The token cache is being invalidate because project a54faf1b3e4e465a8155dee4bd745723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:49:01.785115 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-85f87ee5-0215-406f-903b-620abc9c24eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:49:01.785492 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-85f87ee5-0215-406f-903b-620abc9c24eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:49:01.787345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1219/2433] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:49:01 2022] DELETE /identity/v3/projects/a54faf1b3e4e465a8155dee4bd745723 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:49:11.419108 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=24 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:11.781324 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=37,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:24.732344 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce847a91-2197-4f29-bee7-78dd0bf32aa3 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:49:24.732811 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce847a91-2197-4f29-bee7-78dd0bf32aa3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:49:24.732897 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce847a91-2197-4f29-bee7-78dd0bf32aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:49:24.752574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ce847a91-2197-4f29-bee7-78dd0bf32aa3 None None] MFA Rules not processed for user `bdc800f1d4174b5cba4f6f496207ec95`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:49:24.753761 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ce847a91-2197-4f29-bee7-78dd0bf32aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:49:24.808940 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1215/2434] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 10:49:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:49:24.830618 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f87ee5-0215-406f-903b-620abc9c24eb admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:49:24.832061 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-85f87ee5-0215-406f-903b-620abc9c24eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:49:24.902031 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f87ee5-0215-406f-903b-620abc9c24eb admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:49:24.909514 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c74b04-c102-4963-b6df-97def9b8e049 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ff72290fd14ddaba6ed757051e182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:49:24.910114 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c74b04-c102-4963-b6df-97def9b8e049 service swift] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:49:24.910392 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c74b04-c102-4963-b6df-97def9b8e049 service swift] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:49:24.910661 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c74b04-c102-4963-b6df-97def9b8e049 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:49:24.919043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c74b04-c102-4963-b6df-97def9b8e049 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:49:24.920672 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c74b04-c102-4963-b6df-97def9b8e049 service swift] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:49:24.929307 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1220/2435] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 10:49:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 10:49:34.801841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=25 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:34.925489 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=32 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:39.601474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce847a91-2197-4f29-bee7-78dd0bf32aa3 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:49:39.602958 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ce847a91-2197-4f29-bee7-78dd0bf32aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:49:39.681508 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce847a91-2197-4f29-bee7-78dd0bf32aa3 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:49:39.686487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28edf9-e4ea-49d7-a0cf-85d666fc6d4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0211a05cca4e72b30d64eef4ba527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:49:39.687166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28edf9-e4ea-49d7-a0cf-85d666fc6d4e service placement] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:49:39.687511 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28edf9-e4ea-49d7-a0cf-85d666fc6d4e service placement] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:49:39.687864 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28edf9-e4ea-49d7-a0cf-85d666fc6d4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:49:39.689685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7a28edf9-e4ea-49d7-a0cf-85d666fc6d4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:49:39.701496 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28edf9-e4ea-49d7-a0cf-85d666fc6d4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:49:39.703057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28edf9-e4ea-49d7-a0cf-85d666fc6d4e service placement] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:49:39.716487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1216/2436] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:49:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:49:41.796351 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a57e14-d088-415a-b2d8-5de3e19ea047 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:49:41.796932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a57e14-d088-415a-b2d8-5de3e19ea047 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:49:41.797028 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a57e14-d088-415a-b2d8-5de3e19ea047 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:49:41.798343 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1221/2437] 10.222.0.20 () {54 vars in 921 bytes} [Sun Sep 11 10:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:49:41.805191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bdb03-f78f-43d8-9ce2-803af3993dcf None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:49:41.805719 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bdb03-f78f-43d8-9ce2-803af3993dcf None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:49:41.805938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bdb03-f78f-43d8-9ce2-803af3993dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:49:41.849691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-fb2bdb03-f78f-43d8-9ce2-803af3993dcf None None] MFA Rules not processed for user `b642a1d00de940429fc1cc6131ac22b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:49:41.850918 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fb2bdb03-f78f-43d8-9ce2-803af3993dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:49:41.979037 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1217/2438] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Sep 11 10:49:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:49:41.991127 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a57e14-d088-415a-b2d8-5de3e19ea047 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:49:41.993159 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e4a57e14-d088-415a-b2d8-5de3e19ea047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:49:42.057331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a57e14-d088-415a-b2d8-5de3e19ea047 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:49:42.060936 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca387e-8e17-4715-b615-f96c81cb51f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28614526d50d4201b93b20df45465d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:49:42.061994 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca387e-8e17-4715-b615-f96c81cb51f4 service glance] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:49:42.062286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca387e-8e17-4715-b615-f96c81cb51f4 service glance] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:49:42.062561 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca387e-8e17-4715-b615-f96c81cb51f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:49:42.073539 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca387e-8e17-4715-b615-f96c81cb51f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:49:42.074970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca387e-8e17-4715-b615-f96c81cb51f4 service glance] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:49:42.085330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1222/2439] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:49:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:49:42.153071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895441b-da46-41d6-8bb0-762cb207a55f None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:49:42.153339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895441b-da46-41d6-8bb0-762cb207a55f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:49:42.153613 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895441b-da46-41d6-8bb0-762cb207a55f None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:49:42.154960 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1218/2440] 10.222.0.20 () {54 vars in 921 bytes} [Sun Sep 11 10:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:49:42.159597 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2595d88-5c1f-4daf-8176-107986f90396 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:49:42.159894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2595d88-5c1f-4daf-8176-107986f90396 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:49:42.160438 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2595d88-5c1f-4daf-8176-107986f90396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:49:42.182831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-a2595d88-5c1f-4daf-8176-107986f90396 None None] MFA Rules not processed for user `133c5864d9544973a30ff77866522f15`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:49:42.184025 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a2595d88-5c1f-4daf-8176-107986f90396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:49:42.241916 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1223/2441] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Sep 11 10:49:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:49:42.254623 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895441b-da46-41d6-8bb0-762cb207a55f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:49:42.256329 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7895441b-da46-41d6-8bb0-762cb207a55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:49:42.270548 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895441b-da46-41d6-8bb0-762cb207a55f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:49:42.274057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28da476-8be5-47cf-a85a-e97e8bdac2da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:49:42.274688 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28da476-8be5-47cf-a85a-e97e8bdac2da service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:49:42.274962 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28da476-8be5-47cf-a85a-e97e8bdac2da service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:49:42.275235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28da476-8be5-47cf-a85a-e97e8bdac2da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:49:42.282563 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28da476-8be5-47cf-a85a-e97e8bdac2da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:49:42.283910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28da476-8be5-47cf-a85a-e97e8bdac2da service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:49:42.292364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1219/2442] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:49:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:49:42.384606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d4f53-be3e-4b4c-95cb-205c4c39f9c0 None None] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:49:42.384931 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d4f53-be3e-4b4c-95cb-205c4c39f9c0 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:49:42.385177 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d4f53-be3e-4b4c-95cb-205c4c39f9c0 None None] PATH_INFO: `/` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:49:42.386660 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1224/2443] 10.222.0.20 () {54 vars in 921 bytes} [Sun Sep 11 10:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:49:42.394831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3ad41-28cc-4a47-b701-74c05b42efe7 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:49:42.395337 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3ad41-28cc-4a47-b701-74c05b42efe7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:49:42.395806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3ad41-28cc-4a47-b701-74c05b42efe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:49:42.421440 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4fa3ad41-28cc-4a47-b701-74c05b42efe7 None None] MFA Rules not processed for user `b642a1d00de940429fc1cc6131ac22b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:49:42.422677 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4fa3ad41-28cc-4a47-b701-74c05b42efe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:49:42.432862 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1220/2444] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Sep 11 10:49:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:49:42.443744 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d4f53-be3e-4b4c-95cb-205c4c39f9c0 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:49:42.445718 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-133d4f53-be3e-4b4c-95cb-205c4c39f9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:49:42.459661 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d4f53-be3e-4b4c-95cb-205c4c39f9c0 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:49:42.463643 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced35942-956b-4dc3-88bf-da130c855a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:49:42.464242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced35942-956b-4dc3-88bf-da130c855a9c service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:49:42.464636 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced35942-956b-4dc3-88bf-da130c855a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:49:42.465009 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced35942-956b-4dc3-88bf-da130c855a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:49:42.475237 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced35942-956b-4dc3-88bf-da130c855a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:49:42.476766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced35942-956b-4dc3-88bf-da130c855a9c service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:49:42.488075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1225/2445] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:49:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:49:45.057458 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1700eb-651c-47e3-b360-8786e875da5e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:49:45.058168 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1700eb-651c-47e3-b360-8786e875da5e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:49:45.058168 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1700eb-651c-47e3-b360-8786e875da5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:49:45.076894 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-bd1700eb-651c-47e3-b360-8786e875da5e None None] MFA Rules not processed for user `2465a3ec985c4bacb213ad86ad45ab8f`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:49:45.078107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bd1700eb-651c-47e3-b360-8786e875da5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:49:45.133428 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1221/2446] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:49:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:49:45.627734 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b95f2-8517-46f5-b0c8-ca2ebabe918a None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:49:45.628221 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b95f2-8517-46f5-b0c8-ca2ebabe918a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:49:45.628329 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b95f2-8517-46f5-b0c8-ca2ebabe918a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:49:45.648313 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-051b95f2-8517-46f5-b0c8-ca2ebabe918a None None] MFA Rules not processed for user `bdc800f1d4174b5cba4f6f496207ec95`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:49:45.649798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-051b95f2-8517-46f5-b0c8-ca2ebabe918a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:49:45.657271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1226/2447] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 10:49:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:49:45.669314 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1700eb-651c-47e3-b360-8786e875da5e None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:49:45.683317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1700eb-651c-47e3-b360-8786e875da5e None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:49:45.690190 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc61413-d453-479b-b3f0-421dbd96993c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ff72290fd14ddaba6ed757051e182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:49:45.690862 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc61413-d453-479b-b3f0-421dbd96993c service swift] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:49:45.691389 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc61413-d453-479b-b3f0-421dbd96993c service swift] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:49:45.691719 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc61413-d453-479b-b3f0-421dbd96993c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:49:45.699077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:45.705219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc61413-d453-479b-b3f0-421dbd96993c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:49:45.706969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc61413-d453-479b-b3f0-421dbd96993c service swift] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:49:45.727119 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1222/2448] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 10:49:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 10:49:55.643033 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=58 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:49:55.719721 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:50:02.288203 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59601740-85ea-4cf6-b668-9705c779acc2 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:50:02.288738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59601740-85ea-4cf6-b668-9705c779acc2 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:50:02.288836 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59601740-85ea-4cf6-b668-9705c779acc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:50:02.308248 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-59601740-85ea-4cf6-b668-9705c779acc2 None None] MFA Rules not processed for user `bdc800f1d4174b5cba4f6f496207ec95`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:50:02.309466 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-59601740-85ea-4cf6-b668-9705c779acc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:50:02.316602 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1227/2449] 10.222.0.20 () {58 vars in 967 bytes} [Sun Sep 11 10:50:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:50:02.329483 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc61413-d453-479b-b3f0-421dbd96993c service swift] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:50:02.340715 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc61413-d453-479b-b3f0-421dbd96993c service swift] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:50:02.345654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeee85e-0a2d-4ce9-be18-bf3542a39d68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ff72290fd14ddaba6ed757051e182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:50:02.346243 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeee85e-0a2d-4ce9-be18-bf3542a39d68 service swift] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:50:02.346527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeee85e-0a2d-4ce9-be18-bf3542a39d68 service swift] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:50:02.346802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeee85e-0a2d-4ce9-be18-bf3542a39d68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:50:02.355245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeee85e-0a2d-4ce9-be18-bf3542a39d68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:50:02.356822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeee85e-0a2d-4ce9-be18-bf3542a39d68 service swift] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:50:02.364615 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1223/2450] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 10:50:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 10:50:12.303480 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:50:12.361497 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=6 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:50:23.354945 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27336db-a99b-4b37-8781-57238278c462 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:50:23.355491 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27336db-a99b-4b37-8781-57238278c462 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:50:23.355491 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27336db-a99b-4b37-8781-57238278c462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:50:23.374506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-b27336db-a99b-4b37-8781-57238278c462 None None] MFA Rules not processed for user `d0d2655f3c6a42898c67f82a697ef7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:50:23.375715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b27336db-a99b-4b37-8781-57238278c462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:50:23.436336 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1228/2451] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:50:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:50:31.225654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d199fed-5c7d-4d9a-9709-3d21979c97c5 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:50:31.226106 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d199fed-5c7d-4d9a-9709-3d21979c97c5 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:50:31.226215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d199fed-5c7d-4d9a-9709-3d21979c97c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:50:31.244921 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-0d199fed-5c7d-4d9a-9709-3d21979c97c5 None None] MFA Rules not processed for user `bdc800f1d4174b5cba4f6f496207ec95`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:50:31.246109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0d199fed-5c7d-4d9a-9709-3d21979c97c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:50:31.253179 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1224/2452] 10.222.0.20 () {58 vars in 967 bytes} [Sun Sep 11 10:50:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:50:31.275514 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27336db-a99b-4b37-8781-57238278c462 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:50:31.287578 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27336db-a99b-4b37-8781-57238278c462 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:50:31.293099 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d10b9-50b9-467c-b3dc-c09901e9c9de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ff72290fd14ddaba6ed757051e182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:50:31.293699 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d10b9-50b9-467c-b3dc-c09901e9c9de service swift] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:50:31.293978 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d10b9-50b9-467c-b3dc-c09901e9c9de service swift] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:50:31.294260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d10b9-50b9-467c-b3dc-c09901e9c9de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:50:31.302479 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d10b9-50b9-467c-b3dc-c09901e9c9de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:50:31.304367 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d10b9-50b9-467c-b3dc-c09901e9c9de service swift] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:50:31.313059 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1229/2453] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 10:50:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 10:50:38.948796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d199fed-5c7d-4d9a-9709-3d21979c97c5 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:50:38.950365 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0d199fed-5c7d-4d9a-9709-3d21979c97c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:50:39.022208 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d199fed-5c7d-4d9a-9709-3d21979c97c5 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:50:39.027311 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74058050-e812-4cb0-acd2-2b319aa0c316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:50:39.027948 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74058050-e812-4cb0-acd2-2b319aa0c316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:50:39.028227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74058050-e812-4cb0-acd2-2b319aa0c316 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:50:39.028503 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74058050-e812-4cb0-acd2-2b319aa0c316 admin admin] PATH_INFO: `/v3/users/a69e7a31a0024c48ae272459e11278ad` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:50:39.029679 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74058050-e812-4cb0-acd2-2b319aa0c316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a69e7a31a0024c48ae272459e11278ad)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:50:39.031578 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74058050-e812-4cb0-acd2-2b319aa0c316 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:50:39.083497 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-74058050-e812-4cb0-acd2-2b319aa0c316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a69e7a31a0024c48ae272459e11278ad'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:50:39.098330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-74058050-e812-4cb0-acd2-2b319aa0c316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a69e7a31a0024c48ae272459e11278ad'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:50:39.098708 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-74058050-e812-4cb0-acd2-2b319aa0c316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a69e7a31a0024c48ae272459e11278ad'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:50:39.099465 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-74058050-e812-4cb0-acd2-2b319aa0c316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a69e7a31a0024c48ae272459e11278ad'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:50:39.108499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-74058050-e812-4cb0-acd2-2b319aa0c316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a69e7a31a0024c48ae272459e11278ad'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:50:39.129157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1225/2454] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:50:38 2022] DELETE /identity/v3/users/a69e7a31a0024c48ae272459e11278ad => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:50:39.318221 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d10b9-50b9-467c-b3dc-c09901e9c9de service swift] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:50:39.333854 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d10b9-50b9-467c-b3dc-c09901e9c9de service swift] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:50:39.390513 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec0ef7-3bfb-4ed9-872e-8e61be415427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:50:39.391141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec0ef7-3bfb-4ed9-872e-8e61be415427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:50:39.391420 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec0ef7-3bfb-4ed9-872e-8e61be415427 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:50:39.391696 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec0ef7-3bfb-4ed9-872e-8e61be415427 admin admin] PATH_INFO: `/v3/projects/f134c140f2c740af969f107e97316678` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:50:39.392880 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec0ef7-3bfb-4ed9-872e-8e61be415427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f134c140f2c740af969f107e97316678)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:50:39.394789 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec0ef7-3bfb-4ed9-872e-8e61be415427 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:50:39.441128 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6aec0ef7-3bfb-4ed9-872e-8e61be415427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f134c140f2c740af969f107e97316678', 'request_id': 'req-6aec0ef7-3bfb-4ed9-872e-8e61be415427'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:50:39.447430 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6aec0ef7-3bfb-4ed9-872e-8e61be415427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f134c140f2c740af969f107e97316678', 'request_id': 'req-6aec0ef7-3bfb-4ed9-872e-8e61be415427'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:50:39.454111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6aec0ef7-3bfb-4ed9-872e-8e61be415427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f134c140f2c740af969f107e97316678', 'request_id': 'req-6aec0ef7-3bfb-4ed9-872e-8e61be415427'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:50:39.465034 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6aec0ef7-3bfb-4ed9-872e-8e61be415427 admin admin] The token cache is being invalidate because project f134c140f2c740af969f107e97316678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:50:39.465324 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6aec0ef7-3bfb-4ed9-872e-8e61be415427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:50:39.465947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6aec0ef7-3bfb-4ed9-872e-8e61be415427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:50:39.467423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1230/2455] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:50:39 2022] DELETE /identity/v3/projects/f134c140f2c740af969f107e97316678 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:50:39.471431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74058050-e812-4cb0-acd2-2b319aa0c316 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:50:39.472924 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-74058050-e812-4cb0-acd2-2b319aa0c316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:50:39.486206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74058050-e812-4cb0-acd2-2b319aa0c316 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:50:39.542130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770dd21-9011-4f83-a8e9-3b7401da4807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:50:39.542759 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770dd21-9011-4f83-a8e9-3b7401da4807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:50:39.543031 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770dd21-9011-4f83-a8e9-3b7401da4807 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:50:39.543299 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770dd21-9011-4f83-a8e9-3b7401da4807 admin admin] PATH_INFO: `/v3/users/67d0ad36cf8947048b233799813a5435` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:50:39.544437 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770dd21-9011-4f83-a8e9-3b7401da4807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d0ad36cf8947048b233799813a5435)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:50:39.546376 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770dd21-9011-4f83-a8e9-3b7401da4807 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:50:39.559453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:50:39.592941 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5770dd21-9011-4f83-a8e9-3b7401da4807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d0ad36cf8947048b233799813a5435'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:50:39.600174 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5770dd21-9011-4f83-a8e9-3b7401da4807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d0ad36cf8947048b233799813a5435'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:50:39.600851 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5770dd21-9011-4f83-a8e9-3b7401da4807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d0ad36cf8947048b233799813a5435'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:50:39.601526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5770dd21-9011-4f83-a8e9-3b7401da4807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d0ad36cf8947048b233799813a5435'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:50:39.608531 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5770dd21-9011-4f83-a8e9-3b7401da4807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d0ad36cf8947048b233799813a5435'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:50:39.626273 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1226/2456] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:50:39 2022] DELETE /identity/v3/users/67d0ad36cf8947048b233799813a5435 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:50:39.799983 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec0ef7-3bfb-4ed9-872e-8e61be415427 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:50:39.801607 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6aec0ef7-3bfb-4ed9-872e-8e61be415427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:50:39.818393 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec0ef7-3bfb-4ed9-872e-8e61be415427 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:50:39.839334 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:50:39.878708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9401ef8-0057-41f7-8ab2-4853cda97092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:50:39.879339 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9401ef8-0057-41f7-8ab2-4853cda97092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:50:39.879620 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9401ef8-0057-41f7-8ab2-4853cda97092 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:50:39.879894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9401ef8-0057-41f7-8ab2-4853cda97092 admin admin] PATH_INFO: `/v3/projects/d4fff18590704769974f9c6c9dcc3c45` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:50:39.881036 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9401ef8-0057-41f7-8ab2-4853cda97092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4fff18590704769974f9c6c9dcc3c45)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:50:39.882924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9401ef8-0057-41f7-8ab2-4853cda97092 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:50:39.930299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f9401ef8-0057-41f7-8ab2-4853cda97092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4fff18590704769974f9c6c9dcc3c45', 'request_id': 'req-f9401ef8-0057-41f7-8ab2-4853cda97092'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:50:39.937177 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f9401ef8-0057-41f7-8ab2-4853cda97092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4fff18590704769974f9c6c9dcc3c45', 'request_id': 'req-f9401ef8-0057-41f7-8ab2-4853cda97092'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:50:39.944476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f9401ef8-0057-41f7-8ab2-4853cda97092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4fff18590704769974f9c6c9dcc3c45', 'request_id': 'req-f9401ef8-0057-41f7-8ab2-4853cda97092'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:50:39.955315 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f9401ef8-0057-41f7-8ab2-4853cda97092 admin admin] The token cache is being invalidate because project d4fff18590704769974f9c6c9dcc3c45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:50:39.955603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f9401ef8-0057-41f7-8ab2-4853cda97092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:50:39.956231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f9401ef8-0057-41f7-8ab2-4853cda97092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:50:39.957720 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1231/2457] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:50:39 2022] DELETE /identity/v3/projects/d4fff18590704769974f9c6c9dcc3c45 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:50:46.033952 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e68c8-9b83-4697-954a-8d4b8e1cd038 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:50:46.034448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e68c8-9b83-4697-954a-8d4b8e1cd038 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:50:46.034544 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e68c8-9b83-4697-954a-8d4b8e1cd038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:50:46.053645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-0c4e68c8-9b83-4697-954a-8d4b8e1cd038 None None] MFA Rules not processed for user `80be130a10624a81bd3e874a3745b571`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:50:46.054831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0c4e68c8-9b83-4697-954a-8d4b8e1cd038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:50:46.109763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1227/2458] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:50:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:50:49.952317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:50:55.527820 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2f41b-285e-47fa-b3c4-931ff492147c None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:50:55.528441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2f41b-285e-47fa-b3c4-931ff492147c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:50:55.528441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2f41b-285e-47fa-b3c4-931ff492147c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:50:55.548735 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-ecd2f41b-285e-47fa-b3c4-931ff492147c None None] MFA Rules not processed for user `2465a3ec985c4bacb213ad86ad45ab8f`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:50:55.550084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ecd2f41b-285e-47fa-b3c4-931ff492147c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:50:55.606742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1232/2459] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:50:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:50:56.102580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=46,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:05.599276 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=25 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:24.374192 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e68c8-9b83-4697-954a-8d4b8e1cd038 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:24.376364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0c4e68c8-9b83-4697-954a-8d4b8e1cd038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:24.450959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e68c8-9b83-4697-954a-8d4b8e1cd038 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:24.457372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f16bd-26e0-45d1-b6de-2f9911e9ad7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:24.457372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f16bd-26e0-45d1-b6de-2f9911e9ad7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:24.457372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f16bd-26e0-45d1-b6de-2f9911e9ad7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:24.458222 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f16bd-26e0-45d1-b6de-2f9911e9ad7b admin admin] PATH_INFO: `/v3/users/d0d2655f3c6a42898c67f82a697ef7a8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:24.459083 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f16bd-26e0-45d1-b6de-2f9911e9ad7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0d2655f3c6a42898c67f82a697ef7a8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:24.461237 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f16bd-26e0-45d1-b6de-2f9911e9ad7b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:24.509403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1a6f16bd-26e0-45d1-b6de-2f9911e9ad7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0d2655f3c6a42898c67f82a697ef7a8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:24.516269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1a6f16bd-26e0-45d1-b6de-2f9911e9ad7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0d2655f3c6a42898c67f82a697ef7a8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:24.516966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1a6f16bd-26e0-45d1-b6de-2f9911e9ad7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0d2655f3c6a42898c67f82a697ef7a8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:24.517588 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1a6f16bd-26e0-45d1-b6de-2f9911e9ad7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0d2655f3c6a42898c67f82a697ef7a8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:24.525406 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1a6f16bd-26e0-45d1-b6de-2f9911e9ad7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0d2655f3c6a42898c67f82a697ef7a8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:24.542186 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1228/2460] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:51:24 2022] DELETE /identity/v3/users/d0d2655f3c6a42898c67f82a697ef7a8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:24.724325 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2f41b-285e-47fa-b3c4-931ff492147c None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:24.736413 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2f41b-285e-47fa-b3c4-931ff492147c None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:24.793563 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c15667-7bd5-423e-90a9-af03ab8e1de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:24.794106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c15667-7bd5-423e-90a9-af03ab8e1de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:24.794384 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c15667-7bd5-423e-90a9-af03ab8e1de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:24.794655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c15667-7bd5-423e-90a9-af03ab8e1de9 admin admin] PATH_INFO: `/v3/projects/02525ff265d54629b682029fcc8e08cf` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:24.795751 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c15667-7bd5-423e-90a9-af03ab8e1de9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02525ff265d54629b682029fcc8e08cf)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:24.797706 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c15667-7bd5-423e-90a9-af03ab8e1de9 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:24.843798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-79c15667-7bd5-423e-90a9-af03ab8e1de9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02525ff265d54629b682029fcc8e08cf', 'request_id': 'req-79c15667-7bd5-423e-90a9-af03ab8e1de9'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:24.850220 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-79c15667-7bd5-423e-90a9-af03ab8e1de9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02525ff265d54629b682029fcc8e08cf', 'request_id': 'req-79c15667-7bd5-423e-90a9-af03ab8e1de9'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:24.859230 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-79c15667-7bd5-423e-90a9-af03ab8e1de9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02525ff265d54629b682029fcc8e08cf', 'request_id': 'req-79c15667-7bd5-423e-90a9-af03ab8e1de9'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:24.869819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-79c15667-7bd5-423e-90a9-af03ab8e1de9 admin admin] The token cache is being invalidate because project 02525ff265d54629b682029fcc8e08cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:51:24.870102 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-79c15667-7bd5-423e-90a9-af03ab8e1de9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:24.870714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-79c15667-7bd5-423e-90a9-af03ab8e1de9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:24.872176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1233/2461] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:51:24 2022] DELETE /identity/v3/projects/02525ff265d54629b682029fcc8e08cf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:24.877016 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86910363-0cf9-425b-bd5e-81236372fe37 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:24.877325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86910363-0cf9-425b-bd5e-81236372fe37 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:24.877630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86910363-0cf9-425b-bd5e-81236372fe37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:24.896961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-86910363-0cf9-425b-bd5e-81236372fe37 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:24.898156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-86910363-0cf9-425b-bd5e-81236372fe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:24.965026 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1229/2462] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:24.972735 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b33eec-aea6-48a2-b3d9-c906e56a4741 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:24.973026 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b33eec-aea6-48a2-b3d9-c906e56a4741 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:24.973306 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b33eec-aea6-48a2-b3d9-c906e56a4741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:24.993018 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-55b33eec-aea6-48a2-b3d9-c906e56a4741 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:24.994229 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-55b33eec-aea6-48a2-b3d9-c906e56a4741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:25.002121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1234/2463] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:25.006302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86910363-0cf9-425b-bd5e-81236372fe37 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:25.016366 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86910363-0cf9-425b-bd5e-81236372fe37 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:25.020914 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb103a2-41c8-4174-8674-8755450c3a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:25.021506 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb103a2-41c8-4174-8674-8755450c3a9b admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:25.021791 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb103a2-41c8-4174-8674-8755450c3a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:25.022066 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb103a2-41c8-4174-8674-8755450c3a9b admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:25.022710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb103a2-41c8-4174-8674-8755450c3a9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:51:25.023020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb103a2-41c8-4174-8674-8755450c3a9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:25.025288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb103a2-41c8-4174-8674-8755450c3a9b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:25.036674 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1230/2464] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:51:25.040889 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b33eec-aea6-48a2-b3d9-c906e56a4741 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:25.050380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b33eec-aea6-48a2-b3d9-c906e56a4741 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:25.054935 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867beae-697a-4e2e-8d72-23329de46024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:25.055526 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867beae-697a-4e2e-8d72-23329de46024 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:25.055808 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867beae-697a-4e2e-8d72-23329de46024 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:25.056083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867beae-697a-4e2e-8d72-23329de46024 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:25.056744 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867beae-697a-4e2e-8d72-23329de46024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:25.058624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867beae-697a-4e2e-8d72-23329de46024 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:25.085593 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1235/2465] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:51:25 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:51:25.089933 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb103a2-41c8-4174-8674-8755450c3a9b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:25.099825 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb103a2-41c8-4174-8674-8755450c3a9b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:25.103857 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:25.158300 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d8fe3-077d-4cd6-bb65-cdbb21dcdd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:25.158934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d8fe3-077d-4cd6-bb65-cdbb21dcdd4c admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:25.159217 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d8fe3-077d-4cd6-bb65-cdbb21dcdd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:25.159492 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d8fe3-077d-4cd6-bb65-cdbb21dcdd4c admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:25.160116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d8fe3-077d-4cd6-bb65-cdbb21dcdd4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:25.162101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d8fe3-077d-4cd6-bb65-cdbb21dcdd4c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:25.186495 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1231/2466] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:51:25 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:51:25.187622 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867beae-697a-4e2e-8d72-23329de46024 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:25.198797 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867beae-697a-4e2e-8d72-23329de46024 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:25.203724 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd6eff-9341-40da-a70d-6f6087985142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:25.204486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd6eff-9341-40da-a70d-6f6087985142 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:25.204628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd6eff-9341-40da-a70d-6f6087985142 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:25.204895 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd6eff-9341-40da-a70d-6f6087985142 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:25.205539 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd6eff-9341-40da-a70d-6f6087985142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:25.207113 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd6eff-9341-40da-a70d-6f6087985142 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:25.218644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1236/2467] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 10:51:25.222745 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d8fe3-077d-4cd6-bb65-cdbb21dcdd4c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:25.233380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d8fe3-077d-4cd6-bb65-cdbb21dcdd4c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:25.237748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397e582-685a-4da0-b575-4f14caed8236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:25.238347 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397e582-685a-4da0-b575-4f14caed8236 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:25.238623 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397e582-685a-4da0-b575-4f14caed8236 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:25.238896 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397e582-685a-4da0-b575-4f14caed8236 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:25.239765 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397e582-685a-4da0-b575-4f14caed8236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:25.241438 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397e582-685a-4da0-b575-4f14caed8236 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:25.253969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1232/2468] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 10:51:25.258806 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd6eff-9341-40da-a70d-6f6087985142 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:25.269076 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd6eff-9341-40da-a70d-6f6087985142 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:25.274546 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48779d2-33b6-4ebc-9b9d-35af0d802a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:25.275378 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48779d2-33b6-4ebc-9b9d-35af0d802a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:25.275858 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48779d2-33b6-4ebc-9b9d-35af0d802a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:25.276397 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48779d2-33b6-4ebc-9b9d-35af0d802a1b admin admin] PATH_INFO: `/v3/projects/75c296866377410cbfd9366053c5e22f/users/0106e20523d94ce1820b9fa5f87d5ac9/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:25.291532 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48779d2-33b6-4ebc-9b9d-35af0d802a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c296866377410cbfd9366053c5e22f, user_id=0106e20523d94ce1820b9fa5f87d5ac9, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:25.294264 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48779d2-33b6-4ebc-9b9d-35af0d802a1b admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:25.308175 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1237/2469] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:51:25 2022] PUT /identity/v3/projects/75c296866377410cbfd9366053c5e22f/users/0106e20523d94ce1820b9fa5f87d5ac9/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:51:25.318178 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8686c1-3716-41c2-b4dc-426cd691ef46 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:25.318669 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8686c1-3716-41c2-b4dc-426cd691ef46 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:25.318990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8686c1-3716-41c2-b4dc-426cd691ef46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:25.350000 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-6f8686c1-3716-41c2-b4dc-426cd691ef46 None None] MFA Rules not processed for user `0106e20523d94ce1820b9fa5f87d5ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:25.351397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6f8686c1-3716-41c2-b4dc-426cd691ef46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:25.419273 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1233/2470] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:51:25.423879 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48779d2-33b6-4ebc-9b9d-35af0d802a1b admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:25.453446 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:25.487562 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48779d2-33b6-4ebc-9b9d-35af0d802a1b admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:25.493042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880f580-97df-41ac-a9df-5a7410790cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:25.493685 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880f580-97df-41ac-a9df-5a7410790cef admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:25.494009 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880f580-97df-41ac-a9df-5a7410790cef admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:25.494313 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880f580-97df-41ac-a9df-5a7410790cef admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:25.494958 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880f580-97df-41ac-a9df-5a7410790cef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:25.496913 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880f580-97df-41ac-a9df-5a7410790cef admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:25.524158 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1238/2471] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:51:25 2022] POST /identity/v3/projects => generated 361 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:51:25.528186 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8686c1-3716-41c2-b4dc-426cd691ef46 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:25.539118 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8686c1-3716-41c2-b4dc-426cd691ef46 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:25.601136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d9214-3c7f-4b1f-b41c-7cba3e343669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:25.602337 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d9214-3c7f-4b1f-b41c-7cba3e343669 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:25.602652 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d9214-3c7f-4b1f-b41c-7cba3e343669 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:25.602892 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d9214-3c7f-4b1f-b41c-7cba3e343669 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:25.603517 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d9214-3c7f-4b1f-b41c-7cba3e343669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:25.605467 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d9214-3c7f-4b1f-b41c-7cba3e343669 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:25.627987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1234/2472] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:51:25 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:51:25.632153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880f580-97df-41ac-a9df-5a7410790cef admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:25.643694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880f580-97df-41ac-a9df-5a7410790cef admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:25.648272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb003d6-f9f9-481e-aa99-fb7a9dabb33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:25.648898 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb003d6-f9f9-481e-aa99-fb7a9dabb33e admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:25.649176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb003d6-f9f9-481e-aa99-fb7a9dabb33e admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:25.649454 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb003d6-f9f9-481e-aa99-fb7a9dabb33e admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:25.650090 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb003d6-f9f9-481e-aa99-fb7a9dabb33e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:25.652038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb003d6-f9f9-481e-aa99-fb7a9dabb33e admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:25.662882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1239/2473] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:51:25.667629 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d9214-3c7f-4b1f-b41c-7cba3e343669 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:25.673960 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:25.677822 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d9214-3c7f-4b1f-b41c-7cba3e343669 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:25.685603 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216a2bc-54ef-46bd-bd45-37d97a3a6aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:25.686492 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216a2bc-54ef-46bd-bd45-37d97a3a6aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:25.686985 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216a2bc-54ef-46bd-bd45-37d97a3a6aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:25.687464 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216a2bc-54ef-46bd-bd45-37d97a3a6aeb admin admin] PATH_INFO: `/v3/projects/3d155ebe8c6c48b0b12f2e07c7ab003b/users/a890c734923d4d239395386715e25729/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:25.702324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216a2bc-54ef-46bd-bd45-37d97a3a6aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d155ebe8c6c48b0b12f2e07c7ab003b, user_id=a890c734923d4d239395386715e25729, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:25.705073 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216a2bc-54ef-46bd-bd45-37d97a3a6aeb admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:25.718260 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1235/2474] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:51:25 2022] PUT /identity/v3/projects/3d155ebe8c6c48b0b12f2e07c7ab003b/users/a890c734923d4d239395386715e25729/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:25.722231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb003d6-f9f9-481e-aa99-fb7a9dabb33e admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:25.733167 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb003d6-f9f9-481e-aa99-fb7a9dabb33e admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:25.790405 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977dd90-8e9c-4a0f-8e5b-9c356d6499da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:25.791000 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977dd90-8e9c-4a0f-8e5b-9c356d6499da admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:25.791282 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977dd90-8e9c-4a0f-8e5b-9c356d6499da admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:25.791552 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977dd90-8e9c-4a0f-8e5b-9c356d6499da admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:25.792182 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977dd90-8e9c-4a0f-8e5b-9c356d6499da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:25.793826 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977dd90-8e9c-4a0f-8e5b-9c356d6499da admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:25.803252 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1240/2475] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:51:25.807526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216a2bc-54ef-46bd-bd45-37d97a3a6aeb admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:25.817751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216a2bc-54ef-46bd-bd45-37d97a3a6aeb admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:25.822906 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff822e-c0dd-4dba-ac2f-9d3d24ad7e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:25.823554 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff822e-c0dd-4dba-ac2f-9d3d24ad7e35 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:25.823833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff822e-c0dd-4dba-ac2f-9d3d24ad7e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:25.824106 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff822e-c0dd-4dba-ac2f-9d3d24ad7e35 admin admin] PATH_INFO: `/v3/projects/3d155ebe8c6c48b0b12f2e07c7ab003b/users/a890c734923d4d239395386715e25729/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:25.826040 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff822e-c0dd-4dba-ac2f-9d3d24ad7e35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d155ebe8c6c48b0b12f2e07c7ab003b, user_id=a890c734923d4d239395386715e25729, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:25.828690 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff822e-c0dd-4dba-ac2f-9d3d24ad7e35 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:25.839838 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1236/2476] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:51:25 2022] PUT /identity/v3/projects/3d155ebe8c6c48b0b12f2e07c7ab003b/users/a890c734923d4d239395386715e25729/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:25.851492 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124a1cf-ed1d-42d3-ac2d-7863d2814c97 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:25.851720 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124a1cf-ed1d-42d3-ac2d-7863d2814c97 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:25.852003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124a1cf-ed1d-42d3-ac2d-7863d2814c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:25.879766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-7124a1cf-ed1d-42d3-ac2d-7863d2814c97 None None] MFA Rules not processed for user `a890c734923d4d239395386715e25729`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:25.881001 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7124a1cf-ed1d-42d3-ac2d-7863d2814c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:25.946165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1241/2477] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:25.957362 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff822e-c0dd-4dba-ac2f-9d3d24ad7e35 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:25.959047 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-81ff822e-c0dd-4dba-ac2f-9d3d24ad7e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:26.014890 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff822e-c0dd-4dba-ac2f-9d3d24ad7e35 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:26.018448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f8392-5860-4438-8fa0-585b29809b23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:26.019034 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8392-5860-4438-8fa0-585b29809b23 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:26.019309 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8392-5860-4438-8fa0-585b29809b23 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:26.019580 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8392-5860-4438-8fa0-585b29809b23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:26.028942 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f8392-5860-4438-8fa0-585b29809b23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:26.030340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f8392-5860-4438-8fa0-585b29809b23 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:26.039516 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1237/2478] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:51:25 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:51:26.113660 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124a1cf-ed1d-42d3-ac2d-7863d2814c97 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:26.123706 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124a1cf-ed1d-42d3-ac2d-7863d2814c97 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:26.127231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca96b8-efe0-4d91-9b04-2e93d6fec53f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:26.127812 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca96b8-efe0-4d91-9b04-2e93d6fec53f service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:26.128086 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca96b8-efe0-4d91-9b04-2e93d6fec53f service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:26.128355 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca96b8-efe0-4d91-9b04-2e93d6fec53f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:26.147558 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:26.186356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca96b8-efe0-4d91-9b04-2e93d6fec53f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:26.187791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca96b8-efe0-4d91-9b04-2e93d6fec53f service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:26.196600 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1242/2479] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:51:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:51:32.146438 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f8392-5860-4438-8fa0-585b29809b23 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:32.206670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f8392-5860-4438-8fa0-585b29809b23 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:32.211144 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642baba7-f200-46de-8ceb-4a701dcdc7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:32.211762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642baba7-f200-46de-8ceb-4a701dcdc7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:32.212305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642baba7-f200-46de-8ceb-4a701dcdc7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:32.212608 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642baba7-f200-46de-8ceb-4a701dcdc7e1 admin admin] PATH_INFO: `/v3/users/0106e20523d94ce1820b9fa5f87d5ac9` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:32.213723 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642baba7-f200-46de-8ceb-4a701dcdc7e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0106e20523d94ce1820b9fa5f87d5ac9)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:32.215621 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642baba7-f200-46de-8ceb-4a701dcdc7e1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:32.263556 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-642baba7-f200-46de-8ceb-4a701dcdc7e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0106e20523d94ce1820b9fa5f87d5ac9'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:32.271023 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-642baba7-f200-46de-8ceb-4a701dcdc7e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0106e20523d94ce1820b9fa5f87d5ac9'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:32.271655 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-642baba7-f200-46de-8ceb-4a701dcdc7e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0106e20523d94ce1820b9fa5f87d5ac9'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:32.272255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-642baba7-f200-46de-8ceb-4a701dcdc7e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0106e20523d94ce1820b9fa5f87d5ac9'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:32.279515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-642baba7-f200-46de-8ceb-4a701dcdc7e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0106e20523d94ce1820b9fa5f87d5ac9'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:32.286234 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:32.298374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1238/2480] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:51:32 2022] DELETE /identity/v3/users/0106e20523d94ce1820b9fa5f87d5ac9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:32.303112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2800e-fa14-4864-9457-84a5fe74c452 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:32.303611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2800e-fa14-4864-9457-84a5fe74c452 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:32.303708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2800e-fa14-4864-9457-84a5fe74c452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:32.324811 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-f0b2800e-fa14-4864-9457-84a5fe74c452 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:32.326031 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f0b2800e-fa14-4864-9457-84a5fe74c452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:32.388419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1243/2481] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:32.398829 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642baba7-f200-46de-8ceb-4a701dcdc7e1 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:32.400237 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-642baba7-f200-46de-8ceb-4a701dcdc7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:32.456568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642baba7-f200-46de-8ceb-4a701dcdc7e1 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:32.460206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044512a-e713-4971-8b73-c840e9a19dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:32.461388 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044512a-e713-4971-8b73-c840e9a19dda service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:32.461667 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044512a-e713-4971-8b73-c840e9a19dda service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:32.462200 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044512a-e713-4971-8b73-c840e9a19dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:32.471054 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044512a-e713-4971-8b73-c840e9a19dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:32.472504 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044512a-e713-4971-8b73-c840e9a19dda service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:32.481768 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1239/2482] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:51:32.749337 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2800e-fa14-4864-9457-84a5fe74c452 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:32.750809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f0b2800e-fa14-4864-9457-84a5fe74c452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:32.765325 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2800e-fa14-4864-9457-84a5fe74c452 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:32.769935 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99593be-4d69-4ac5-8513-0406a22cd4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:32.770563 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99593be-4d69-4ac5-8513-0406a22cd4cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:32.770942 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99593be-4d69-4ac5-8513-0406a22cd4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:32.771092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99593be-4d69-4ac5-8513-0406a22cd4cf admin admin] PATH_INFO: `/v3/projects/75c296866377410cbfd9366053c5e22f` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:32.772201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99593be-4d69-4ac5-8513-0406a22cd4cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=75c296866377410cbfd9366053c5e22f)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:32.774708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99593be-4d69-4ac5-8513-0406a22cd4cf admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:32.821015 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f99593be-4d69-4ac5-8513-0406a22cd4cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75c296866377410cbfd9366053c5e22f', 'request_id': 'req-f99593be-4d69-4ac5-8513-0406a22cd4cf'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:32.827260 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f99593be-4d69-4ac5-8513-0406a22cd4cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75c296866377410cbfd9366053c5e22f', 'request_id': 'req-f99593be-4d69-4ac5-8513-0406a22cd4cf'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:32.834477 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f99593be-4d69-4ac5-8513-0406a22cd4cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75c296866377410cbfd9366053c5e22f', 'request_id': 'req-f99593be-4d69-4ac5-8513-0406a22cd4cf'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:32.845714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f99593be-4d69-4ac5-8513-0406a22cd4cf admin admin] The token cache is being invalidate because project 75c296866377410cbfd9366053c5e22f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:51:32.846001 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f99593be-4d69-4ac5-8513-0406a22cd4cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:32.846614 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-f99593be-4d69-4ac5-8513-0406a22cd4cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:32.848101 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1244/2483] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:51:32 2022] DELETE /identity/v3/projects/75c296866377410cbfd9366053c5e22f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:32.852158 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044512a-e713-4971-8b73-c840e9a19dda service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:32.861648 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044512a-e713-4971-8b73-c840e9a19dda service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:32.916761 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454a37d-381f-4820-bb85-6512ba49b1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:32.917379 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454a37d-381f-4820-bb85-6512ba49b1df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:32.917654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454a37d-381f-4820-bb85-6512ba49b1df admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:32.917920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454a37d-381f-4820-bb85-6512ba49b1df admin admin] PATH_INFO: `/v3/users/a890c734923d4d239395386715e25729` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:32.919018 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454a37d-381f-4820-bb85-6512ba49b1df admin admin] RBAC: Authorizing `identity:delete_user(user_id=a890c734923d4d239395386715e25729)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:32.920955 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454a37d-381f-4820-bb85-6512ba49b1df admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:32.967656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5454a37d-381f-4820-bb85-6512ba49b1df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a890c734923d4d239395386715e25729'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:32.974770 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5454a37d-381f-4820-bb85-6512ba49b1df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a890c734923d4d239395386715e25729'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:32.975555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5454a37d-381f-4820-bb85-6512ba49b1df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a890c734923d4d239395386715e25729'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:32.976148 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5454a37d-381f-4820-bb85-6512ba49b1df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a890c734923d4d239395386715e25729'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:32.983028 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5454a37d-381f-4820-bb85-6512ba49b1df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a890c734923d4d239395386715e25729'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:33.000453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1240/2484] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:51:32 2022] DELETE /identity/v3/users/a890c734923d4d239395386715e25729 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:33.260383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99593be-4d69-4ac5-8513-0406a22cd4cf admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:33.261893 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f99593be-4d69-4ac5-8513-0406a22cd4cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:33.274596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99593be-4d69-4ac5-8513-0406a22cd4cf admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:33.318144 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:33.335539 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83bfce-5716-4c7d-890f-6a75d6ff2782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:33.336172 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83bfce-5716-4c7d-890f-6a75d6ff2782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:33.336448 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83bfce-5716-4c7d-890f-6a75d6ff2782 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:33.336750 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83bfce-5716-4c7d-890f-6a75d6ff2782 admin admin] PATH_INFO: `/v3/projects/3d155ebe8c6c48b0b12f2e07c7ab003b` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:33.338185 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83bfce-5716-4c7d-890f-6a75d6ff2782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d155ebe8c6c48b0b12f2e07c7ab003b)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:33.340075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83bfce-5716-4c7d-890f-6a75d6ff2782 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:33.388641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3f83bfce-5716-4c7d-890f-6a75d6ff2782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d155ebe8c6c48b0b12f2e07c7ab003b', 'request_id': 'req-3f83bfce-5716-4c7d-890f-6a75d6ff2782'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:33.395119 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3f83bfce-5716-4c7d-890f-6a75d6ff2782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d155ebe8c6c48b0b12f2e07c7ab003b', 'request_id': 'req-3f83bfce-5716-4c7d-890f-6a75d6ff2782'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:33.402545 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3f83bfce-5716-4c7d-890f-6a75d6ff2782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d155ebe8c6c48b0b12f2e07c7ab003b', 'request_id': 'req-3f83bfce-5716-4c7d-890f-6a75d6ff2782'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:33.412886 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3f83bfce-5716-4c7d-890f-6a75d6ff2782 admin admin] The token cache is being invalidate because project 3d155ebe8c6c48b0b12f2e07c7ab003b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:51:33.413169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3f83bfce-5716-4c7d-890f-6a75d6ff2782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:33.413781 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3f83bfce-5716-4c7d-890f-6a75d6ff2782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:33.415252 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1245/2485] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:51:33 2022] DELETE /identity/v3/projects/3d155ebe8c6c48b0b12f2e07c7ab003b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:33.420080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9772c8-138d-48ef-affc-3083ad3703df None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:33.420587 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9772c8-138d-48ef-affc-3083ad3703df None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:33.420700 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9772c8-138d-48ef-affc-3083ad3703df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:33.439993 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-df9772c8-138d-48ef-affc-3083ad3703df None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:33.441239 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-df9772c8-138d-48ef-affc-3083ad3703df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:33.446964 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:33.501322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1241/2486] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:33.508965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4c002-694d-458d-b4c6-5d2c7964d8c6 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:33.509252 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4c002-694d-458d-b4c6-5d2c7964d8c6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:33.509531 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4c002-694d-458d-b4c6-5d2c7964d8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:33.528787 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-7aa4c002-694d-458d-b4c6-5d2c7964d8c6 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:33.529983 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7aa4c002-694d-458d-b4c6-5d2c7964d8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:33.537744 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1246/2487] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:33.542267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9772c8-138d-48ef-affc-3083ad3703df None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:33.551681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9772c8-138d-48ef-affc-3083ad3703df None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:33.556804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c33a8-b836-4130-b9b0-3ba089c68e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:33.557391 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c33a8-b836-4130-b9b0-3ba089c68e97 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:33.557670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c33a8-b836-4130-b9b0-3ba089c68e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:33.557941 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c33a8-b836-4130-b9b0-3ba089c68e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:33.558585 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c33a8-b836-4130-b9b0-3ba089c68e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:51:33.558884 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c33a8-b836-4130-b9b0-3ba089c68e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:33.560465 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c33a8-b836-4130-b9b0-3ba089c68e97 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:33.571669 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1242/2488] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:51:33.575820 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4c002-694d-458d-b4c6-5d2c7964d8c6 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:33.585191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4c002-694d-458d-b4c6-5d2c7964d8c6 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:33.590544 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7bab1-0038-46db-acb2-76a2cdfa82da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:33.591125 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7bab1-0038-46db-acb2-76a2cdfa82da admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:33.591402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7bab1-0038-46db-acb2-76a2cdfa82da admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:33.591673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7bab1-0038-46db-acb2-76a2cdfa82da admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:33.592294 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7bab1-0038-46db-acb2-76a2cdfa82da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:33.594208 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7bab1-0038-46db-acb2-76a2cdfa82da admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:33.621604 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1247/2489] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:51:33 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:51:33.625630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c33a8-b836-4130-b9b0-3ba089c68e97 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:33.635634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c33a8-b836-4130-b9b0-3ba089c68e97 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:33.692819 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f387c4-b4cd-4a2e-bd83-aed61b7aa016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:33.693409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f387c4-b4cd-4a2e-bd83-aed61b7aa016 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:33.693686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f387c4-b4cd-4a2e-bd83-aed61b7aa016 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:33.693957 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f387c4-b4cd-4a2e-bd83-aed61b7aa016 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:33.694595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f387c4-b4cd-4a2e-bd83-aed61b7aa016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:33.696581 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f387c4-b4cd-4a2e-bd83-aed61b7aa016 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:33.719350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1243/2490] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:51:33 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:51:33.723507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7bab1-0038-46db-acb2-76a2cdfa82da admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:33.734590 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7bab1-0038-46db-acb2-76a2cdfa82da admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:33.739317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5d892-0695-4952-a170-8214611a948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:33.739911 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5d892-0695-4952-a170-8214611a948b admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:33.740191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5d892-0695-4952-a170-8214611a948b admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:33.740465 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5d892-0695-4952-a170-8214611a948b admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:33.741140 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5d892-0695-4952-a170-8214611a948b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:33.742742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5d892-0695-4952-a170-8214611a948b admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:33.752638 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1248/2491] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:51:33.756574 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f387c4-b4cd-4a2e-bd83-aed61b7aa016 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:33.766478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f387c4-b4cd-4a2e-bd83-aed61b7aa016 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:33.771001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a6e65-720b-4bc8-95d7-59840185e14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:33.771590 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a6e65-720b-4bc8-95d7-59840185e14d admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:33.771869 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a6e65-720b-4bc8-95d7-59840185e14d admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:33.772141 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a6e65-720b-4bc8-95d7-59840185e14d admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:33.773307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a6e65-720b-4bc8-95d7-59840185e14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:33.774878 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a6e65-720b-4bc8-95d7-59840185e14d admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:33.785349 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1244/2492] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:51:33.789974 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5d892-0695-4952-a170-8214611a948b admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:33.799740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5d892-0695-4952-a170-8214611a948b admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:33.804247 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbcfdc-50ad-4eec-a0e8-609bac1fde71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:33.804915 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbcfdc-50ad-4eec-a0e8-609bac1fde71 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:33.805193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbcfdc-50ad-4eec-a0e8-609bac1fde71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:33.805462 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbcfdc-50ad-4eec-a0e8-609bac1fde71 admin admin] PATH_INFO: `/v3/projects/5500528aeb594cd9978d54a6ef02c67a/users/db8c75f158cd48b087684044dc1ea3bf/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:33.819690 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbcfdc-50ad-4eec-a0e8-609bac1fde71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5500528aeb594cd9978d54a6ef02c67a, user_id=db8c75f158cd48b087684044dc1ea3bf, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:33.822341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbcfdc-50ad-4eec-a0e8-609bac1fde71 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:33.834581 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1249/2493] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:51:33 2022] PUT /identity/v3/projects/5500528aeb594cd9978d54a6ef02c67a/users/db8c75f158cd48b087684044dc1ea3bf/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:33.846622 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467e982-6cff-46b3-bdaa-4ecf56d372ca None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:33.846907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467e982-6cff-46b3-bdaa-4ecf56d372ca None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:33.847179 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467e982-6cff-46b3-bdaa-4ecf56d372ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:33.874769 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7467e982-6cff-46b3-bdaa-4ecf56d372ca None None] MFA Rules not processed for user `db8c75f158cd48b087684044dc1ea3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:33.875977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7467e982-6cff-46b3-bdaa-4ecf56d372ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:33.938497 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1245/2494] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:33.942821 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbcfdc-50ad-4eec-a0e8-609bac1fde71 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:34.004055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbcfdc-50ad-4eec-a0e8-609bac1fde71 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:34.009172 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1eb2a0-9b8c-4108-87d4-4da661a42b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:34.009765 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eb2a0-9b8c-4108-87d4-4da661a42b08 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:34.010047 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eb2a0-9b8c-4108-87d4-4da661a42b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:34.010325 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eb2a0-9b8c-4108-87d4-4da661a42b08 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:34.010953 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1eb2a0-9b8c-4108-87d4-4da661a42b08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:34.012866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1eb2a0-9b8c-4108-87d4-4da661a42b08 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:34.027931 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:34.042716 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1250/2495] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:51:33 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:51:34.046921 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467e982-6cff-46b3-bdaa-4ecf56d372ca None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:34.058024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467e982-6cff-46b3-bdaa-4ecf56d372ca None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:34.061798 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:34.114184 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cc845-a83b-496e-9e7e-1a32b670ee20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:34.115186 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cc845-a83b-496e-9e7e-1a32b670ee20 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:34.115186 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cc845-a83b-496e-9e7e-1a32b670ee20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:34.115370 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cc845-a83b-496e-9e7e-1a32b670ee20 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:34.115987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57cc845-a83b-496e-9e7e-1a32b670ee20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:34.118545 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57cc845-a83b-496e-9e7e-1a32b670ee20 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:34.139242 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1246/2496] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:51:34 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:51:34.143220 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1eb2a0-9b8c-4108-87d4-4da661a42b08 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:34.153513 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1eb2a0-9b8c-4108-87d4-4da661a42b08 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:34.158083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e565c-fcf7-48b2-a9d8-bd9f726db2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:34.158677 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e565c-fcf7-48b2-a9d8-bd9f726db2ab admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:34.158951 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e565c-fcf7-48b2-a9d8-bd9f726db2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:34.159220 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e565c-fcf7-48b2-a9d8-bd9f726db2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:34.159853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e565c-fcf7-48b2-a9d8-bd9f726db2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:34.161457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e565c-fcf7-48b2-a9d8-bd9f726db2ab admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:34.172412 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1251/2497] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:51:34.176322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cc845-a83b-496e-9e7e-1a32b670ee20 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:34.186192 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cc845-a83b-496e-9e7e-1a32b670ee20 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:34.190810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572b5e5-c732-4003-b59f-eed052676aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:34.191386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572b5e5-c732-4003-b59f-eed052676aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:34.191662 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572b5e5-c732-4003-b59f-eed052676aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:34.191931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572b5e5-c732-4003-b59f-eed052676aa3 admin admin] PATH_INFO: `/v3/projects/8421574c1ee7415b9f8648291dffc96d/users/3b3cfba81c254be983f8e6b2564b3c19/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:34.206581 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572b5e5-c732-4003-b59f-eed052676aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8421574c1ee7415b9f8648291dffc96d, user_id=3b3cfba81c254be983f8e6b2564b3c19, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:34.209296 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572b5e5-c732-4003-b59f-eed052676aa3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:34.222509 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1247/2498] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:51:34 2022] PUT /identity/v3/projects/8421574c1ee7415b9f8648291dffc96d/users/3b3cfba81c254be983f8e6b2564b3c19/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:51:34.226428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e565c-fcf7-48b2-a9d8-bd9f726db2ab admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:34.236296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e565c-fcf7-48b2-a9d8-bd9f726db2ab admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:34.291880 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d320016-3ab0-4d73-aaab-a9b6b0e266b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:34.292482 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d320016-3ab0-4d73-aaab-a9b6b0e266b5 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:34.292789 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d320016-3ab0-4d73-aaab-a9b6b0e266b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:34.293069 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d320016-3ab0-4d73-aaab-a9b6b0e266b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:34.293732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d320016-3ab0-4d73-aaab-a9b6b0e266b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:34.295313 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d320016-3ab0-4d73-aaab-a9b6b0e266b5 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:34.304949 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1252/2499] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:51:34.309031 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572b5e5-c732-4003-b59f-eed052676aa3 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:34.319601 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572b5e5-c732-4003-b59f-eed052676aa3 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:34.324645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a864d-0dd4-47ba-a8ad-fa97c5b80b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:34.325294 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a864d-0dd4-47ba-a8ad-fa97c5b80b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:34.325567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a864d-0dd4-47ba-a8ad-fa97c5b80b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:34.325835 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a864d-0dd4-47ba-a8ad-fa97c5b80b72 admin admin] PATH_INFO: `/v3/projects/8421574c1ee7415b9f8648291dffc96d/users/3b3cfba81c254be983f8e6b2564b3c19/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:34.327718 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a864d-0dd4-47ba-a8ad-fa97c5b80b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8421574c1ee7415b9f8648291dffc96d, user_id=3b3cfba81c254be983f8e6b2564b3c19, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:34.330646 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a864d-0dd4-47ba-a8ad-fa97c5b80b72 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:34.341397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1248/2500] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:51:34 2022] PUT /identity/v3/projects/8421574c1ee7415b9f8648291dffc96d/users/3b3cfba81c254be983f8e6b2564b3c19/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:34.352737 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9d33e-c18d-4729-a70e-6a4738c67b42 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:34.353184 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9d33e-c18d-4729-a70e-6a4738c67b42 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:34.353289 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9d33e-c18d-4729-a70e-6a4738c67b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:34.387908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-23c9d33e-c18d-4729-a70e-6a4738c67b42 None None] MFA Rules not processed for user `3b3cfba81c254be983f8e6b2564b3c19`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:34.389151 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-23c9d33e-c18d-4729-a70e-6a4738c67b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:34.456160 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1253/2501] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:34.467774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a864d-0dd4-47ba-a8ad-fa97c5b80b72 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:34.469614 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-706a864d-0dd4-47ba-a8ad-fa97c5b80b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:34.525419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a864d-0dd4-47ba-a8ad-fa97c5b80b72 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:34.528980 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811eb97-e5c3-4a7e-94ab-c8d56fc26c12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:34.529568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811eb97-e5c3-4a7e-94ab-c8d56fc26c12 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:34.529842 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811eb97-e5c3-4a7e-94ab-c8d56fc26c12 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:34.530133 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811eb97-e5c3-4a7e-94ab-c8d56fc26c12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:34.539309 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811eb97-e5c3-4a7e-94ab-c8d56fc26c12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:34.540724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811eb97-e5c3-4a7e-94ab-c8d56fc26c12 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:34.549990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1249/2502] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:51:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:51:34.615362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9d33e-c18d-4729-a70e-6a4738c67b42 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:34.677647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9d33e-c18d-4729-a70e-6a4738c67b42 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:34.682812 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5321c01-a160-48da-8ab1-789b79e4cf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:34.683438 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5321c01-a160-48da-8ab1-789b79e4cf10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:34.683721 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5321c01-a160-48da-8ab1-789b79e4cf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:34.683995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5321c01-a160-48da-8ab1-789b79e4cf10 admin admin] PATH_INFO: `/v3/users/db8c75f158cd48b087684044dc1ea3bf` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:34.685142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5321c01-a160-48da-8ab1-789b79e4cf10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db8c75f158cd48b087684044dc1ea3bf)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:34.687075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5321c01-a160-48da-8ab1-789b79e4cf10 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:34.692354 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:34.733882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d5321c01-a160-48da-8ab1-789b79e4cf10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db8c75f158cd48b087684044dc1ea3bf'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:34.740963 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d5321c01-a160-48da-8ab1-789b79e4cf10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db8c75f158cd48b087684044dc1ea3bf'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:34.742079 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d5321c01-a160-48da-8ab1-789b79e4cf10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db8c75f158cd48b087684044dc1ea3bf'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:34.742699 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d5321c01-a160-48da-8ab1-789b79e4cf10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db8c75f158cd48b087684044dc1ea3bf'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:34.749565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d5321c01-a160-48da-8ab1-789b79e4cf10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db8c75f158cd48b087684044dc1ea3bf'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:34.767265 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1254/2503] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:51:34 2022] DELETE /identity/v3/users/db8c75f158cd48b087684044dc1ea3bf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:34.771760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bd496-78d0-410c-b6a5-1f4f710a0c9d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:34.772038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bd496-78d0-410c-b6a5-1f4f710a0c9d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:34.772305 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bd496-78d0-410c-b6a5-1f4f710a0c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:34.790709 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-373bd496-78d0-410c-b6a5-1f4f710a0c9d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:34.791894 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-373bd496-78d0-410c-b6a5-1f4f710a0c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:34.848736 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1250/2504] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:34.858425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5321c01-a160-48da-8ab1-789b79e4cf10 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:34.859870 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d5321c01-a160-48da-8ab1-789b79e4cf10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:34.917131 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5321c01-a160-48da-8ab1-789b79e4cf10 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:34.920656 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afb73d-0c3a-4c90-87c7-df1ec99e62c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:34.921247 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afb73d-0c3a-4c90-87c7-df1ec99e62c1 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:34.921522 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afb73d-0c3a-4c90-87c7-df1ec99e62c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:34.921791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afb73d-0c3a-4c90-87c7-df1ec99e62c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:34.931030 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afb73d-0c3a-4c90-87c7-df1ec99e62c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:34.932424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afb73d-0c3a-4c90-87c7-df1ec99e62c1 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:34.944265 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1255/2505] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:51:35.209771 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bd496-78d0-410c-b6a5-1f4f710a0c9d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:35.212674 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-373bd496-78d0-410c-b6a5-1f4f710a0c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:35.223258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:35.229858 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bd496-78d0-410c-b6a5-1f4f710a0c9d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:35.235383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6a8f1-3f05-410c-88b7-1a4a81d20bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:35.236210 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6a8f1-3f05-410c-88b7-1a4a81d20bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:35.236638 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6a8f1-3f05-410c-88b7-1a4a81d20bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:35.237110 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6a8f1-3f05-410c-88b7-1a4a81d20bf2 admin admin] PATH_INFO: `/v3/projects/5500528aeb594cd9978d54a6ef02c67a` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:35.238577 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6a8f1-3f05-410c-88b7-1a4a81d20bf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5500528aeb594cd9978d54a6ef02c67a)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:35.240393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6a8f1-3f05-410c-88b7-1a4a81d20bf2 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:35.286590 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8ff6a8f1-3f05-410c-88b7-1a4a81d20bf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5500528aeb594cd9978d54a6ef02c67a', 'request_id': 'req-8ff6a8f1-3f05-410c-88b7-1a4a81d20bf2'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:35.292866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8ff6a8f1-3f05-410c-88b7-1a4a81d20bf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5500528aeb594cd9978d54a6ef02c67a', 'request_id': 'req-8ff6a8f1-3f05-410c-88b7-1a4a81d20bf2'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:35.300642 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8ff6a8f1-3f05-410c-88b7-1a4a81d20bf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5500528aeb594cd9978d54a6ef02c67a', 'request_id': 'req-8ff6a8f1-3f05-410c-88b7-1a4a81d20bf2'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:35.312047 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8ff6a8f1-3f05-410c-88b7-1a4a81d20bf2 admin admin] The token cache is being invalidate because project 5500528aeb594cd9978d54a6ef02c67a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:51:35.312318 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8ff6a8f1-3f05-410c-88b7-1a4a81d20bf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:35.313009 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8ff6a8f1-3f05-410c-88b7-1a4a81d20bf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:35.314509 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1251/2506] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:51:35 2022] DELETE /identity/v3/projects/5500528aeb594cd9978d54a6ef02c67a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:51:35.318565 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afb73d-0c3a-4c90-87c7-df1ec99e62c1 service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:35.329479 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afb73d-0c3a-4c90-87c7-df1ec99e62c1 service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:35.388162 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba867e24-a05f-4b74-8aa3-42260b24120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:35.388891 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba867e24-a05f-4b74-8aa3-42260b24120e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:35.389092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba867e24-a05f-4b74-8aa3-42260b24120e admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:35.389364 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba867e24-a05f-4b74-8aa3-42260b24120e admin admin] PATH_INFO: `/v3/users/3b3cfba81c254be983f8e6b2564b3c19` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:35.390476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba867e24-a05f-4b74-8aa3-42260b24120e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b3cfba81c254be983f8e6b2564b3c19)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:35.392377 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba867e24-a05f-4b74-8aa3-42260b24120e admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:35.425213 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:35.439371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ba867e24-a05f-4b74-8aa3-42260b24120e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b3cfba81c254be983f8e6b2564b3c19'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:35.446505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ba867e24-a05f-4b74-8aa3-42260b24120e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b3cfba81c254be983f8e6b2564b3c19'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:35.447108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ba867e24-a05f-4b74-8aa3-42260b24120e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b3cfba81c254be983f8e6b2564b3c19'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:35.447694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ba867e24-a05f-4b74-8aa3-42260b24120e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b3cfba81c254be983f8e6b2564b3c19'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:35.454783 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-ba867e24-a05f-4b74-8aa3-42260b24120e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b3cfba81c254be983f8e6b2564b3c19'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:35.472812 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1256/2507] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:51:35 2022] DELETE /identity/v3/users/3b3cfba81c254be983f8e6b2564b3c19 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:35.733841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6a8f1-3f05-410c-88b7-1a4a81d20bf2 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:35.735462 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8ff6a8f1-3f05-410c-88b7-1a4a81d20bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:35.753787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6a8f1-3f05-410c-88b7-1a4a81d20bf2 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:35.818242 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a86993-80e3-40eb-9302-bef82eb2104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:35.818803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a86993-80e3-40eb-9302-bef82eb2104f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:35.819143 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a86993-80e3-40eb-9302-bef82eb2104f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:35.819421 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a86993-80e3-40eb-9302-bef82eb2104f admin admin] PATH_INFO: `/v3/projects/8421574c1ee7415b9f8648291dffc96d` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:35.821241 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a86993-80e3-40eb-9302-bef82eb2104f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8421574c1ee7415b9f8648291dffc96d)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:35.823160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a86993-80e3-40eb-9302-bef82eb2104f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:35.871046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-60a86993-80e3-40eb-9302-bef82eb2104f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8421574c1ee7415b9f8648291dffc96d', 'request_id': 'req-60a86993-80e3-40eb-9302-bef82eb2104f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:35.877208 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-60a86993-80e3-40eb-9302-bef82eb2104f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8421574c1ee7415b9f8648291dffc96d', 'request_id': 'req-60a86993-80e3-40eb-9302-bef82eb2104f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:35.885787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-60a86993-80e3-40eb-9302-bef82eb2104f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8421574c1ee7415b9f8648291dffc96d', 'request_id': 'req-60a86993-80e3-40eb-9302-bef82eb2104f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:35.897205 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-60a86993-80e3-40eb-9302-bef82eb2104f admin admin] The token cache is being invalidate because project 8421574c1ee7415b9f8648291dffc96d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:51:35.897832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-60a86993-80e3-40eb-9302-bef82eb2104f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:35.899043 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-60a86993-80e3-40eb-9302-bef82eb2104f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:35.900830 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1252/2508] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:51:35 2022] DELETE /identity/v3/projects/8421574c1ee7415b9f8648291dffc96d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:35.906969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc645e-e269-488d-841b-7e22960f4365 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:35.907349 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc645e-e269-488d-841b-7e22960f4365 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:35.907676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc645e-e269-488d-841b-7e22960f4365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:35.927820 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-dbcc645e-e269-488d-841b-7e22960f4365 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:35.929154 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-dbcc645e-e269-488d-841b-7e22960f4365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:35.991599 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1257/2509] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:36.007852 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77f2bc-11eb-48f3-8fb7-2c0a93f5782c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:36.008139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77f2bc-11eb-48f3-8fb7-2c0a93f5782c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:36.008424 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77f2bc-11eb-48f3-8fb7-2c0a93f5782c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:36.158115 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3f77f2bc-11eb-48f3-8fb7-2c0a93f5782c None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:36.159520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3f77f2bc-11eb-48f3-8fb7-2c0a93f5782c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:36.168526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1253/2510] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:36.172923 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc645e-e269-488d-841b-7e22960f4365 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:36.183385 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc645e-e269-488d-841b-7e22960f4365 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:36.188078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d2892-3a66-45ce-b346-47473705d283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:36.188711 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d2892-3a66-45ce-b346-47473705d283 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:36.188988 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d2892-3a66-45ce-b346-47473705d283 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:36.189262 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d2892-3a66-45ce-b346-47473705d283 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:36.189938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d2892-3a66-45ce-b346-47473705d283 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:51:36.190242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d2892-3a66-45ce-b346-47473705d283 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:36.191822 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d2892-3a66-45ce-b346-47473705d283 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:36.209296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1258/2511] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:51:36.211306 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77f2bc-11eb-48f3-8fb7-2c0a93f5782c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:36.222877 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77f2bc-11eb-48f3-8fb7-2c0a93f5782c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:36.228232 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92966776-e2c7-4f5a-8159-933f8211bc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:36.228955 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92966776-e2c7-4f5a-8159-933f8211bc67 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:36.229297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92966776-e2c7-4f5a-8159-933f8211bc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:36.229630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92966776-e2c7-4f5a-8159-933f8211bc67 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:36.230328 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92966776-e2c7-4f5a-8159-933f8211bc67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:36.232330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92966776-e2c7-4f5a-8159-933f8211bc67 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:36.237781 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:36.261630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1254/2512] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:51:36 2022] POST /identity/v3/projects => generated 409 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:51:36.265801 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d2892-3a66-45ce-b346-47473705d283 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:36.276157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d2892-3a66-45ce-b346-47473705d283 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:36.335670 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df650c-13eb-413a-bd7f-0a95f4b61563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:36.336232 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df650c-13eb-413a-bd7f-0a95f4b61563 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:36.336507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df650c-13eb-413a-bd7f-0a95f4b61563 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:36.337058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df650c-13eb-413a-bd7f-0a95f4b61563 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:36.337703 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df650c-13eb-413a-bd7f-0a95f4b61563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:36.339639 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df650c-13eb-413a-bd7f-0a95f4b61563 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:36.361584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1259/2513] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:51:36 2022] POST /identity/v3/users => generated 305 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:51:36.365723 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92966776-e2c7-4f5a-8159-933f8211bc67 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:36.375902 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92966776-e2c7-4f5a-8159-933f8211bc67 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:36.380438 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff924dc-00e6-4db9-9a0b-bbae8c1a4ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:36.381055 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff924dc-00e6-4db9-9a0b-bbae8c1a4ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:36.381329 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff924dc-00e6-4db9-9a0b-bbae8c1a4ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:36.381625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff924dc-00e6-4db9-9a0b-bbae8c1a4ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:36.382262 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff924dc-00e6-4db9-9a0b-bbae8c1a4ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:36.383825 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff924dc-00e6-4db9-9a0b-bbae8c1a4ff7 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:36.393924 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1255/2514] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:51:36.398281 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df650c-13eb-413a-bd7f-0a95f4b61563 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:36.408486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df650c-13eb-413a-bd7f-0a95f4b61563 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:36.413277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6275e-7e10-455d-954b-c819692e937f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:36.414532 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6275e-7e10-455d-954b-c819692e937f admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:36.414935 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6275e-7e10-455d-954b-c819692e937f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:36.415248 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6275e-7e10-455d-954b-c819692e937f admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:36.415919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6275e-7e10-455d-954b-c819692e937f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:36.417648 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6275e-7e10-455d-954b-c819692e937f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:36.428496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1260/2515] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:51:36.433173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff924dc-00e6-4db9-9a0b-bbae8c1a4ff7 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:36.443216 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff924dc-00e6-4db9-9a0b-bbae8c1a4ff7 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:36.448363 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e934fc-05f3-433a-abb9-c095b3579709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:36.449039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e934fc-05f3-433a-abb9-c095b3579709 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:36.449314 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e934fc-05f3-433a-abb9-c095b3579709 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:36.449578 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e934fc-05f3-433a-abb9-c095b3579709 admin admin] PATH_INFO: `/v3/projects/8622338a3a914497bc71b4310e10c70d/users/8aa06343fe7b487a9330989bfab92931/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:36.465915 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e934fc-05f3-433a-abb9-c095b3579709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8622338a3a914497bc71b4310e10c70d, user_id=8aa06343fe7b487a9330989bfab92931, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:36.468508 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e934fc-05f3-433a-abb9-c095b3579709 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:36.481344 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1256/2516] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:51:36 2022] PUT /identity/v3/projects/8622338a3a914497bc71b4310e10c70d/users/8aa06343fe7b487a9330989bfab92931/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:36.493128 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be275eac-6627-4df4-a596-767ccbf6923a None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:36.493416 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be275eac-6627-4df4-a596-767ccbf6923a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:36.493698 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be275eac-6627-4df4-a596-767ccbf6923a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:36.518214 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:36.521223 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-be275eac-6627-4df4-a596-767ccbf6923a None None] MFA Rules not processed for user `8aa06343fe7b487a9330989bfab92931`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:36.523422 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-be275eac-6627-4df4-a596-767ccbf6923a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:36.587671 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1261/2517] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:36 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:36.592217 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e934fc-05f3-433a-abb9-c095b3579709 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:36.656874 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e934fc-05f3-433a-abb9-c095b3579709 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:36.661498 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd8cb4-b635-484d-be7f-baedf69ed207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:36.662096 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd8cb4-b635-484d-be7f-baedf69ed207 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:36.662399 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd8cb4-b635-484d-be7f-baedf69ed207 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:36.662672 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd8cb4-b635-484d-be7f-baedf69ed207 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:36.663806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd8cb4-b635-484d-be7f-baedf69ed207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:36.665710 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd8cb4-b635-484d-be7f-baedf69ed207 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:36.692453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1257/2518] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:51:36 2022] POST /identity/v3/projects => generated 407 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:51:36.696569 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be275eac-6627-4df4-a596-767ccbf6923a None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:36.707129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be275eac-6627-4df4-a596-767ccbf6923a None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:36.764919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce6530-3069-4f79-b0a5-018ffc7dd541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:36.765526 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce6530-3069-4f79-b0a5-018ffc7dd541 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:36.765806 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce6530-3069-4f79-b0a5-018ffc7dd541 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:36.766079 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce6530-3069-4f79-b0a5-018ffc7dd541 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:36.766717 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce6530-3069-4f79-b0a5-018ffc7dd541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:36.768645 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce6530-3069-4f79-b0a5-018ffc7dd541 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:36.790063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1262/2519] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:51:36 2022] POST /identity/v3/users => generated 310 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:51:36.794182 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd8cb4-b635-484d-be7f-baedf69ed207 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:36.804024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd8cb4-b635-484d-be7f-baedf69ed207 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:36.808438 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d766e-8a3a-4177-adc5-41e0dd3afeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:36.809054 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d766e-8a3a-4177-adc5-41e0dd3afeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:36.809329 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d766e-8a3a-4177-adc5-41e0dd3afeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:36.809594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d766e-8a3a-4177-adc5-41e0dd3afeb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:36.810224 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d766e-8a3a-4177-adc5-41e0dd3afeb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:36.811781 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d766e-8a3a-4177-adc5-41e0dd3afeb1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:36.821891 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1258/2520] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:51:36.825784 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce6530-3069-4f79-b0a5-018ffc7dd541 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:36.836296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce6530-3069-4f79-b0a5-018ffc7dd541 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:36.841105 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864f1d6-6c4e-4314-bad6-996a8c56b025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:36.841682 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864f1d6-6c4e-4314-bad6-996a8c56b025 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:36.841959 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864f1d6-6c4e-4314-bad6-996a8c56b025 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:36.842232 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864f1d6-6c4e-4314-bad6-996a8c56b025 admin admin] PATH_INFO: `/v3/projects/663c2c9942a541f8962b876226d3723c/users/5f26da8dd3774b1595e9b33824cfdb5d/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:36.857838 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864f1d6-6c4e-4314-bad6-996a8c56b025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=663c2c9942a541f8962b876226d3723c, user_id=5f26da8dd3774b1595e9b33824cfdb5d, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:36.860656 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864f1d6-6c4e-4314-bad6-996a8c56b025 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:36.873063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1263/2521] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:51:36 2022] PUT /identity/v3/projects/663c2c9942a541f8962b876226d3723c/users/5f26da8dd3774b1595e9b33824cfdb5d/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:36.877036 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d766e-8a3a-4177-adc5-41e0dd3afeb1 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:36.887197 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d766e-8a3a-4177-adc5-41e0dd3afeb1 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:36.941963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c398b-17d3-438a-9aea-aa66251a2660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:36.942557 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c398b-17d3-438a-9aea-aa66251a2660 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:36.942836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c398b-17d3-438a-9aea-aa66251a2660 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:36.943107 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c398b-17d3-438a-9aea-aa66251a2660 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:36.943734 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c398b-17d3-438a-9aea-aa66251a2660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:36.945368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c398b-17d3-438a-9aea-aa66251a2660 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:36.954778 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1259/2522] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:51:36.958970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864f1d6-6c4e-4314-bad6-996a8c56b025 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:36.970256 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864f1d6-6c4e-4314-bad6-996a8c56b025 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:36.975095 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da248f86-2dbb-4296-a54a-2d2b6350fab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:36.975781 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da248f86-2dbb-4296-a54a-2d2b6350fab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:36.976645 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da248f86-2dbb-4296-a54a-2d2b6350fab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:36.976927 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da248f86-2dbb-4296-a54a-2d2b6350fab9 admin admin] PATH_INFO: `/v3/projects/663c2c9942a541f8962b876226d3723c/users/5f26da8dd3774b1595e9b33824cfdb5d/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:36.978921 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da248f86-2dbb-4296-a54a-2d2b6350fab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=663c2c9942a541f8962b876226d3723c, user_id=5f26da8dd3774b1595e9b33824cfdb5d, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:36.981609 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da248f86-2dbb-4296-a54a-2d2b6350fab9 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:36.992921 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1264/2523] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:51:36 2022] PUT /identity/v3/projects/663c2c9942a541f8962b876226d3723c/users/5f26da8dd3774b1595e9b33824cfdb5d/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:37.003147 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af66ee3-d2ba-43e0-8cfe-d1d60bb62182 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:37.003429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af66ee3-d2ba-43e0-8cfe-d1d60bb62182 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:37.003697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af66ee3-d2ba-43e0-8cfe-d1d60bb62182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:37.031117 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-6af66ee3-d2ba-43e0-8cfe-d1d60bb62182 None None] MFA Rules not processed for user `5f26da8dd3774b1595e9b33824cfdb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:37.032306 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6af66ee3-d2ba-43e0-8cfe-d1d60bb62182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:37.041328 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:37.101586 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1260/2524] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:37 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:37.112806 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da248f86-2dbb-4296-a54a-2d2b6350fab9 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:37.114506 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-da248f86-2dbb-4296-a54a-2d2b6350fab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:37.170243 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da248f86-2dbb-4296-a54a-2d2b6350fab9 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:37.173790 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aab9aa-2887-4d34-ae41-117e9a92db20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:37.174374 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aab9aa-2887-4d34-ae41-117e9a92db20 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:37.174647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aab9aa-2887-4d34-ae41-117e9a92db20 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:37.174916 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aab9aa-2887-4d34-ae41-117e9a92db20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:37.183700 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aab9aa-2887-4d34-ae41-117e9a92db20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:37.185142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aab9aa-2887-4d34-ae41-117e9a92db20 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:37.188912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:37.196163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1265/2525] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:51:37 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:51:37.351365 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af66ee3-d2ba-43e0-8cfe-d1d60bb62182 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:37.352894 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6af66ee3-d2ba-43e0-8cfe-d1d60bb62182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:37.364404 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af66ee3-d2ba-43e0-8cfe-d1d60bb62182 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:37.368004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402df2eb-c3df-4654-a05a-52b21933d76a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:37.368628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402df2eb-c3df-4654-a05a-52b21933d76a service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:37.368908 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402df2eb-c3df-4654-a05a-52b21933d76a service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:37.369180 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402df2eb-c3df-4654-a05a-52b21933d76a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:37.424925 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402df2eb-c3df-4654-a05a-52b21933d76a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:37.426341 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402df2eb-c3df-4654-a05a-52b21933d76a service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:37.435819 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1261/2526] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:51:37 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:51:37.897832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aab9aa-2887-4d34-ae41-117e9a92db20 service cinder] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:37.899249 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e6aab9aa-2887-4d34-ae41-117e9a92db20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:37.956141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aab9aa-2887-4d34-ae41-117e9a92db20 service cinder] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:37.959776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9f34f-8774-4bdb-9471-7ce1d804b5bd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28614526d50d4201b93b20df45465d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:37.960905 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9f34f-8774-4bdb-9471-7ce1d804b5bd service glance] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:37.961185 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9f34f-8774-4bdb-9471-7ce1d804b5bd service glance] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:37.961458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9f34f-8774-4bdb-9471-7ce1d804b5bd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:37.963450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3ac9f34f-8774-4bdb-9471-7ce1d804b5bd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:38.038588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9f34f-8774-4bdb-9471-7ce1d804b5bd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:38.040005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9f34f-8774-4bdb-9471-7ce1d804b5bd service glance] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:38.050801 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1266/2527] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:51:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:51:38.227259 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402df2eb-c3df-4654-a05a-52b21933d76a service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:38.228726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-402df2eb-c3df-4654-a05a-52b21933d76a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:38.283325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402df2eb-c3df-4654-a05a-52b21933d76a service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:38.287108 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5ac89-73f2-4be9-bb28-d16756a99bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:38.287738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5ac89-73f2-4be9-bb28-d16756a99bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:38.288014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5ac89-73f2-4be9-bb28-d16756a99bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:38.288811 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5ac89-73f2-4be9-bb28-d16756a99bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:38.290499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1ad5ac89-73f2-4be9-bb28-d16756a99bd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:38.303412 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5ac89-73f2-4be9-bb28-d16756a99bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:38.305479 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5ac89-73f2-4be9-bb28-d16756a99bd9 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:38.315952 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1262/2528] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:51:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:51:42.835184 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9f34f-8774-4bdb-9471-7ce1d804b5bd service glance] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:42.897213 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9f34f-8774-4bdb-9471-7ce1d804b5bd service glance] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:42.901666 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7b666-2771-41ba-9cf0-5e209e59fa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:42.902278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7b666-2771-41ba-9cf0-5e209e59fa3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:42.902555 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7b666-2771-41ba-9cf0-5e209e59fa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:42.902834 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7b666-2771-41ba-9cf0-5e209e59fa3c admin admin] PATH_INFO: `/v3/users/8aa06343fe7b487a9330989bfab92931` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:42.903917 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7b666-2771-41ba-9cf0-5e209e59fa3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aa06343fe7b487a9330989bfab92931)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:42.905840 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7b666-2771-41ba-9cf0-5e209e59fa3c admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:42.946258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:42.951360 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-78e7b666-2771-41ba-9cf0-5e209e59fa3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aa06343fe7b487a9330989bfab92931'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:42.959443 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-78e7b666-2771-41ba-9cf0-5e209e59fa3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aa06343fe7b487a9330989bfab92931'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:42.960701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-78e7b666-2771-41ba-9cf0-5e209e59fa3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aa06343fe7b487a9330989bfab92931'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:42.961356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-78e7b666-2771-41ba-9cf0-5e209e59fa3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aa06343fe7b487a9330989bfab92931'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:42.968573 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-78e7b666-2771-41ba-9cf0-5e209e59fa3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aa06343fe7b487a9330989bfab92931'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:42.986464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1267/2529] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:51:42 2022] DELETE /identity/v3/users/8aa06343fe7b487a9330989bfab92931 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:42.990880 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b429b-7250-427a-a7dd-7412cb26930c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:42.991362 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b429b-7250-427a-a7dd-7412cb26930c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:42.991456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b429b-7250-427a-a7dd-7412cb26930c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:43.010898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-288b429b-7250-427a-a7dd-7412cb26930c None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:43.012000 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-288b429b-7250-427a-a7dd-7412cb26930c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:43.058420 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:43.074208 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1263/2530] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:43.084199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7b666-2771-41ba-9cf0-5e209e59fa3c admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:43.086255 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-78e7b666-2771-41ba-9cf0-5e209e59fa3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:43.146307 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7b666-2771-41ba-9cf0-5e209e59fa3c admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:43.150500 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab9fb8-b63f-4146-a3dd-744b8e76ac89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:43.151120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab9fb8-b63f-4146-a3dd-744b8e76ac89 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:43.151382 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab9fb8-b63f-4146-a3dd-744b8e76ac89 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:43.151653 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab9fb8-b63f-4146-a3dd-744b8e76ac89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:43.160908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab9fb8-b63f-4146-a3dd-744b8e76ac89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:43.162330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab9fb8-b63f-4146-a3dd-744b8e76ac89 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:43.172536 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1268/2531] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:51:43.443001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b429b-7250-427a-a7dd-7412cb26930c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:43.444962 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-288b429b-7250-427a-a7dd-7412cb26930c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:43.457461 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b429b-7250-427a-a7dd-7412cb26930c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:43.463091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3604c64-a4b2-4023-9651-ab2ba9fa7743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:43.463715 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3604c64-a4b2-4023-9651-ab2ba9fa7743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:43.464681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3604c64-a4b2-4023-9651-ab2ba9fa7743 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:43.464977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3604c64-a4b2-4023-9651-ab2ba9fa7743 admin admin] PATH_INFO: `/v3/projects/8622338a3a914497bc71b4310e10c70d` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:43.466663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3604c64-a4b2-4023-9651-ab2ba9fa7743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8622338a3a914497bc71b4310e10c70d)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:43.468663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3604c64-a4b2-4023-9651-ab2ba9fa7743 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:43.523564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b3604c64-a4b2-4023-9651-ab2ba9fa7743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8622338a3a914497bc71b4310e10c70d', 'request_id': 'req-b3604c64-a4b2-4023-9651-ab2ba9fa7743'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:43.530161 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b3604c64-a4b2-4023-9651-ab2ba9fa7743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8622338a3a914497bc71b4310e10c70d', 'request_id': 'req-b3604c64-a4b2-4023-9651-ab2ba9fa7743'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:43.537587 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b3604c64-a4b2-4023-9651-ab2ba9fa7743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8622338a3a914497bc71b4310e10c70d', 'request_id': 'req-b3604c64-a4b2-4023-9651-ab2ba9fa7743'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:43.547842 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b3604c64-a4b2-4023-9651-ab2ba9fa7743 admin admin] The token cache is being invalidate because project 8622338a3a914497bc71b4310e10c70d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:51:43.548142 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b3604c64-a4b2-4023-9651-ab2ba9fa7743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:43.548768 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b3604c64-a4b2-4023-9651-ab2ba9fa7743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:43.550231 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1264/2532] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:51:43 2022] DELETE /identity/v3/projects/8622338a3a914497bc71b4310e10c70d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:43.554423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab9fb8-b63f-4146-a3dd-744b8e76ac89 service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:43.564065 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab9fb8-b63f-4146-a3dd-744b8e76ac89 service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:43.618915 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facca572-c41a-4e5e-be48-5cc9085e6f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:43.619536 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facca572-c41a-4e5e-be48-5cc9085e6f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:43.619813 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facca572-c41a-4e5e-be48-5cc9085e6f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:43.620083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facca572-c41a-4e5e-be48-5cc9085e6f2d admin admin] PATH_INFO: `/v3/users/5f26da8dd3774b1595e9b33824cfdb5d` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:43.621203 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facca572-c41a-4e5e-be48-5cc9085e6f2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f26da8dd3774b1595e9b33824cfdb5d)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:43.623097 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facca572-c41a-4e5e-be48-5cc9085e6f2d admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:43.667631 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-facca572-c41a-4e5e-be48-5cc9085e6f2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f26da8dd3774b1595e9b33824cfdb5d'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:43.674707 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-facca572-c41a-4e5e-be48-5cc9085e6f2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f26da8dd3774b1595e9b33824cfdb5d'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:43.675308 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-facca572-c41a-4e5e-be48-5cc9085e6f2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f26da8dd3774b1595e9b33824cfdb5d'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:43.676165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-facca572-c41a-4e5e-be48-5cc9085e6f2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f26da8dd3774b1595e9b33824cfdb5d'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:43.683486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-facca572-c41a-4e5e-be48-5cc9085e6f2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f26da8dd3774b1595e9b33824cfdb5d'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:43.684596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:43.702725 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1269/2533] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:51:43 2022] DELETE /identity/v3/users/5f26da8dd3774b1595e9b33824cfdb5d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:43.975624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3604c64-a4b2-4023-9651-ab2ba9fa7743 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:43.977385 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b3604c64-a4b2-4023-9651-ab2ba9fa7743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:43.990672 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3604c64-a4b2-4023-9651-ab2ba9fa7743 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:44.053355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc2a4c-ff65-494b-95e2-3b59c8332e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:44.054563 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc2a4c-ff65-494b-95e2-3b59c8332e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:44.054877 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc2a4c-ff65-494b-95e2-3b59c8332e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:44.055377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc2a4c-ff65-494b-95e2-3b59c8332e7c admin admin] PATH_INFO: `/v3/projects/663c2c9942a541f8962b876226d3723c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:44.056772 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc2a4c-ff65-494b-95e2-3b59c8332e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=663c2c9942a541f8962b876226d3723c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:44.058705 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc2a4c-ff65-494b-95e2-3b59c8332e7c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:44.106403 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7abc2a4c-ff65-494b-95e2-3b59c8332e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '663c2c9942a541f8962b876226d3723c', 'request_id': 'req-7abc2a4c-ff65-494b-95e2-3b59c8332e7c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:44.112538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7abc2a4c-ff65-494b-95e2-3b59c8332e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '663c2c9942a541f8962b876226d3723c', 'request_id': 'req-7abc2a4c-ff65-494b-95e2-3b59c8332e7c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:44.120460 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7abc2a4c-ff65-494b-95e2-3b59c8332e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '663c2c9942a541f8962b876226d3723c', 'request_id': 'req-7abc2a4c-ff65-494b-95e2-3b59c8332e7c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:44.130858 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7abc2a4c-ff65-494b-95e2-3b59c8332e7c admin admin] The token cache is being invalidate because project 663c2c9942a541f8962b876226d3723c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:51:44.131140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7abc2a4c-ff65-494b-95e2-3b59c8332e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:44.131801 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7abc2a4c-ff65-494b-95e2-3b59c8332e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:44.133292 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1265/2534] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:51:43 2022] DELETE /identity/v3/projects/663c2c9942a541f8962b876226d3723c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:44.139123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b566d4-7a31-4f52-a580-c8dc7548fb1b None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:44.139600 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b566d4-7a31-4f52-a580-c8dc7548fb1b None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:44.139697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b566d4-7a31-4f52-a580-c8dc7548fb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:44.158982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-11b566d4-7a31-4f52-a580-c8dc7548fb1b None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:44.160191 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-11b566d4-7a31-4f52-a580-c8dc7548fb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:44.226835 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1270/2535] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:44.230167 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c270f9-0319-4a66-a420-8f101867f88d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:44.230451 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c270f9-0319-4a66-a420-8f101867f88d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:44.230721 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c270f9-0319-4a66-a420-8f101867f88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:44.238204 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:44.252942 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-25c270f9-0319-4a66-a420-8f101867f88d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:44.254232 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-25c270f9-0319-4a66-a420-8f101867f88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:44.263314 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1266/2536] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:51:44.267458 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b566d4-7a31-4f52-a580-c8dc7548fb1b None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:44.277154 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b566d4-7a31-4f52-a580-c8dc7548fb1b None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:44.281716 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495145d-0a45-45d3-8fe2-da1c7b9e3b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:44.282312 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495145d-0a45-45d3-8fe2-da1c7b9e3b36 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:44.282596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495145d-0a45-45d3-8fe2-da1c7b9e3b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:44.282867 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495145d-0a45-45d3-8fe2-da1c7b9e3b36 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:44.283508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495145d-0a45-45d3-8fe2-da1c7b9e3b36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:51:44.283802 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495145d-0a45-45d3-8fe2-da1c7b9e3b36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:44.285435 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495145d-0a45-45d3-8fe2-da1c7b9e3b36 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:44.301184 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1271/2537] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:51:44.302488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c270f9-0319-4a66-a420-8f101867f88d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:44.312724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c270f9-0319-4a66-a420-8f101867f88d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:44.317680 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9ed13-32db-4a47-9c9a-dd997f2edfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:44.318358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9ed13-32db-4a47-9c9a-dd997f2edfc8 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:44.318707 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9ed13-32db-4a47-9c9a-dd997f2edfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:44.319049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9ed13-32db-4a47-9c9a-dd997f2edfc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:44.320267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9ed13-32db-4a47-9c9a-dd997f2edfc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:44.322252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9ed13-32db-4a47-9c9a-dd997f2edfc8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:44.351876 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1267/2538] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:51:44 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:51:44.356111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495145d-0a45-45d3-8fe2-da1c7b9e3b36 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:44.375094 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495145d-0a45-45d3-8fe2-da1c7b9e3b36 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:44.434707 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b568400-771b-4ce1-9059-f253da7c3eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:44.435353 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b568400-771b-4ce1-9059-f253da7c3eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:44.435631 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b568400-771b-4ce1-9059-f253da7c3eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:44.435901 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b568400-771b-4ce1-9059-f253da7c3eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:44.436569 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b568400-771b-4ce1-9059-f253da7c3eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:44.438477 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b568400-771b-4ce1-9059-f253da7c3eb6 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:44.459483 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1272/2539] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:51:44 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:51:44.463883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9ed13-32db-4a47-9c9a-dd997f2edfc8 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:44.474380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9ed13-32db-4a47-9c9a-dd997f2edfc8 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:44.479268 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dedb7-23a3-4d17-85c3-e435e91b9215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:44.479796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dedb7-23a3-4d17-85c3-e435e91b9215 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:44.480086 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dedb7-23a3-4d17-85c3-e435e91b9215 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:44.480446 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dedb7-23a3-4d17-85c3-e435e91b9215 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:44.480994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1dedb7-23a3-4d17-85c3-e435e91b9215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:44.482556 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1dedb7-23a3-4d17-85c3-e435e91b9215 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:44.492818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1268/2540] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:51:44.496800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b568400-771b-4ce1-9059-f253da7c3eb6 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:44.506482 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b568400-771b-4ce1-9059-f253da7c3eb6 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:44.511704 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3de9fa-61e9-4b78-b98b-c60d0b45b9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:44.512283 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3de9fa-61e9-4b78-b98b-c60d0b45b9fd admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:44.512579 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3de9fa-61e9-4b78-b98b-c60d0b45b9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:44.512919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3de9fa-61e9-4b78-b98b-c60d0b45b9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:44.513554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3de9fa-61e9-4b78-b98b-c60d0b45b9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:44.515127 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3de9fa-61e9-4b78-b98b-c60d0b45b9fd admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:44.525482 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1273/2541] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:51:44.529428 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dedb7-23a3-4d17-85c3-e435e91b9215 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:44.539938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dedb7-23a3-4d17-85c3-e435e91b9215 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:44.544815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294c5f9-dac8-4b8d-a41b-877e8895d7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:44.545487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294c5f9-dac8-4b8d-a41b-877e8895d7d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:44.545759 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294c5f9-dac8-4b8d-a41b-877e8895d7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:44.546027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294c5f9-dac8-4b8d-a41b-877e8895d7d3 admin admin] PATH_INFO: `/v3/projects/5a3bae7488654feb9506734a17d586cc/users/850684ef2edf4c4eaa5c133d10e48029/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:44.560679 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294c5f9-dac8-4b8d-a41b-877e8895d7d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a3bae7488654feb9506734a17d586cc, user_id=850684ef2edf4c4eaa5c133d10e48029, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:44.563278 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294c5f9-dac8-4b8d-a41b-877e8895d7d3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:44.576244 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1269/2542] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:51:44 2022] PUT /identity/v3/projects/5a3bae7488654feb9506734a17d586cc/users/850684ef2edf4c4eaa5c133d10e48029/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:44.587677 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45097bd7-1894-4d28-82db-3845614f6cc2 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:44.587985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45097bd7-1894-4d28-82db-3845614f6cc2 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:44.588258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45097bd7-1894-4d28-82db-3845614f6cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:44.615249 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-45097bd7-1894-4d28-82db-3845614f6cc2 None None] MFA Rules not processed for user `850684ef2edf4c4eaa5c133d10e48029`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:44.617008 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-45097bd7-1894-4d28-82db-3845614f6cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:44.649206 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:44.680448 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1274/2543] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:44.691049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294c5f9-dac8-4b8d-a41b-877e8895d7d3 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:44.692801 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4294c5f9-dac8-4b8d-a41b-877e8895d7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:44.755314 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294c5f9-dac8-4b8d-a41b-877e8895d7d3 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:44.758776 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d6fbb-8590-4c46-886f-7390ec352c22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:44.759368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d6fbb-8590-4c46-886f-7390ec352c22 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:44.759649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d6fbb-8590-4c46-886f-7390ec352c22 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:44.759917 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d6fbb-8590-4c46-886f-7390ec352c22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:44.768165 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d6fbb-8590-4c46-886f-7390ec352c22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:44.769610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d6fbb-8590-4c46-886f-7390ec352c22 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:44.778679 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1270/2544] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:51:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:51:47.780666 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45097bd7-1894-4d28-82db-3845614f6cc2 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:47.855668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45097bd7-1894-4d28-82db-3845614f6cc2 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:47.860433 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d68969-0507-4a55-b205-a31cf1e3074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:47.861112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d68969-0507-4a55-b205-a31cf1e3074a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:47.861392 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d68969-0507-4a55-b205-a31cf1e3074a admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:47.861667 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d68969-0507-4a55-b205-a31cf1e3074a admin admin] PATH_INFO: `/v3/users/850684ef2edf4c4eaa5c133d10e48029` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:47.862789 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d68969-0507-4a55-b205-a31cf1e3074a admin admin] RBAC: Authorizing `identity:delete_user(user_id=850684ef2edf4c4eaa5c133d10e48029)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:47.864860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d68969-0507-4a55-b205-a31cf1e3074a admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:47.918711 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b0d68969-0507-4a55-b205-a31cf1e3074a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '850684ef2edf4c4eaa5c133d10e48029'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:47.926805 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b0d68969-0507-4a55-b205-a31cf1e3074a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '850684ef2edf4c4eaa5c133d10e48029'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:47.927520 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b0d68969-0507-4a55-b205-a31cf1e3074a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '850684ef2edf4c4eaa5c133d10e48029'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:47.928136 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b0d68969-0507-4a55-b205-a31cf1e3074a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '850684ef2edf4c4eaa5c133d10e48029'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:47.935399 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b0d68969-0507-4a55-b205-a31cf1e3074a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '850684ef2edf4c4eaa5c133d10e48029'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:47.952856 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1275/2545] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:51:47 2022] DELETE /identity/v3/users/850684ef2edf4c4eaa5c133d10e48029 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:47.957236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3ae09-593b-425b-a518-ffe279c32497 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:47.957683 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3ae09-593b-425b-a518-ffe279c32497 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:47.957775 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3ae09-593b-425b-a518-ffe279c32497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:47.977020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-43e3ae09-593b-425b-a518-ffe279c32497 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:47.978135 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-43e3ae09-593b-425b-a518-ffe279c32497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:48.035143 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1271/2546] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:48.045045 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d68969-0507-4a55-b205-a31cf1e3074a admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:48.047613 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b0d68969-0507-4a55-b205-a31cf1e3074a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:48.118234 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d68969-0507-4a55-b205-a31cf1e3074a admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:48.121870 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e6d16-1f88-4fb7-a9a1-f473ed55d4b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:48.122472 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e6d16-1f88-4fb7-a9a1-f473ed55d4b6 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:48.122753 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e6d16-1f88-4fb7-a9a1-f473ed55d4b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:48.123024 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e6d16-1f88-4fb7-a9a1-f473ed55d4b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:48.132608 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e6d16-1f88-4fb7-a9a1-f473ed55d4b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:48.134031 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e6d16-1f88-4fb7-a9a1-f473ed55d4b6 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:48.137961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:48.145954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1276/2547] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:51:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:51:48.421353 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3ae09-593b-425b-a518-ffe279c32497 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:48.423042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-43e3ae09-593b-425b-a518-ffe279c32497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:48.437320 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3ae09-593b-425b-a518-ffe279c32497 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:48.443645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710c2d3-dc86-4df8-8cfe-125bdc61b467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:48.444963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710c2d3-dc86-4df8-8cfe-125bdc61b467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:48.445240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710c2d3-dc86-4df8-8cfe-125bdc61b467 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:48.445507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710c2d3-dc86-4df8-8cfe-125bdc61b467 admin admin] PATH_INFO: `/v3/projects/5a3bae7488654feb9506734a17d586cc` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:48.446624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710c2d3-dc86-4df8-8cfe-125bdc61b467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a3bae7488654feb9506734a17d586cc)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:48.448505 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710c2d3-dc86-4df8-8cfe-125bdc61b467 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:48.498165 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:48.515767 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2710c2d3-dc86-4df8-8cfe-125bdc61b467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a3bae7488654feb9506734a17d586cc', 'request_id': 'req-2710c2d3-dc86-4df8-8cfe-125bdc61b467'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:48.522480 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2710c2d3-dc86-4df8-8cfe-125bdc61b467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a3bae7488654feb9506734a17d586cc', 'request_id': 'req-2710c2d3-dc86-4df8-8cfe-125bdc61b467'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:48.529881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2710c2d3-dc86-4df8-8cfe-125bdc61b467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a3bae7488654feb9506734a17d586cc', 'request_id': 'req-2710c2d3-dc86-4df8-8cfe-125bdc61b467'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:48.541023 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2710c2d3-dc86-4df8-8cfe-125bdc61b467 admin admin] The token cache is being invalidate because project 5a3bae7488654feb9506734a17d586cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:51:48.541311 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2710c2d3-dc86-4df8-8cfe-125bdc61b467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:48.541930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2710c2d3-dc86-4df8-8cfe-125bdc61b467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:48.543432 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1272/2548] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:51:48 2022] DELETE /identity/v3/projects/5a3bae7488654feb9506734a17d586cc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:48.548431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2abc37-6ffc-443d-afb4-7c9ebdb4869f None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:48.548755 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2abc37-6ffc-443d-afb4-7c9ebdb4869f None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:48.549031 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2abc37-6ffc-443d-afb4-7c9ebdb4869f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:48.570920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-ac2abc37-6ffc-443d-afb4-7c9ebdb4869f None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:48.572118 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ac2abc37-6ffc-443d-afb4-7c9ebdb4869f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:48.639223 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1277/2549] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:48.648245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b3419-cc18-41f0-95aa-a1e39f09ac49 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:48.648578 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b3419-cc18-41f0-95aa-a1e39f09ac49 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:48.648840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b3419-cc18-41f0-95aa-a1e39f09ac49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:48.673282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-069b3419-cc18-41f0-95aa-a1e39f09ac49 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:48.674571 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-069b3419-cc18-41f0-95aa-a1e39f09ac49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:48.684393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1273/2550] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:48.691529 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b3419-cc18-41f0-95aa-a1e39f09ac49 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:48.691693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2abc37-6ffc-443d-afb4-7c9ebdb4869f None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:48.693006 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-ac2abc37-6ffc-443d-afb4-7c9ebdb4869f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:48.701067 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b3419-cc18-41f0-95aa-a1e39f09ac49 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:48.708641 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8576ac8-5d25-43f9-b913-8581f833c2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:48.708641 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8576ac8-5d25-43f9-b913-8581f833c2ea admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:48.708641 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8576ac8-5d25-43f9-b913-8581f833c2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:48.708641 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8576ac8-5d25-43f9-b913-8581f833c2ea admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:48.709039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8576ac8-5d25-43f9-b913-8581f833c2ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:51:48.709039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8576ac8-5d25-43f9-b913-8581f833c2ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:48.710153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8576ac8-5d25-43f9-b913-8581f833c2ea admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:48.724192 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1274/2551] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 10:51:48.729346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8576ac8-5d25-43f9-b913-8581f833c2ea admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:48.738985 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8576ac8-5d25-43f9-b913-8581f833c2ea admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:48.744697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b46f8-5b13-4a4f-b420-08de1a1aee19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:48.745309 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b46f8-5b13-4a4f-b420-08de1a1aee19 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:48.745590 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b46f8-5b13-4a4f-b420-08de1a1aee19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:48.745867 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b46f8-5b13-4a4f-b420-08de1a1aee19 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:48.746602 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b46f8-5b13-4a4f-b420-08de1a1aee19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:48.748634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b46f8-5b13-4a4f-b420-08de1a1aee19 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:48.756573 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2abc37-6ffc-443d-afb4-7c9ebdb4869f None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:48.760409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d71f9-0c91-47a1-94ea-91af4803fd3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:48.761130 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d71f9-0c91-47a1-94ea-91af4803fd3e service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:48.761464 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d71f9-0c91-47a1-94ea-91af4803fd3e service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:48.761743 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d71f9-0c91-47a1-94ea-91af4803fd3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:48.763509 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-603d71f9-0c91-47a1-94ea-91af4803fd3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:48.776940 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1275/2552] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:51:48 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:51:48.781016 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b46f8-5b13-4a4f-b420-08de1a1aee19 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:48.825558 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d71f9-0c91-47a1-94ea-91af4803fd3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:48.827085 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d71f9-0c91-47a1-94ea-91af4803fd3e service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:48.836323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1278/2553] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:51:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:51:48.844142 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b46f8-5b13-4a4f-b420-08de1a1aee19 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:48.848772 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec74dd0-13d7-4d96-aa4b-c3e41d1d3d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:48.849383 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec74dd0-13d7-4d96-aa4b-c3e41d1d3d0a admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:48.849661 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec74dd0-13d7-4d96-aa4b-c3e41d1d3d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:48.849938 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec74dd0-13d7-4d96-aa4b-c3e41d1d3d0a admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:48.851093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec74dd0-13d7-4d96-aa4b-c3e41d1d3d0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:48.853003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec74dd0-13d7-4d96-aa4b-c3e41d1d3d0a admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:48.874987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1276/2554] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:51:48 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:51:48.879520 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d71f9-0c91-47a1-94ea-91af4803fd3e service cinder] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:48.890467 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d71f9-0c91-47a1-94ea-91af4803fd3e service cinder] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:48.895003 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e1b9f-fecc-4156-b132-0de75e50e0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:48.895596 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e1b9f-fecc-4156-b132-0de75e50e0cf admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:48.895884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e1b9f-fecc-4156-b132-0de75e50e0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:48.896160 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e1b9f-fecc-4156-b132-0de75e50e0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:48.896846 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e1b9f-fecc-4156-b132-0de75e50e0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:48.898413 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e1b9f-fecc-4156-b132-0de75e50e0cf admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:48.909089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1279/2555] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:51:48.913499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec74dd0-13d7-4d96-aa4b-c3e41d1d3d0a admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:48.923250 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec74dd0-13d7-4d96-aa4b-c3e41d1d3d0a admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:48.927756 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15605af4-861f-4f76-acfc-df1f6f79d9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:48.928368 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15605af4-861f-4f76-acfc-df1f6f79d9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:48.929187 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15605af4-861f-4f76-acfc-df1f6f79d9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:48.929457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15605af4-861f-4f76-acfc-df1f6f79d9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:48.930091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15605af4-861f-4f76-acfc-df1f6f79d9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:48.931660 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15605af4-861f-4f76-acfc-df1f6f79d9c1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:48.941917 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1277/2556] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:51:48.946517 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e1b9f-fecc-4156-b132-0de75e50e0cf admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:48.956508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e1b9f-fecc-4156-b132-0de75e50e0cf admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:48.961416 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17674d3-3cfc-413b-ba04-8907f1b0c7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:48.962257 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17674d3-3cfc-413b-ba04-8907f1b0c7e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:48.962536 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17674d3-3cfc-413b-ba04-8907f1b0c7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:48.962814 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17674d3-3cfc-413b-ba04-8907f1b0c7e2 admin admin] PATH_INFO: `/v3/projects/7c8d9e9b9e5645239d367f3bccd73a07/users/591836f1d4fa4e8bbfde5d98c0b1f8a2/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:48.977706 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17674d3-3cfc-413b-ba04-8907f1b0c7e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c8d9e9b9e5645239d367f3bccd73a07, user_id=591836f1d4fa4e8bbfde5d98c0b1f8a2, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:48.980351 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17674d3-3cfc-413b-ba04-8907f1b0c7e2 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:48.994174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1280/2557] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:51:48 2022] PUT /identity/v3/projects/7c8d9e9b9e5645239d367f3bccd73a07/users/591836f1d4fa4e8bbfde5d98c0b1f8a2/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:49.005399 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097c74b-e1c5-45b7-a542-a2de363577d7 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:49.005877 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097c74b-e1c5-45b7-a542-a2de363577d7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:49.005877 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097c74b-e1c5-45b7-a542-a2de363577d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:49.033924 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e097c74b-e1c5-45b7-a542-a2de363577d7 None None] MFA Rules not processed for user `591836f1d4fa4e8bbfde5d98c0b1f8a2`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:49.035132 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e097c74b-e1c5-45b7-a542-a2de363577d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:49.089433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:49.111811 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1278/2558] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:49.117604 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17674d3-3cfc-413b-ba04-8907f1b0c7e2 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:49.143017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:49.191008 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17674d3-3cfc-413b-ba04-8907f1b0c7e2 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:49.196396 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27622088-aabe-48da-a3e0-3a8bdacc9670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:49.197031 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27622088-aabe-48da-a3e0-3a8bdacc9670 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:49.197309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27622088-aabe-48da-a3e0-3a8bdacc9670 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:49.197580 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27622088-aabe-48da-a3e0-3a8bdacc9670 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:49.198207 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27622088-aabe-48da-a3e0-3a8bdacc9670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:49.200180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27622088-aabe-48da-a3e0-3a8bdacc9670 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:49.228370 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1281/2559] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:51:49 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:51:49.232569 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097c74b-e1c5-45b7-a542-a2de363577d7 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:49.243344 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097c74b-e1c5-45b7-a542-a2de363577d7 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:49.302748 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a62f5a-261d-4839-af51-52c764e418ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:49.303974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a62f5a-261d-4839-af51-52c764e418ae admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:49.304315 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a62f5a-261d-4839-af51-52c764e418ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:49.304652 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a62f5a-261d-4839-af51-52c764e418ae admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:49.306060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a62f5a-261d-4839-af51-52c764e418ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:49.308391 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a62f5a-261d-4839-af51-52c764e418ae admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:49.330161 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1279/2560] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:51:49 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:51:49.334760 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27622088-aabe-48da-a3e0-3a8bdacc9670 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:49.346315 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27622088-aabe-48da-a3e0-3a8bdacc9670 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:49.351512 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfefd9-7732-4a5b-b673-6b96c6f4f20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:49.352106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfefd9-7732-4a5b-b673-6b96c6f4f20d admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:49.352389 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfefd9-7732-4a5b-b673-6b96c6f4f20d admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:49.352695 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfefd9-7732-4a5b-b673-6b96c6f4f20d admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:49.353337 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfefd9-7732-4a5b-b673-6b96c6f4f20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:49.354912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfefd9-7732-4a5b-b673-6b96c6f4f20d admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:49.365235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1282/2561] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 10:51:49.369720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a62f5a-261d-4839-af51-52c764e418ae admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:49.379443 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a62f5a-261d-4839-af51-52c764e418ae admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:49.384049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8133225-f379-42a1-a49f-cd4fa11db34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:49.384676 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8133225-f379-42a1-a49f-cd4fa11db34e admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:49.384955 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8133225-f379-42a1-a49f-cd4fa11db34e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:49.385225 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8133225-f379-42a1-a49f-cd4fa11db34e admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:49.385857 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8133225-f379-42a1-a49f-cd4fa11db34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:49.387422 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8133225-f379-42a1-a49f-cd4fa11db34e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:49.397236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1280/2562] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:51:49.401196 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfefd9-7732-4a5b-b673-6b96c6f4f20d admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:49.412209 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfefd9-7732-4a5b-b673-6b96c6f4f20d admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:49.417244 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcf3fa-3288-4aa3-a36d-934ae574b434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:49.417883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcf3fa-3288-4aa3-a36d-934ae574b434 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:49.418160 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcf3fa-3288-4aa3-a36d-934ae574b434 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:49.418433 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcf3fa-3288-4aa3-a36d-934ae574b434 admin admin] PATH_INFO: `/v3/projects/f63774870df5433d9a0347cbfd2ae95e/users/0798f6aaa9124089a80ff07007b92263/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:49.434045 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcf3fa-3288-4aa3-a36d-934ae574b434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63774870df5433d9a0347cbfd2ae95e, user_id=0798f6aaa9124089a80ff07007b92263, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:49.436732 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcf3fa-3288-4aa3-a36d-934ae574b434 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:49.451395 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1283/2563] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:51:49 2022] PUT /identity/v3/projects/f63774870df5433d9a0347cbfd2ae95e/users/0798f6aaa9124089a80ff07007b92263/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:49.461610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4759f-deae-4b90-8b9b-3128a7d7faa8 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:49.462156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4759f-deae-4b90-8b9b-3128a7d7faa8 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:49.462431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4759f-deae-4b90-8b9b-3128a7d7faa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:49.490449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-73a4759f-deae-4b90-8b9b-3128a7d7faa8 None None] MFA Rules not processed for user `0798f6aaa9124089a80ff07007b92263`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:49.492249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-73a4759f-deae-4b90-8b9b-3128a7d7faa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:49.553210 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1281/2564] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:49.557954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcf3fa-3288-4aa3-a36d-934ae574b434 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:49.618451 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcf3fa-3288-4aa3-a36d-934ae574b434 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:49.623114 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bab6a0-fa79-48e9-9836-4695ff1019bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:49.623714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab6a0-fa79-48e9-9836-4695ff1019bb admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:49.623994 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab6a0-fa79-48e9-9836-4695ff1019bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:49.624265 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab6a0-fa79-48e9-9836-4695ff1019bb admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:49.624926 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bab6a0-fa79-48e9-9836-4695ff1019bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:49.626810 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bab6a0-fa79-48e9-9836-4695ff1019bb admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:49.653429 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1284/2565] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:51:49 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:51:49.657499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4759f-deae-4b90-8b9b-3128a7d7faa8 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:49.668079 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4759f-deae-4b90-8b9b-3128a7d7faa8 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:49.733311 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0fdfb-d85a-4ecf-8b0e-c11ac8fd7e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:49.733917 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0fdfb-d85a-4ecf-8b0e-c11ac8fd7e50 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:49.734221 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0fdfb-d85a-4ecf-8b0e-c11ac8fd7e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:49.734490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0fdfb-d85a-4ecf-8b0e-c11ac8fd7e50 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:49.735120 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0fdfb-d85a-4ecf-8b0e-c11ac8fd7e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:49.737022 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0fdfb-d85a-4ecf-8b0e-c11ac8fd7e50 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:49.745711 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:49.761048 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1282/2566] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:51:49 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:51:49.764883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bab6a0-fa79-48e9-9836-4695ff1019bb admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:49.775826 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bab6a0-fa79-48e9-9836-4695ff1019bb admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:49.780855 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e7a90-2d90-4a73-a418-1e7b61ad35c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:49.781449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e7a90-2d90-4a73-a418-1e7b61ad35c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:49.781730 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e7a90-2d90-4a73-a418-1e7b61ad35c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:49.782259 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e7a90-2d90-4a73-a418-1e7b61ad35c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:49.783171 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e7a90-2d90-4a73-a418-1e7b61ad35c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:49.784811 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e7a90-2d90-4a73-a418-1e7b61ad35c8 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:49.799221 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1285/2567] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:51:49.800634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0fdfb-d85a-4ecf-8b0e-c11ac8fd7e50 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:49.810564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0fdfb-d85a-4ecf-8b0e-c11ac8fd7e50 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:49.815339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687de0e-c350-4c9b-926a-89b520f3d8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:49.816002 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687de0e-c350-4c9b-926a-89b520f3d8e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:49.816282 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687de0e-c350-4c9b-926a-89b520f3d8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:49.816612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687de0e-c350-4c9b-926a-89b520f3d8e5 admin admin] PATH_INFO: `/v3/projects/83a46b06f6ed4ff79652c84adf6a63a5/users/f7f87f5e6fff460297441124699012d5/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:49.834088 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687de0e-c350-4c9b-926a-89b520f3d8e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a46b06f6ed4ff79652c84adf6a63a5, user_id=f7f87f5e6fff460297441124699012d5, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:49.837605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687de0e-c350-4c9b-926a-89b520f3d8e5 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:49.851519 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1283/2568] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:51:49 2022] PUT /identity/v3/projects/83a46b06f6ed4ff79652c84adf6a63a5/users/f7f87f5e6fff460297441124699012d5/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:51:49.855809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e7a90-2d90-4a73-a418-1e7b61ad35c8 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:49.866159 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e7a90-2d90-4a73-a418-1e7b61ad35c8 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:49.909246 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:49.937826 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2566f-3075-47f4-9d12-118b30212724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:49.938442 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2566f-3075-47f4-9d12-118b30212724 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:49.938731 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2566f-3075-47f4-9d12-118b30212724 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:49.938994 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2566f-3075-47f4-9d12-118b30212724 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:49.939789 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2566f-3075-47f4-9d12-118b30212724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:49.941401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2566f-3075-47f4-9d12-118b30212724 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:49.952197 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1286/2569] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:51:49.956609 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687de0e-c350-4c9b-926a-89b520f3d8e5 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:49.967000 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687de0e-c350-4c9b-926a-89b520f3d8e5 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:49.971794 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540cdcd-34e3-443d-bf1f-b5b04a3368cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:49.972519 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540cdcd-34e3-443d-bf1f-b5b04a3368cf admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:49.972831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540cdcd-34e3-443d-bf1f-b5b04a3368cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:49.973104 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540cdcd-34e3-443d-bf1f-b5b04a3368cf admin admin] PATH_INFO: `/v3/projects/83a46b06f6ed4ff79652c84adf6a63a5/users/f7f87f5e6fff460297441124699012d5/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:49.975039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540cdcd-34e3-443d-bf1f-b5b04a3368cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a46b06f6ed4ff79652c84adf6a63a5, user_id=f7f87f5e6fff460297441124699012d5, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:49.977706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540cdcd-34e3-443d-bf1f-b5b04a3368cf admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:49.990713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1284/2570] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:51:49 2022] PUT /identity/v3/projects/83a46b06f6ed4ff79652c84adf6a63a5/users/f7f87f5e6fff460297441124699012d5/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:50.001494 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac6054-d4f3-44e2-8385-28399009238e None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:50.001893 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac6054-d4f3-44e2-8385-28399009238e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:50.002173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac6054-d4f3-44e2-8385-28399009238e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:50.030511 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-06ac6054-d4f3-44e2-8385-28399009238e None None] MFA Rules not processed for user `f7f87f5e6fff460297441124699012d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:50.031903 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-06ac6054-d4f3-44e2-8385-28399009238e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:50.106899 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1287/2571] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:50.118584 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540cdcd-34e3-443d-bf1f-b5b04a3368cf admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:50.120257 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c540cdcd-34e3-443d-bf1f-b5b04a3368cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:50.179088 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540cdcd-34e3-443d-bf1f-b5b04a3368cf admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:50.182799 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1fa38-76d1-4d45-8151-f469053af772 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:50.183408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1fa38-76d1-4d45-8151-f469053af772 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:50.183690 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1fa38-76d1-4d45-8151-f469053af772 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:50.183963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1fa38-76d1-4d45-8151-f469053af772 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:50.242933 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1fa38-76d1-4d45-8151-f469053af772 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:50.244500 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1fa38-76d1-4d45-8151-f469053af772 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:50.253632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1285/2572] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:51:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:51:51.768468 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac6054-d4f3-44e2-8385-28399009238e None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:51.778941 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac6054-d4f3-44e2-8385-28399009238e None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:51.782605 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c07be2-c247-4dda-acc3-35db15fca408 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:51.783203 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c07be2-c247-4dda-acc3-35db15fca408 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:51.783485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c07be2-c247-4dda-acc3-35db15fca408 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:51.783760 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c07be2-c247-4dda-acc3-35db15fca408 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:51.858277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c07be2-c247-4dda-acc3-35db15fca408 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:51.859881 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c07be2-c247-4dda-acc3-35db15fca408 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:51.869961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1288/2573] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:51:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:51:52.469917 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1fa38-76d1-4d45-8151-f469053af772 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:52.479096 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1fa38-76d1-4d45-8151-f469053af772 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:52.491732 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee499df-63a9-444c-a851-2c45cfa5a876 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:52.492508 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee499df-63a9-444c-a851-2c45cfa5a876 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:52.492774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee499df-63a9-444c-a851-2c45cfa5a876 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:52.493016 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee499df-63a9-444c-a851-2c45cfa5a876 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:52.515504 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee499df-63a9-444c-a851-2c45cfa5a876 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:52.517066 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee499df-63a9-444c-a851-2c45cfa5a876 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:52.541087 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1286/2574] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:51:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 10:51:55.769581 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e654f9-ba36-4fde-8300-1751e7ba8c83 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:55.770050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e654f9-ba36-4fde-8300-1751e7ba8c83 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:55.770164 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e654f9-ba36-4fde-8300-1751e7ba8c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:55.795803 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-f7e654f9-ba36-4fde-8300-1751e7ba8c83 None None] MFA Rules not processed for user `bdc800f1d4174b5cba4f6f496207ec95`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:55.797051 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f7e654f9-ba36-4fde-8300-1751e7ba8c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:55.860294 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1289/2575] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 10:51:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:51:55.907567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee499df-63a9-444c-a851-2c45cfa5a876 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:55.909012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cee499df-63a9-444c-a851-2c45cfa5a876 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:55.962778 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:55.980829 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee499df-63a9-444c-a851-2c45cfa5a876 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:55.985720 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b97d58-3808-405e-9e67-9ebbb03777c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ff72290fd14ddaba6ed757051e182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:55.986322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b97d58-3808-405e-9e67-9ebbb03777c2 service swift] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:55.986602 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b97d58-3808-405e-9e67-9ebbb03777c2 service swift] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:55.986871 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b97d58-3808-405e-9e67-9ebbb03777c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:55.994910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b97d58-3808-405e-9e67-9ebbb03777c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:55.996460 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b97d58-3808-405e-9e67-9ebbb03777c2 service swift] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:56.004250 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1287/2576] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 10:51:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 10:51:56.592116 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e654f9-ba36-4fde-8300-1751e7ba8c83 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:56.602824 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:56.699049 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e654f9-ba36-4fde-8300-1751e7ba8c83 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:56.718599 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4efeb8-4184-43c6-b36b-9a01e6c3310d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:56.719856 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4efeb8-4184-43c6-b36b-9a01e6c3310d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:56.720263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4efeb8-4184-43c6-b36b-9a01e6c3310d admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:56.721002 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4efeb8-4184-43c6-b36b-9a01e6c3310d admin admin] PATH_INFO: `/v3/users/591836f1d4fa4e8bbfde5d98c0b1f8a2` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:56.727330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4efeb8-4184-43c6-b36b-9a01e6c3310d admin admin] RBAC: Authorizing `identity:delete_user(user_id=591836f1d4fa4e8bbfde5d98c0b1f8a2)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:56.729670 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4efeb8-4184-43c6-b36b-9a01e6c3310d admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:56.792658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9b4efeb8-4184-43c6-b36b-9a01e6c3310d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '591836f1d4fa4e8bbfde5d98c0b1f8a2'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:56.803865 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9b4efeb8-4184-43c6-b36b-9a01e6c3310d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '591836f1d4fa4e8bbfde5d98c0b1f8a2'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:56.804677 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9b4efeb8-4184-43c6-b36b-9a01e6c3310d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '591836f1d4fa4e8bbfde5d98c0b1f8a2'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:56.805385 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9b4efeb8-4184-43c6-b36b-9a01e6c3310d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '591836f1d4fa4e8bbfde5d98c0b1f8a2'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:56.833513 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-9b4efeb8-4184-43c6-b36b-9a01e6c3310d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '591836f1d4fa4e8bbfde5d98c0b1f8a2'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:56.861208 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1290/2577] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:51:56 2022] DELETE /identity/v3/users/591836f1d4fa4e8bbfde5d98c0b1f8a2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:56.866458 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052352d-5be0-4f66-a0a1-998abcd79d6d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:56.867110 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052352d-5be0-4f66-a0a1-998abcd79d6d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:56.867452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052352d-5be0-4f66-a0a1-998abcd79d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:56.892128 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-0052352d-5be0-4f66-a0a1-998abcd79d6d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:56.893791 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0052352d-5be0-4f66-a0a1-998abcd79d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:56.968352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1288/2578] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:56.979957 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4efeb8-4184-43c6-b36b-9a01e6c3310d admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:56.982354 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9b4efeb8-4184-43c6-b36b-9a01e6c3310d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:57.078083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4efeb8-4184-43c6-b36b-9a01e6c3310d admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:57.081713 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91002261-2859-4a12-81df-6410c142f0ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:57.082355 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91002261-2859-4a12-81df-6410c142f0ea service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:57.082641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91002261-2859-4a12-81df-6410c142f0ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:57.082920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91002261-2859-4a12-81df-6410c142f0ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:57.094679 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91002261-2859-4a12-81df-6410c142f0ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:57.096181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91002261-2859-4a12-81df-6410c142f0ea service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:57.108658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1291/2579] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:51:57.474100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052352d-5be0-4f66-a0a1-998abcd79d6d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:57.476355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0052352d-5be0-4f66-a0a1-998abcd79d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:57.500954 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052352d-5be0-4f66-a0a1-998abcd79d6d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:57.513349 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3b7b4-c810-4a79-b80d-ce607dd5eca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:57.514012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3b7b4-c810-4a79-b80d-ce607dd5eca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:57.514295 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3b7b4-c810-4a79-b80d-ce607dd5eca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:57.514564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3b7b4-c810-4a79-b80d-ce607dd5eca0 admin admin] PATH_INFO: `/v3/projects/7c8d9e9b9e5645239d367f3bccd73a07` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:57.516323 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3b7b4-c810-4a79-b80d-ce607dd5eca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c8d9e9b9e5645239d367f3bccd73a07)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:57.522433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3b7b4-c810-4a79-b80d-ce607dd5eca0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:57.602774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-27c3b7b4-c810-4a79-b80d-ce607dd5eca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c8d9e9b9e5645239d367f3bccd73a07', 'request_id': 'req-27c3b7b4-c810-4a79-b80d-ce607dd5eca0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:57.609330 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-27c3b7b4-c810-4a79-b80d-ce607dd5eca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c8d9e9b9e5645239d367f3bccd73a07', 'request_id': 'req-27c3b7b4-c810-4a79-b80d-ce607dd5eca0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:57.619636 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-27c3b7b4-c810-4a79-b80d-ce607dd5eca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c8d9e9b9e5645239d367f3bccd73a07', 'request_id': 'req-27c3b7b4-c810-4a79-b80d-ce607dd5eca0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:57.632656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-27c3b7b4-c810-4a79-b80d-ce607dd5eca0 admin admin] The token cache is being invalidate because project 7c8d9e9b9e5645239d367f3bccd73a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:51:57.633018 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-27c3b7b4-c810-4a79-b80d-ce607dd5eca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:57.633612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-27c3b7b4-c810-4a79-b80d-ce607dd5eca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:57.635904 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1289/2580] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:51:57 2022] DELETE /identity/v3/projects/7c8d9e9b9e5645239d367f3bccd73a07 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:57.639626 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91002261-2859-4a12-81df-6410c142f0ea service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:57.649965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91002261-2859-4a12-81df-6410c142f0ea service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:57.677609 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:57.731457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ac7fd-16c3-40b4-93cf-20c6b139427f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:57.732689 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ac7fd-16c3-40b4-93cf-20c6b139427f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:57.732974 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ac7fd-16c3-40b4-93cf-20c6b139427f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:57.733246 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ac7fd-16c3-40b4-93cf-20c6b139427f admin admin] PATH_INFO: `/v3/users/0798f6aaa9124089a80ff07007b92263` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:57.734411 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ac7fd-16c3-40b4-93cf-20c6b139427f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0798f6aaa9124089a80ff07007b92263)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:57.736437 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ac7fd-16c3-40b4-93cf-20c6b139427f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:57.797904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bb6ac7fd-16c3-40b4-93cf-20c6b139427f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0798f6aaa9124089a80ff07007b92263'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:57.811084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bb6ac7fd-16c3-40b4-93cf-20c6b139427f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0798f6aaa9124089a80ff07007b92263'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:57.812994 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bb6ac7fd-16c3-40b4-93cf-20c6b139427f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0798f6aaa9124089a80ff07007b92263'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:57.813626 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bb6ac7fd-16c3-40b4-93cf-20c6b139427f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0798f6aaa9124089a80ff07007b92263'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:57.822691 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bb6ac7fd-16c3-40b4-93cf-20c6b139427f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0798f6aaa9124089a80ff07007b92263'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:57.847293 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1292/2581] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:51:57 2022] DELETE /identity/v3/users/0798f6aaa9124089a80ff07007b92263 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:58.055944 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3b7b4-c810-4a79-b80d-ce607dd5eca0 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:58.057538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-27c3b7b4-c810-4a79-b80d-ce607dd5eca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:58.169273 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3b7b4-c810-4a79-b80d-ce607dd5eca0 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:58.214879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:58.242884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ac7fd-16c3-40b4-93cf-20c6b139427f admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:58.245527 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-bb6ac7fd-16c3-40b4-93cf-20c6b139427f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:58.288219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde09dc-40d7-403c-bb37-4d8cc8ee103a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:58.288928 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde09dc-40d7-403c-bb37-4d8cc8ee103a service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:58.289213 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde09dc-40d7-403c-bb37-4d8cc8ee103a service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:58.289486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde09dc-40d7-403c-bb37-4d8cc8ee103a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:58.291851 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7cde09dc-40d7-403c-bb37-4d8cc8ee103a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:58.362987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ac7fd-16c3-40b4-93cf-20c6b139427f admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:58.369160 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0d277-b4bb-4608-84b1-e799684ed6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:58.373982 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0d277-b4bb-4608-84b1-e799684ed6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:58.374267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0d277-b4bb-4608-84b1-e799684ed6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:58.374694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0d277-b4bb-4608-84b1-e799684ed6c3 admin admin] PATH_INFO: `/v3/projects/f63774870df5433d9a0347cbfd2ae95e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:58.377291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0d277-b4bb-4608-84b1-e799684ed6c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f63774870df5433d9a0347cbfd2ae95e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:58.379585 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0d277-b4bb-4608-84b1-e799684ed6c3 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:58.384076 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde09dc-40d7-403c-bb37-4d8cc8ee103a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:58.385833 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde09dc-40d7-403c-bb37-4d8cc8ee103a service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:58.398687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1290/2582] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:51:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:51:58.448239 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a1a0d277-b4bb-4608-84b1-e799684ed6c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f63774870df5433d9a0347cbfd2ae95e', 'request_id': 'req-a1a0d277-b4bb-4608-84b1-e799684ed6c3'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:58.449878 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:58.459923 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a1a0d277-b4bb-4608-84b1-e799684ed6c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f63774870df5433d9a0347cbfd2ae95e', 'request_id': 'req-a1a0d277-b4bb-4608-84b1-e799684ed6c3'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:58.471796 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a1a0d277-b4bb-4608-84b1-e799684ed6c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f63774870df5433d9a0347cbfd2ae95e', 'request_id': 'req-a1a0d277-b4bb-4608-84b1-e799684ed6c3'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:58.489018 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a1a0d277-b4bb-4608-84b1-e799684ed6c3 admin admin] The token cache is being invalidate because project f63774870df5433d9a0347cbfd2ae95e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:51:58.489587 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a1a0d277-b4bb-4608-84b1-e799684ed6c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:58.491301 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a1a0d277-b4bb-4608-84b1-e799684ed6c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:58.493828 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1293/2583] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:51:58 2022] DELETE /identity/v3/projects/f63774870df5433d9a0347cbfd2ae95e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:58.497970 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde09dc-40d7-403c-bb37-4d8cc8ee103a service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:58.508721 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde09dc-40d7-403c-bb37-4d8cc8ee103a service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:58.588599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38eb149-8924-4665-af4b-573b411658f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:58.589244 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38eb149-8924-4665-af4b-573b411658f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:58.589525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38eb149-8924-4665-af4b-573b411658f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:58.589803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38eb149-8924-4665-af4b-573b411658f3 admin admin] PATH_INFO: `/v3/users/f7f87f5e6fff460297441124699012d5` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:58.590953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38eb149-8924-4665-af4b-573b411658f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7f87f5e6fff460297441124699012d5)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:58.594007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38eb149-8924-4665-af4b-573b411658f3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:58.668213 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b38eb149-8924-4665-af4b-573b411658f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7f87f5e6fff460297441124699012d5'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:58.679348 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b38eb149-8924-4665-af4b-573b411658f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7f87f5e6fff460297441124699012d5'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:58.680096 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b38eb149-8924-4665-af4b-573b411658f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7f87f5e6fff460297441124699012d5'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:58.680876 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b38eb149-8924-4665-af4b-573b411658f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7f87f5e6fff460297441124699012d5'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:58.695044 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b38eb149-8924-4665-af4b-573b411658f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7f87f5e6fff460297441124699012d5'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:58.704304 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:51:58.739623 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1291/2584] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:51:58 2022] DELETE /identity/v3/users/f7f87f5e6fff460297441124699012d5 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:51:59.205056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0d277-b4bb-4608-84b1-e799684ed6c3 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:59.206674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a1a0d277-b4bb-4608-84b1-e799684ed6c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:59.222886 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0d277-b4bb-4608-84b1-e799684ed6c3 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:59.317589 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa663a0-0a45-4643-90a7-55e428b10e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:59.318259 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa663a0-0a45-4643-90a7-55e428b10e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:59.318673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa663a0-0a45-4643-90a7-55e428b10e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:59.319121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa663a0-0a45-4643-90a7-55e428b10e48 admin admin] PATH_INFO: `/v3/projects/83a46b06f6ed4ff79652c84adf6a63a5` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:59.320422 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa663a0-0a45-4643-90a7-55e428b10e48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a46b06f6ed4ff79652c84adf6a63a5)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:59.322479 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa663a0-0a45-4643-90a7-55e428b10e48 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:59.407583 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4aa663a0-0a45-4643-90a7-55e428b10e48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a46b06f6ed4ff79652c84adf6a63a5', 'request_id': 'req-4aa663a0-0a45-4643-90a7-55e428b10e48'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:59.415181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4aa663a0-0a45-4643-90a7-55e428b10e48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a46b06f6ed4ff79652c84adf6a63a5', 'request_id': 'req-4aa663a0-0a45-4643-90a7-55e428b10e48'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:59.428709 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4aa663a0-0a45-4643-90a7-55e428b10e48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a46b06f6ed4ff79652c84adf6a63a5', 'request_id': 'req-4aa663a0-0a45-4643-90a7-55e428b10e48'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:59.456856 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4aa663a0-0a45-4643-90a7-55e428b10e48 admin admin] The token cache is being invalidate because project 83a46b06f6ed4ff79652c84adf6a63a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:51:59.457167 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4aa663a0-0a45-4643-90a7-55e428b10e48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:59.457891 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4aa663a0-0a45-4643-90a7-55e428b10e48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:51:59.464775 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1294/2585] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:51:59 2022] DELETE /identity/v3/projects/83a46b06f6ed4ff79652c84adf6a63a5 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:51:59.466509 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dc9e7-b3f6-44a8-a52f-146c2e1a8b51 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:59.466964 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dc9e7-b3f6-44a8-a52f-146c2e1a8b51 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:59.467214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dc9e7-b3f6-44a8-a52f-146c2e1a8b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:59.494816 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-1d8dc9e7-b3f6-44a8-a52f-146c2e1a8b51 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:59.496161 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1d8dc9e7-b3f6-44a8-a52f-146c2e1a8b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:59.574187 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1292/2586] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:59.640937 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847712e-3a43-435a-b559-85828aa257ba None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:59.641808 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847712e-3a43-435a-b559-85828aa257ba None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:59.642425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847712e-3a43-435a-b559-85828aa257ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:59.677353 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-2847712e-3a43-435a-b559-85828aa257ba None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:51:59.678995 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2847712e-3a43-435a-b559-85828aa257ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:51:59.688019 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1295/2587] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:51:59.692251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dc9e7-b3f6-44a8-a52f-146c2e1a8b51 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:59.719142 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dc9e7-b3f6-44a8-a52f-146c2e1a8b51 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:59.738705 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41190218-058e-42ff-844f-621da34651ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:59.741301 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41190218-058e-42ff-844f-621da34651ed admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:59.741600 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41190218-058e-42ff-844f-621da34651ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:59.741879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41190218-058e-42ff-844f-621da34651ed admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:59.742557 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41190218-058e-42ff-844f-621da34651ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:51:59.743493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41190218-058e-42ff-844f-621da34651ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:59.745151 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41190218-058e-42ff-844f-621da34651ed admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:59.772115 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1293/2588] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:51:59.777507 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847712e-3a43-435a-b559-85828aa257ba None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:59.790195 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847712e-3a43-435a-b559-85828aa257ba None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:59.795556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29be54-2561-4cfc-b70d-49714ae940a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:59.796169 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29be54-2561-4cfc-b70d-49714ae940a7 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:59.796452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29be54-2561-4cfc-b70d-49714ae940a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:59.796973 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29be54-2561-4cfc-b70d-49714ae940a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:59.797618 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29be54-2561-4cfc-b70d-49714ae940a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:59.799519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29be54-2561-4cfc-b70d-49714ae940a7 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:51:59.853129 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41190218-058e-42ff-844f-621da34651ed admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:51:59.860763 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1296/2589] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:51:59 2022] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:51:59.865706 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41190218-058e-42ff-844f-621da34651ed admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:51:59.977468 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422138c-a7e0-4bff-92f8-4c0705b71039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:51:59.978104 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422138c-a7e0-4bff-92f8-4c0705b71039 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:51:59.978442 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422138c-a7e0-4bff-92f8-4c0705b71039 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:51:59.978724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422138c-a7e0-4bff-92f8-4c0705b71039 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:51:59.979365 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422138c-a7e0-4bff-92f8-4c0705b71039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:51:59.981367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422138c-a7e0-4bff-92f8-4c0705b71039 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:00.016492 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29be54-2561-4cfc-b70d-49714ae940a7 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:00.023849 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1294/2590] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:51:59 2022] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:52:00.031470 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29be54-2561-4cfc-b70d-49714ae940a7 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:00.044891 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc14ff-be22-43b4-9cd9-3e4e523590d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:00.045741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc14ff-be22-43b4-9cd9-3e4e523590d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:00.046154 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc14ff-be22-43b4-9cd9-3e4e523590d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:00.046876 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc14ff-be22-43b4-9cd9-3e4e523590d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:00.048109 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc14ff-be22-43b4-9cd9-3e4e523590d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:00.049932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc14ff-be22-43b4-9cd9-3e4e523590d7 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:00.066912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1297/2591] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:52:00.070949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422138c-a7e0-4bff-92f8-4c0705b71039 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:00.090047 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422138c-a7e0-4bff-92f8-4c0705b71039 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:00.101071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e1867-cdb3-4602-96d7-f487cccefd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:00.101900 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e1867-cdb3-4602-96d7-f487cccefd12 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:00.102295 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e1867-cdb3-4602-96d7-f487cccefd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:00.102637 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e1867-cdb3-4602-96d7-f487cccefd12 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:00.103421 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e1867-cdb3-4602-96d7-f487cccefd12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:00.105195 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e1867-cdb3-4602-96d7-f487cccefd12 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:00.126946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1295/2592] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:52:00.127824 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc14ff-be22-43b4-9cd9-3e4e523590d7 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:00.142280 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc14ff-be22-43b4-9cd9-3e4e523590d7 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:00.165929 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6f467-c217-4c09-ab6b-806d87d7b7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:00.166872 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6f467-c217-4c09-ab6b-806d87d7b7dc admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:00.167251 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6f467-c217-4c09-ab6b-806d87d7b7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:00.167625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6f467-c217-4c09-ab6b-806d87d7b7dc admin admin] PATH_INFO: `/v3/projects/abcb84d457404e25b96d725a8b723e8e/users/3b253144389c4fe0a906f195c9e843cd/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:00.189744 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6f467-c217-4c09-ab6b-806d87d7b7dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=abcb84d457404e25b96d725a8b723e8e, user_id=3b253144389c4fe0a906f195c9e843cd, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:00.193153 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6f467-c217-4c09-ab6b-806d87d7b7dc admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:00.232994 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1298/2593] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:52:00 2022] PUT /identity/v3/projects/abcb84d457404e25b96d725a8b723e8e/users/3b253144389c4fe0a906f195c9e843cd/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:52:00.236588 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238f912-e7b0-469c-94f2-5802004c69bf None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:00.237220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238f912-e7b0-469c-94f2-5802004c69bf None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:00.237634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238f912-e7b0-469c-94f2-5802004c69bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:00.277799 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-1238f912-e7b0-469c-94f2-5802004c69bf None None] MFA Rules not processed for user `3b253144389c4fe0a906f195c9e843cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:00.279176 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1238f912-e7b0-469c-94f2-5802004c69bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:00.355608 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:00.395137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1296/2594] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:00.405330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6f467-c217-4c09-ab6b-806d87d7b7dc admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:00.407306 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9ad6f467-c217-4c09-ab6b-806d87d7b7dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:00.426621 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:00.528775 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6f467-c217-4c09-ab6b-806d87d7b7dc admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:00.535380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ecdbd-0e06-411c-8746-18dcf098bbb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:00.538133 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ecdbd-0e06-411c-8746-18dcf098bbb4 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:00.538415 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ecdbd-0e06-411c-8746-18dcf098bbb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:00.540265 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ecdbd-0e06-411c-8746-18dcf098bbb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:00.554077 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ecdbd-0e06-411c-8746-18dcf098bbb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:00.555530 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ecdbd-0e06-411c-8746-18dcf098bbb4 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:00.567719 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1299/2595] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:03.248252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238f912-e7b0-469c-94f2-5802004c69bf None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:03.257412 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1238f912-e7b0-469c-94f2-5802004c69bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:03.381968 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238f912-e7b0-469c-94f2-5802004c69bf None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:03.392399 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebbdae-7c80-4924-b7a6-25a05271caf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:03.393342 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebbdae-7c80-4924-b7a6-25a05271caf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:03.393777 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebbdae-7c80-4924-b7a6-25a05271caf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:03.394259 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebbdae-7c80-4924-b7a6-25a05271caf6 admin admin] PATH_INFO: `/v3/users/2465a3ec985c4bacb213ad86ad45ab8f` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:03.395900 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebbdae-7c80-4924-b7a6-25a05271caf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2465a3ec985c4bacb213ad86ad45ab8f)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:03.398372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebbdae-7c80-4924-b7a6-25a05271caf6 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:03.482510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-faebbdae-7c80-4924-b7a6-25a05271caf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2465a3ec985c4bacb213ad86ad45ab8f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:03.496510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-faebbdae-7c80-4924-b7a6-25a05271caf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2465a3ec985c4bacb213ad86ad45ab8f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:03.497364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-faebbdae-7c80-4924-b7a6-25a05271caf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2465a3ec985c4bacb213ad86ad45ab8f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:03.498012 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-faebbdae-7c80-4924-b7a6-25a05271caf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2465a3ec985c4bacb213ad86ad45ab8f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:03.507316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-faebbdae-7c80-4924-b7a6-25a05271caf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2465a3ec985c4bacb213ad86ad45ab8f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:03.531144 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1297/2596] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:52:03 2022] DELETE /identity/v3/users/2465a3ec985c4bacb213ad86ad45ab8f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:03.745881 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ecdbd-0e06-411c-8746-18dcf098bbb4 service cinder] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:03.757893 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ecdbd-0e06-411c-8746-18dcf098bbb4 service cinder] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:03.828667 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735dbdc-be11-44d0-8dd6-ac7a43c6393c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:03.829643 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735dbdc-be11-44d0-8dd6-ac7a43c6393c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:03.829911 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735dbdc-be11-44d0-8dd6-ac7a43c6393c admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:03.830174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735dbdc-be11-44d0-8dd6-ac7a43c6393c admin admin] PATH_INFO: `/v3/projects/91960c42649a4d50a5080f5cc9482e0c` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:03.831404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735dbdc-be11-44d0-8dd6-ac7a43c6393c admin admin] RBAC: Authorizing `identity:delete_project(project_id=91960c42649a4d50a5080f5cc9482e0c)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:03.833409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735dbdc-be11-44d0-8dd6-ac7a43c6393c admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:03.889291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3735dbdc-be11-44d0-8dd6-ac7a43c6393c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91960c42649a4d50a5080f5cc9482e0c', 'request_id': 'req-3735dbdc-be11-44d0-8dd6-ac7a43c6393c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:03.896697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3735dbdc-be11-44d0-8dd6-ac7a43c6393c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91960c42649a4d50a5080f5cc9482e0c', 'request_id': 'req-3735dbdc-be11-44d0-8dd6-ac7a43c6393c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:03.910622 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3735dbdc-be11-44d0-8dd6-ac7a43c6393c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91960c42649a4d50a5080f5cc9482e0c', 'request_id': 'req-3735dbdc-be11-44d0-8dd6-ac7a43c6393c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:03.923609 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3735dbdc-be11-44d0-8dd6-ac7a43c6393c admin admin] The token cache is being invalidate because project 91960c42649a4d50a5080f5cc9482e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:52:03.923976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3735dbdc-be11-44d0-8dd6-ac7a43c6393c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:03.924654 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3735dbdc-be11-44d0-8dd6-ac7a43c6393c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:03.929618 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1300/2597] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:52:03 2022] DELETE /identity/v3/projects/91960c42649a4d50a5080f5cc9482e0c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:03.931662 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983dc7c-263d-47e6-9098-adcb5c6f97a6 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:03.931969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983dc7c-263d-47e6-9098-adcb5c6f97a6 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:03.932272 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983dc7c-263d-47e6-9098-adcb5c6f97a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:03.955054 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2983dc7c-263d-47e6-9098-adcb5c6f97a6 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:03.956300 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2983dc7c-263d-47e6-9098-adcb5c6f97a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:04.069548 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1298/2598] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:04.077829 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aba00-8844-41b8-9bab-1858ee749bd0 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:04.078471 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aba00-8844-41b8-9bab-1858ee749bd0 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:04.079109 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aba00-8844-41b8-9bab-1858ee749bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:04.104013 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-8f9aba00-8844-41b8-9bab-1858ee749bd0 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:04.105541 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8f9aba00-8844-41b8-9bab-1858ee749bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:04.120474 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1301/2599] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:04.125393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983dc7c-263d-47e6-9098-adcb5c6f97a6 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:04.138109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983dc7c-263d-47e6-9098-adcb5c6f97a6 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:04.148321 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87330d-7b69-4d77-8a40-1bfa2b5eb777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:04.150337 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87330d-7b69-4d77-8a40-1bfa2b5eb777 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:04.151453 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87330d-7b69-4d77-8a40-1bfa2b5eb777 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:04.151798 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87330d-7b69-4d77-8a40-1bfa2b5eb777 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:04.153111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87330d-7b69-4d77-8a40-1bfa2b5eb777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:52:04.156046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87330d-7b69-4d77-8a40-1bfa2b5eb777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:04.157813 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87330d-7b69-4d77-8a40-1bfa2b5eb777 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:04.159803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:04.184891 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aba00-8844-41b8-9bab-1858ee749bd0 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:04.193195 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1299/2600] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:52:04.199829 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aba00-8844-41b8-9bab-1858ee749bd0 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:04.206711 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b9e83-c037-4e23-8c7f-30ab3ee14cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:04.207649 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b9e83-c037-4e23-8c7f-30ab3ee14cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:04.208011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b9e83-c037-4e23-8c7f-30ab3ee14cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:04.208398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b9e83-c037-4e23-8c7f-30ab3ee14cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:04.209785 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b9e83-c037-4e23-8c7f-30ab3ee14cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:04.212211 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b9e83-c037-4e23-8c7f-30ab3ee14cb2 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:04.259924 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87330d-7b69-4d77-8a40-1bfa2b5eb777 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:04.260752 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1302/2601] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:52:04 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:52:04.272742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87330d-7b69-4d77-8a40-1bfa2b5eb777 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:04.379651 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0db98-96c6-4269-a04c-029d05fd46e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:04.380297 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0db98-96c6-4269-a04c-029d05fd46e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:04.380604 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0db98-96c6-4269-a04c-029d05fd46e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:04.381432 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0db98-96c6-4269-a04c-029d05fd46e8 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:04.382071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0db98-96c6-4269-a04c-029d05fd46e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:04.383969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0db98-96c6-4269-a04c-029d05fd46e8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:04.412656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1300/2602] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:52:04 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:52:04.418268 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b9e83-c037-4e23-8c7f-30ab3ee14cb2 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:04.431802 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b9e83-c037-4e23-8c7f-30ab3ee14cb2 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:04.436693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cd6cf-ff04-48bb-b372-c79149a486b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:04.437304 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cd6cf-ff04-48bb-b372-c79149a486b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:04.437581 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cd6cf-ff04-48bb-b372-c79149a486b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:04.437853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cd6cf-ff04-48bb-b372-c79149a486b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:04.438501 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cd6cf-ff04-48bb-b372-c79149a486b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:04.440078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cd6cf-ff04-48bb-b372-c79149a486b0 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:04.443866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:04.457632 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1303/2603] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:52:04.461449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0db98-96c6-4269-a04c-029d05fd46e8 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:04.472498 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0db98-96c6-4269-a04c-029d05fd46e8 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:04.481869 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bcf66-b02b-48e0-939d-50d4ffd42092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:04.482486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bcf66-b02b-48e0-939d-50d4ffd42092 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:04.482763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bcf66-b02b-48e0-939d-50d4ffd42092 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:04.483031 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bcf66-b02b-48e0-939d-50d4ffd42092 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:04.483687 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1bcf66-b02b-48e0-939d-50d4ffd42092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:04.485355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1bcf66-b02b-48e0-939d-50d4ffd42092 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:04.497058 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1301/2604] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:52:04.501586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cd6cf-ff04-48bb-b372-c79149a486b0 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:04.511858 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cd6cf-ff04-48bb-b372-c79149a486b0 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:04.516770 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49668e-c258-47a8-946b-ec7ab355670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:04.517609 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49668e-c258-47a8-946b-ec7ab355670c admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:04.518137 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49668e-c258-47a8-946b-ec7ab355670c admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:04.518410 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49668e-c258-47a8-946b-ec7ab355670c admin admin] PATH_INFO: `/v3/projects/34376e1de5174dfdba6bf954b7b9f8ac/users/50704c1076a9400685736b8681c1f807/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:04.533890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49668e-c258-47a8-946b-ec7ab355670c admin admin] RBAC: Authorizing `identity:create_grant(project_id=34376e1de5174dfdba6bf954b7b9f8ac, user_id=50704c1076a9400685736b8681c1f807, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:04.536672 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49668e-c258-47a8-946b-ec7ab355670c admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:04.551994 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1304/2605] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:52:04 2022] PUT /identity/v3/projects/34376e1de5174dfdba6bf954b7b9f8ac/users/50704c1076a9400685736b8681c1f807/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:52:04.562533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b9afa-0a79-4ebb-9d7a-19c91bbe952b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:04.562820 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b9afa-0a79-4ebb-9d7a-19c91bbe952b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:04.563098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b9afa-0a79-4ebb-9d7a-19c91bbe952b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:04.594935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-651b9afa-0a79-4ebb-9d7a-19c91bbe952b None None] MFA Rules not processed for user `50704c1076a9400685736b8681c1f807`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:04.596387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-651b9afa-0a79-4ebb-9d7a-19c91bbe952b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:04.672638 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1302/2606] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:04.684532 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49668e-c258-47a8-946b-ec7ab355670c admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:04.686574 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2b49668e-c258-47a8-946b-ec7ab355670c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:04.784355 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49668e-c258-47a8-946b-ec7ab355670c admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:04.791296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f70c4-4b25-485b-b877-f9aaa87b7aad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:04.792587 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f70c4-4b25-485b-b877-f9aaa87b7aad service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:04.792587 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f70c4-4b25-485b-b877-f9aaa87b7aad service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:04.792587 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f70c4-4b25-485b-b877-f9aaa87b7aad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:04.804752 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f70c4-4b25-485b-b877-f9aaa87b7aad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:04.806344 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f70c4-4b25-485b-b877-f9aaa87b7aad service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:04.817767 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1305/2607] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:07.827862 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b9afa-0a79-4ebb-9d7a-19c91bbe952b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:07.829298 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-651b9afa-0a79-4ebb-9d7a-19c91bbe952b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:07.891314 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b9afa-0a79-4ebb-9d7a-19c91bbe952b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:07.895016 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce235d-15ab-4a9a-9281-1648b60c5c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:07.895617 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce235d-15ab-4a9a-9281-1648b60c5c71 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:07.895893 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce235d-15ab-4a9a-9281-1648b60c5c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:07.896171 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce235d-15ab-4a9a-9281-1648b60c5c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:07.898387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-91ce235d-15ab-4a9a-9281-1648b60c5c71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:07.911916 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce235d-15ab-4a9a-9281-1648b60c5c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:07.913472 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce235d-15ab-4a9a-9281-1648b60c5c71 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:07.921778 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1303/2608] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:10.172781 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f70c4-4b25-485b-b877-f9aaa87b7aad service nova] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:10.232000 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f70c4-4b25-485b-b877-f9aaa87b7aad service nova] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:10.236519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f8521-aadb-406f-869a-21357eaf61f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:10.237182 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f8521-aadb-406f-869a-21357eaf61f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:10.237486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f8521-aadb-406f-869a-21357eaf61f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:10.237761 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f8521-aadb-406f-869a-21357eaf61f2 admin admin] PATH_INFO: `/v3/users/50704c1076a9400685736b8681c1f807` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:10.238896 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f8521-aadb-406f-869a-21357eaf61f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50704c1076a9400685736b8681c1f807)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:10.240933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f8521-aadb-406f-869a-21357eaf61f2 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:10.290205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bd8f8521-aadb-406f-869a-21357eaf61f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50704c1076a9400685736b8681c1f807'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:10.302690 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bd8f8521-aadb-406f-869a-21357eaf61f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50704c1076a9400685736b8681c1f807'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:10.303381 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bd8f8521-aadb-406f-869a-21357eaf61f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50704c1076a9400685736b8681c1f807'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:10.304053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bd8f8521-aadb-406f-869a-21357eaf61f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50704c1076a9400685736b8681c1f807'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:10.310390 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:10.312174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bd8f8521-aadb-406f-869a-21357eaf61f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50704c1076a9400685736b8681c1f807'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:10.337402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1306/2609] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:52:10 2022] DELETE /identity/v3/users/50704c1076a9400685736b8681c1f807 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:10.342404 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a430b1-7d31-46cb-94cd-d8a2e171d62d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:10.342849 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a430b1-7d31-46cb-94cd-d8a2e171d62d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:10.343391 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a430b1-7d31-46cb-94cd-d8a2e171d62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:10.351932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:10.364231 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-29a430b1-7d31-46cb-94cd-d8a2e171d62d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:10.365673 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-29a430b1-7d31-46cb-94cd-d8a2e171d62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:10.430841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1304/2610] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:10.440675 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f8521-aadb-406f-869a-21357eaf61f2 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:10.442131 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-bd8f8521-aadb-406f-869a-21357eaf61f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:10.503263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f8521-aadb-406f-869a-21357eaf61f2 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:10.507008 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d64999-cab1-4d36-898a-65caa0aa6176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:10.507613 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d64999-cab1-4d36-898a-65caa0aa6176 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:10.507893 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d64999-cab1-4d36-898a-65caa0aa6176 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:10.508163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d64999-cab1-4d36-898a-65caa0aa6176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:10.517510 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d64999-cab1-4d36-898a-65caa0aa6176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:10.519042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d64999-cab1-4d36-898a-65caa0aa6176 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:10.529042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1307/2611] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:10.827417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a430b1-7d31-46cb-94cd-d8a2e171d62d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:10.829026 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-29a430b1-7d31-46cb-94cd-d8a2e171d62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:10.860426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a430b1-7d31-46cb-94cd-d8a2e171d62d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:10.867654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e0674-e418-4420-afbb-5d72d61ee487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:10.868441 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e0674-e418-4420-afbb-5d72d61ee487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:10.868814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e0674-e418-4420-afbb-5d72d61ee487 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:10.869144 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e0674-e418-4420-afbb-5d72d61ee487 admin admin] PATH_INFO: `/v3/projects/34376e1de5174dfdba6bf954b7b9f8ac` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:10.870889 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350e0674-e418-4420-afbb-5d72d61ee487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34376e1de5174dfdba6bf954b7b9f8ac)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:10.873357 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350e0674-e418-4420-afbb-5d72d61ee487 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:10.927175 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-350e0674-e418-4420-afbb-5d72d61ee487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34376e1de5174dfdba6bf954b7b9f8ac', 'request_id': 'req-350e0674-e418-4420-afbb-5d72d61ee487'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:10.937639 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-350e0674-e418-4420-afbb-5d72d61ee487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34376e1de5174dfdba6bf954b7b9f8ac', 'request_id': 'req-350e0674-e418-4420-afbb-5d72d61ee487'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:10.953195 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-350e0674-e418-4420-afbb-5d72d61ee487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34376e1de5174dfdba6bf954b7b9f8ac', 'request_id': 'req-350e0674-e418-4420-afbb-5d72d61ee487'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:10.971256 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-350e0674-e418-4420-afbb-5d72d61ee487 admin admin] The token cache is being invalidate because project 34376e1de5174dfdba6bf954b7b9f8ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:52:10.971612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-350e0674-e418-4420-afbb-5d72d61ee487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:10.972452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-350e0674-e418-4420-afbb-5d72d61ee487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:10.978019 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1305/2612] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:52:10 2022] DELETE /identity/v3/projects/34376e1de5174dfdba6bf954b7b9f8ac => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:10.980985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2707e-a7bc-4b82-ad3d-246a49bfcf0a None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:10.981402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2707e-a7bc-4b82-ad3d-246a49bfcf0a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:10.981773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2707e-a7bc-4b82-ad3d-246a49bfcf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:11.002853 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e2d2707e-a7bc-4b82-ad3d-246a49bfcf0a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:11.004291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e2d2707e-a7bc-4b82-ad3d-246a49bfcf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:11.101001 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1308/2613] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:11.108860 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268bc76-ee32-4d27-b0c6-d33b65e8ffab None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:11.109152 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268bc76-ee32-4d27-b0c6-d33b65e8ffab None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:11.109422 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268bc76-ee32-4d27-b0c6-d33b65e8ffab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:11.132237 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-6268bc76-ee32-4d27-b0c6-d33b65e8ffab None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:11.133650 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6268bc76-ee32-4d27-b0c6-d33b65e8ffab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:11.141657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1306/2614] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:11.145928 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2707e-a7bc-4b82-ad3d-246a49bfcf0a None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:11.156038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2707e-a7bc-4b82-ad3d-246a49bfcf0a None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:11.162287 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc67e5-e340-4866-8f8f-db6dac328c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:11.162948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc67e5-e340-4866-8f8f-db6dac328c23 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:11.163237 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc67e5-e340-4866-8f8f-db6dac328c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:11.163508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc67e5-e340-4866-8f8f-db6dac328c23 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:11.164156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc67e5-e340-4866-8f8f-db6dac328c23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:52:11.164448 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc67e5-e340-4866-8f8f-db6dac328c23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:11.166078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc67e5-e340-4866-8f8f-db6dac328c23 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:11.178605 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1309/2615] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:52:11.183387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268bc76-ee32-4d27-b0c6-d33b65e8ffab None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:11.193830 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268bc76-ee32-4d27-b0c6-d33b65e8ffab None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:11.199051 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c388f1-bb04-494f-ae12-c71d932d2ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:11.199766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c388f1-bb04-494f-ae12-c71d932d2ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:11.199921 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c388f1-bb04-494f-ae12-c71d932d2ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:11.200189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c388f1-bb04-494f-ae12-c71d932d2ce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:11.200853 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c388f1-bb04-494f-ae12-c71d932d2ce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:11.202925 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c388f1-bb04-494f-ae12-c71d932d2ce6 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:11.235982 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1307/2616] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:52:11 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:52:11.240284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc67e5-e340-4866-8f8f-db6dac328c23 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:11.250914 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc67e5-e340-4866-8f8f-db6dac328c23 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:11.311798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004425ef-7f7e-450e-8540-a8e4d8de0c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:11.312432 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004425ef-7f7e-450e-8540-a8e4d8de0c04 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:11.312757 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004425ef-7f7e-450e-8540-a8e4d8de0c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:11.313038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004425ef-7f7e-450e-8540-a8e4d8de0c04 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:11.313691 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004425ef-7f7e-450e-8540-a8e4d8de0c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:11.315626 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004425ef-7f7e-450e-8540-a8e4d8de0c04 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:11.334530 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:11.345484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1310/2617] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:52:11 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:52:11.350342 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c388f1-bb04-494f-ae12-c71d932d2ce6 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:11.361228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c388f1-bb04-494f-ae12-c71d932d2ce6 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:11.366582 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecc6b4-d06c-49b7-9302-450e5e68b881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:11.367333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecc6b4-d06c-49b7-9302-450e5e68b881 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:11.367642 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecc6b4-d06c-49b7-9302-450e5e68b881 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:11.367965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecc6b4-d06c-49b7-9302-450e5e68b881 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:11.368745 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecc6b4-d06c-49b7-9302-450e5e68b881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:11.370608 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecc6b4-d06c-49b7-9302-450e5e68b881 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:11.381131 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1308/2618] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 10:52:11.385181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004425ef-7f7e-450e-8540-a8e4d8de0c04 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:11.395082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004425ef-7f7e-450e-8540-a8e4d8de0c04 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:11.399938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dd666-adf4-416b-83af-936ca4a6df19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:11.400689 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dd666-adf4-416b-83af-936ca4a6df19 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:11.401011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dd666-adf4-416b-83af-936ca4a6df19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:11.401366 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dd666-adf4-416b-83af-936ca4a6df19 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:11.402141 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208dd666-adf4-416b-83af-936ca4a6df19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:11.404007 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208dd666-adf4-416b-83af-936ca4a6df19 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:11.417098 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1311/2619] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:52:11.421208 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecc6b4-d06c-49b7-9302-450e5e68b881 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:11.435213 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecc6b4-d06c-49b7-9302-450e5e68b881 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:11.440595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c7180-5465-47b8-8d35-b9281123ed6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:11.441419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c7180-5465-47b8-8d35-b9281123ed6f admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:11.441795 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c7180-5465-47b8-8d35-b9281123ed6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:11.442160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c7180-5465-47b8-8d35-b9281123ed6f admin admin] PATH_INFO: `/v3/projects/365be27f4c0240da8b7038fbb4d5fc4e/users/7b597557618240c79d4be190ea6ac330/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:11.460520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c7180-5465-47b8-8d35-b9281123ed6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=365be27f4c0240da8b7038fbb4d5fc4e, user_id=7b597557618240c79d4be190ea6ac330, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:11.463814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c7180-5465-47b8-8d35-b9281123ed6f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:11.478961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1309/2620] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:52:11 2022] PUT /identity/v3/projects/365be27f4c0240da8b7038fbb4d5fc4e/users/7b597557618240c79d4be190ea6ac330/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:11.490131 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83b8fd-6e93-4406-94d1-2ee88f662ecc None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:11.490419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83b8fd-6e93-4406-94d1-2ee88f662ecc None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:11.490670 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83b8fd-6e93-4406-94d1-2ee88f662ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:11.521841 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-8a83b8fd-6e93-4406-94d1-2ee88f662ecc None None] MFA Rules not processed for user `7b597557618240c79d4be190ea6ac330`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:11.523053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8a83b8fd-6e93-4406-94d1-2ee88f662ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:11.598601 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1312/2621] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:11.603614 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c7180-5465-47b8-8d35-b9281123ed6f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:11.636980 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:11.672927 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83b8fd-6e93-4406-94d1-2ee88f662ecc None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:11.674309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8a83b8fd-6e93-4406-94d1-2ee88f662ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:11.676131 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c7180-5465-47b8-8d35-b9281123ed6f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:11.681996 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2dbd6-5526-4850-888c-98b34e5d69a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:11.682749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2dbd6-5526-4850-888c-98b34e5d69a2 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:11.683027 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2dbd6-5526-4850-888c-98b34e5d69a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:11.683351 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2dbd6-5526-4850-888c-98b34e5d69a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:11.684048 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2dbd6-5526-4850-888c-98b34e5d69a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:11.686561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2dbd6-5526-4850-888c-98b34e5d69a2 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:11.724539 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1310/2622] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:52:11 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:52:11.728871 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2dbd6-5526-4850-888c-98b34e5d69a2 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:11.748242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83b8fd-6e93-4406-94d1-2ee88f662ecc None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:11.791767 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2dbd6-5526-4850-888c-98b34e5d69a2 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:11.796674 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e934ea5-cc50-406b-9693-a1bd6aca950e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:11.797267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e934ea5-cc50-406b-9693-a1bd6aca950e admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:11.797576 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e934ea5-cc50-406b-9693-a1bd6aca950e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:11.797841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e934ea5-cc50-406b-9693-a1bd6aca950e admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:11.798501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e934ea5-cc50-406b-9693-a1bd6aca950e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:11.800387 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e934ea5-cc50-406b-9693-a1bd6aca950e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:11.809649 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57246c23-432a-4516-bad5-781792b68da2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0211a05cca4e72b30d64eef4ba527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:11.810256 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57246c23-432a-4516-bad5-781792b68da2 service placement] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:11.810539 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57246c23-432a-4516-bad5-781792b68da2 service placement] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:11.810813 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57246c23-432a-4516-bad5-781792b68da2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:11.812575 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-57246c23-432a-4516-bad5-781792b68da2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:11.826146 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1311/2623] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:52:11 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:52:11.826316 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57246c23-432a-4516-bad5-781792b68da2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:11.826426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57246c23-432a-4516-bad5-781792b68da2 service placement] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:11.827402 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e934ea5-cc50-406b-9693-a1bd6aca950e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:11.837084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1313/2624] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:11.837354 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e934ea5-cc50-406b-9693-a1bd6aca950e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:11.841681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecbe3d-4c99-46d9-8cfb-8287778a8224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:11.842290 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecbe3d-4c99-46d9-8cfb-8287778a8224 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:11.842567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecbe3d-4c99-46d9-8cfb-8287778a8224 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:11.842834 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecbe3d-4c99-46d9-8cfb-8287778a8224 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:11.843521 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecbe3d-4c99-46d9-8cfb-8287778a8224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:11.845111 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecbe3d-4c99-46d9-8cfb-8287778a8224 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:11.856053 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1312/2625] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:52:11.860345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57246c23-432a-4516-bad5-781792b68da2 service placement] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:11.871077 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57246c23-432a-4516-bad5-781792b68da2 service placement] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:11.875624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ca114-3adc-45e9-a853-dd5cbe36dee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:11.876296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ca114-3adc-45e9-a853-dd5cbe36dee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:11.876646 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ca114-3adc-45e9-a853-dd5cbe36dee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:11.876926 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ca114-3adc-45e9-a853-dd5cbe36dee3 admin admin] PATH_INFO: `/v3/projects/41a285ab5d0847cdb60a329ce71d89b3/users/fa0f2eefd2b64121a8c965cc7b4c7147/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:11.880215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:11.892791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ca114-3adc-45e9-a853-dd5cbe36dee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a285ab5d0847cdb60a329ce71d89b3, user_id=fa0f2eefd2b64121a8c965cc7b4c7147, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:11.895433 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ca114-3adc-45e9-a853-dd5cbe36dee3 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:11.912987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1314/2626] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:52:11 2022] PUT /identity/v3/projects/41a285ab5d0847cdb60a329ce71d89b3/users/fa0f2eefd2b64121a8c965cc7b4c7147/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:11.917143 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecbe3d-4c99-46d9-8cfb-8287778a8224 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:11.928762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecbe3d-4c99-46d9-8cfb-8287778a8224 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:11.989830 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d28d55-10f5-4e1d-910b-2bf949c28a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:11.990440 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28d55-10f5-4e1d-910b-2bf949c28a35 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:11.990721 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28d55-10f5-4e1d-910b-2bf949c28a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:11.990991 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28d55-10f5-4e1d-910b-2bf949c28a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:11.991652 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d28d55-10f5-4e1d-910b-2bf949c28a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:11.993251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d28d55-10f5-4e1d-910b-2bf949c28a35 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:12.004618 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1313/2627] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 10:52:12.007851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ca114-3adc-45e9-a853-dd5cbe36dee3 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:12.018786 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ca114-3adc-45e9-a853-dd5cbe36dee3 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:12.024397 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6662cca-e850-490c-a393-6e09e044f424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:12.025204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6662cca-e850-490c-a393-6e09e044f424 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:12.025496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6662cca-e850-490c-a393-6e09e044f424 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:12.025773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6662cca-e850-490c-a393-6e09e044f424 admin admin] PATH_INFO: `/v3/projects/41a285ab5d0847cdb60a329ce71d89b3/users/fa0f2eefd2b64121a8c965cc7b4c7147/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:12.027697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6662cca-e850-490c-a393-6e09e044f424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a285ab5d0847cdb60a329ce71d89b3, user_id=fa0f2eefd2b64121a8c965cc7b4c7147, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:12.030343 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6662cca-e850-490c-a393-6e09e044f424 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:12.041539 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1315/2628] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:52:12 2022] PUT /identity/v3/projects/41a285ab5d0847cdb60a329ce71d89b3/users/fa0f2eefd2b64121a8c965cc7b4c7147/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:12.052426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742fd2b-7266-4ca3-926f-d4caccfdafb8 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:12.052777 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742fd2b-7266-4ca3-926f-d4caccfdafb8 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:12.053135 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742fd2b-7266-4ca3-926f-d4caccfdafb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:12.082819 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-6742fd2b-7266-4ca3-926f-d4caccfdafb8 None None] MFA Rules not processed for user `fa0f2eefd2b64121a8c965cc7b4c7147`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:12.084699 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6742fd2b-7266-4ca3-926f-d4caccfdafb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:12.100269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:12.186164 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1314/2629] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:12.195912 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6662cca-e850-490c-a393-6e09e044f424 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:12.198193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e6662cca-e850-490c-a393-6e09e044f424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:12.268318 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6662cca-e850-490c-a393-6e09e044f424 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:12.272727 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf0028-ddee-4dc6-93ce-cd69c243d914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:12.273454 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf0028-ddee-4dc6-93ce-cd69c243d914 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:12.273756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf0028-ddee-4dc6-93ce-cd69c243d914 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:12.274251 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf0028-ddee-4dc6-93ce-cd69c243d914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:12.337031 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf0028-ddee-4dc6-93ce-cd69c243d914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:12.338421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf0028-ddee-4dc6-93ce-cd69c243d914 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:12.348378 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1316/2630] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:13.400773 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29db6a7-f464-4631-8501-5ed66b39f612 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:13.401237 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29db6a7-f464-4631-8501-5ed66b39f612 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:13.401339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29db6a7-f464-4631-8501-5ed66b39f612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:13.420981 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c29db6a7-f464-4631-8501-5ed66b39f612 None None] MFA Rules not processed for user `bdc800f1d4174b5cba4f6f496207ec95`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:13.422191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c29db6a7-f464-4631-8501-5ed66b39f612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:13.480937 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1315/2631] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 10:52:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:13.495919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf0028-ddee-4dc6-93ce-cd69c243d914 service cinder] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:13.497435 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-89cf0028-ddee-4dc6-93ce-cd69c243d914 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:13.569999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf0028-ddee-4dc6-93ce-cd69c243d914 service cinder] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:13.575244 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e69561-3141-48db-81b6-e749f91f07a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ff72290fd14ddaba6ed757051e182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:13.576009 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e69561-3141-48db-81b6-e749f91f07a7 service swift] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:13.576108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e69561-3141-48db-81b6-e749f91f07a7 service swift] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:13.576379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e69561-3141-48db-81b6-e749f91f07a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:13.584721 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e69561-3141-48db-81b6-e749f91f07a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:13.586299 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e69561-3141-48db-81b6-e749f91f07a7 service swift] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:13.595137 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1317/2632] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 10:52:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 10:52:15.204882 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29db6a7-f464-4631-8501-5ed66b39f612 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:15.206466 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c29db6a7-f464-4631-8501-5ed66b39f612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:15.225090 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29db6a7-f464-4631-8501-5ed66b39f612 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:15.232166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396abfd0-acf4-4a16-a4f6-44e0260708a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:15.232980 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396abfd0-acf4-4a16-a4f6-44e0260708a3 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:15.233476 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396abfd0-acf4-4a16-a4f6-44e0260708a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:15.233690 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396abfd0-acf4-4a16-a4f6-44e0260708a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:15.244115 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396abfd0-acf4-4a16-a4f6-44e0260708a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:15.245805 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396abfd0-acf4-4a16-a4f6-44e0260708a3 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:15.271407 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1316/2633] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:23.591567 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=91,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:25.253260 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=54 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:26.223051 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e69561-3141-48db-81b6-e749f91f07a7 service swift] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:26.226222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-71e69561-3141-48db-81b6-e749f91f07a7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:26.306525 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e69561-3141-48db-81b6-e749f91f07a7 service swift] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:26.312200 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cf251-43ef-4d2e-ad06-b3da561f2a1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:26.312842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cf251-43ef-4d2e-ad06-b3da561f2a1c service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:26.313125 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cf251-43ef-4d2e-ad06-b3da561f2a1c service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:26.313411 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cf251-43ef-4d2e-ad06-b3da561f2a1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:26.315131 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b71cf251-43ef-4d2e-ad06-b3da561f2a1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:26.327610 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cf251-43ef-4d2e-ad06-b3da561f2a1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:26.329460 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cf251-43ef-4d2e-ad06-b3da561f2a1c service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:26.341642 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1318/2634] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:28.045059 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b61f7-8529-4c89-ba84-2d56ad13833e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:28.045506 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b61f7-8529-4c89-ba84-2d56ad13833e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:28.045681 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b61f7-8529-4c89-ba84-2d56ad13833e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:28.065284 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b04b61f7-8529-4c89-ba84-2d56ad13833e None None] MFA Rules not processed for user `bdc800f1d4174b5cba4f6f496207ec95`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:28.066544 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b04b61f7-8529-4c89-ba84-2d56ad13833e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:28.073742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1317/2635] 10.222.0.20 () {58 vars in 967 bytes} [Sun Sep 11 10:52:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:28.086883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cf251-43ef-4d2e-ad06-b3da561f2a1c service nova] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:28.098178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cf251-43ef-4d2e-ad06-b3da561f2a1c service nova] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:28.104331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba7470-b59f-4519-9025-3913eaf6b827 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ff72290fd14ddaba6ed757051e182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:28.104887 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba7470-b59f-4519-9025-3913eaf6b827 service swift] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:28.105166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba7470-b59f-4519-9025-3913eaf6b827 service swift] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:28.105435 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba7470-b59f-4519-9025-3913eaf6b827 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:28.113832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba7470-b59f-4519-9025-3913eaf6b827 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:28.115413 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba7470-b59f-4519-9025-3913eaf6b827 service swift] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:28.124179 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1319/2636] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 10:52:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 10:52:28.217848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b61f7-8529-4c89-ba84-2d56ad13833e None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:28.286826 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b61f7-8529-4c89-ba84-2d56ad13833e None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:28.292475 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf2053-f660-4859-bfe6-08fe96feb3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:28.293229 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf2053-f660-4859-bfe6-08fe96feb3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:28.293518 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf2053-f660-4859-bfe6-08fe96feb3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:28.293856 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf2053-f660-4859-bfe6-08fe96feb3e4 admin admin] PATH_INFO: `/v3/users/7b597557618240c79d4be190ea6ac330` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:28.295005 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf2053-f660-4859-bfe6-08fe96feb3e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b597557618240c79d4be190ea6ac330)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:28.296946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf2053-f660-4859-bfe6-08fe96feb3e4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:28.349328 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a3cf2053-f660-4859-bfe6-08fe96feb3e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b597557618240c79d4be190ea6ac330'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:28.357374 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a3cf2053-f660-4859-bfe6-08fe96feb3e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b597557618240c79d4be190ea6ac330'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:28.357995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a3cf2053-f660-4859-bfe6-08fe96feb3e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b597557618240c79d4be190ea6ac330'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:28.358701 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a3cf2053-f660-4859-bfe6-08fe96feb3e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b597557618240c79d4be190ea6ac330'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:28.366249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a3cf2053-f660-4859-bfe6-08fe96feb3e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b597557618240c79d4be190ea6ac330'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:28.384137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1318/2637] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:52:28 2022] DELETE /identity/v3/users/7b597557618240c79d4be190ea6ac330 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:28.388642 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd2f0e-b065-40d3-8b64-d88b01e74e63 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:28.389171 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd2f0e-b065-40d3-8b64-d88b01e74e63 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:28.389448 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd2f0e-b065-40d3-8b64-d88b01e74e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:28.410383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-48cd2f0e-b065-40d3-8b64-d88b01e74e63 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:28.412094 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-48cd2f0e-b065-40d3-8b64-d88b01e74e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:28.479333 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1320/2638] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:28.490577 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf2053-f660-4859-bfe6-08fe96feb3e4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:28.492196 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a3cf2053-f660-4859-bfe6-08fe96feb3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:28.553774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf2053-f660-4859-bfe6-08fe96feb3e4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:28.557439 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07147e-8d16-4749-8650-09b5eaa0ee71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:28.558130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07147e-8d16-4749-8650-09b5eaa0ee71 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:28.558472 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07147e-8d16-4749-8650-09b5eaa0ee71 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:28.558812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07147e-8d16-4749-8650-09b5eaa0ee71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:28.568467 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07147e-8d16-4749-8650-09b5eaa0ee71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:28.569906 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07147e-8d16-4749-8650-09b5eaa0ee71 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:28.579756 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1319/2639] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:28.849205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd2f0e-b065-40d3-8b64-d88b01e74e63 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:28.850738 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-48cd2f0e-b065-40d3-8b64-d88b01e74e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:28.863053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd2f0e-b065-40d3-8b64-d88b01e74e63 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:28.868163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0621ad2-fde6-4644-8e63-c8c41ce9f174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:28.868830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0621ad2-fde6-4644-8e63-c8c41ce9f174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:28.869113 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0621ad2-fde6-4644-8e63-c8c41ce9f174 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:28.869425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0621ad2-fde6-4644-8e63-c8c41ce9f174 admin admin] PATH_INFO: `/v3/projects/365be27f4c0240da8b7038fbb4d5fc4e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:28.870556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0621ad2-fde6-4644-8e63-c8c41ce9f174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=365be27f4c0240da8b7038fbb4d5fc4e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:28.872518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0621ad2-fde6-4644-8e63-c8c41ce9f174 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:28.918816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a0621ad2-fde6-4644-8e63-c8c41ce9f174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '365be27f4c0240da8b7038fbb4d5fc4e', 'request_id': 'req-a0621ad2-fde6-4644-8e63-c8c41ce9f174'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:28.924977 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a0621ad2-fde6-4644-8e63-c8c41ce9f174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '365be27f4c0240da8b7038fbb4d5fc4e', 'request_id': 'req-a0621ad2-fde6-4644-8e63-c8c41ce9f174'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:28.932541 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a0621ad2-fde6-4644-8e63-c8c41ce9f174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '365be27f4c0240da8b7038fbb4d5fc4e', 'request_id': 'req-a0621ad2-fde6-4644-8e63-c8c41ce9f174'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:28.937205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:28.944934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a0621ad2-fde6-4644-8e63-c8c41ce9f174 admin admin] The token cache is being invalidate because project 365be27f4c0240da8b7038fbb4d5fc4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:52:28.945455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a0621ad2-fde6-4644-8e63-c8c41ce9f174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:28.946330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-a0621ad2-fde6-4644-8e63-c8c41ce9f174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:28.947864 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1321/2640] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:52:28 2022] DELETE /identity/v3/projects/365be27f4c0240da8b7038fbb4d5fc4e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:28.951990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07147e-8d16-4749-8650-09b5eaa0ee71 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:28.961654 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07147e-8d16-4749-8650-09b5eaa0ee71 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:28.972873 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:29.021989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e5ac6-0fba-49ff-b4f9-b9a7a50f7987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:29.022724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e5ac6-0fba-49ff-b4f9-b9a7a50f7987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:29.023122 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e5ac6-0fba-49ff-b4f9-b9a7a50f7987 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:29.023494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e5ac6-0fba-49ff-b4f9-b9a7a50f7987 admin admin] PATH_INFO: `/v3/users/fa0f2eefd2b64121a8c965cc7b4c7147` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:29.024803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e5ac6-0fba-49ff-b4f9-b9a7a50f7987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa0f2eefd2b64121a8c965cc7b4c7147)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:29.026796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e5ac6-0fba-49ff-b4f9-b9a7a50f7987 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:29.075636 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-434e5ac6-0fba-49ff-b4f9-b9a7a50f7987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa0f2eefd2b64121a8c965cc7b4c7147'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:29.082743 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-434e5ac6-0fba-49ff-b4f9-b9a7a50f7987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa0f2eefd2b64121a8c965cc7b4c7147'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:29.083946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-434e5ac6-0fba-49ff-b4f9-b9a7a50f7987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa0f2eefd2b64121a8c965cc7b4c7147'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:29.084678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-434e5ac6-0fba-49ff-b4f9-b9a7a50f7987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa0f2eefd2b64121a8c965cc7b4c7147'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:29.104214 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-434e5ac6-0fba-49ff-b4f9-b9a7a50f7987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa0f2eefd2b64121a8c965cc7b4c7147'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:29.109837 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1320/2641] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:52:28 2022] DELETE /identity/v3/users/fa0f2eefd2b64121a8c965cc7b4c7147 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:29.391581 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0621ad2-fde6-4644-8e63-c8c41ce9f174 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:29.393130 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a0621ad2-fde6-4644-8e63-c8c41ce9f174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:29.405987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0621ad2-fde6-4644-8e63-c8c41ce9f174 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:29.463944 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8827b69-ef51-47e0-ad70-ad53bfd2b845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:29.464513 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8827b69-ef51-47e0-ad70-ad53bfd2b845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:29.464826 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8827b69-ef51-47e0-ad70-ad53bfd2b845 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:29.465120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8827b69-ef51-47e0-ad70-ad53bfd2b845 admin admin] PATH_INFO: `/v3/projects/41a285ab5d0847cdb60a329ce71d89b3` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:29.466216 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8827b69-ef51-47e0-ad70-ad53bfd2b845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a285ab5d0847cdb60a329ce71d89b3)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:29.468112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8827b69-ef51-47e0-ad70-ad53bfd2b845 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:29.513033 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d8827b69-ef51-47e0-ad70-ad53bfd2b845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a285ab5d0847cdb60a329ce71d89b3', 'request_id': 'req-d8827b69-ef51-47e0-ad70-ad53bfd2b845'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:29.519121 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d8827b69-ef51-47e0-ad70-ad53bfd2b845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a285ab5d0847cdb60a329ce71d89b3', 'request_id': 'req-d8827b69-ef51-47e0-ad70-ad53bfd2b845'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:29.526571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d8827b69-ef51-47e0-ad70-ad53bfd2b845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a285ab5d0847cdb60a329ce71d89b3', 'request_id': 'req-d8827b69-ef51-47e0-ad70-ad53bfd2b845'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:29.537350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d8827b69-ef51-47e0-ad70-ad53bfd2b845 admin admin] The token cache is being invalidate because project 41a285ab5d0847cdb60a329ce71d89b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:52:29.537636 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d8827b69-ef51-47e0-ad70-ad53bfd2b845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:29.538250 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d8827b69-ef51-47e0-ad70-ad53bfd2b845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:29.539722 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1322/2642] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:52:29 2022] DELETE /identity/v3/projects/41a285ab5d0847cdb60a329ce71d89b3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:29.544636 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6a60-047a-476a-b502-14a35f6a90a4 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:29.544928 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6a60-047a-476a-b502-14a35f6a90a4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:29.545207 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6a60-047a-476a-b502-14a35f6a90a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:29.564780 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-058e6a60-047a-476a-b502-14a35f6a90a4 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:29.565968 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-058e6a60-047a-476a-b502-14a35f6a90a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:29.624009 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1321/2643] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:29.633882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d376c9-46e4-4794-a4a3-c8f72b90dedb None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:29.634326 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d376c9-46e4-4794-a4a3-c8f72b90dedb None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:29.634614 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d376c9-46e4-4794-a4a3-c8f72b90dedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:29.654243 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-e9d376c9-46e4-4794-a4a3-c8f72b90dedb None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:29.655453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-e9d376c9-46e4-4794-a4a3-c8f72b90dedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:29.663359 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1323/2644] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:29.667771 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e6a60-047a-476a-b502-14a35f6a90a4 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:29.677950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e6a60-047a-476a-b502-14a35f6a90a4 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:29.682643 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd340ff-cdac-4f64-8bcf-1ea873f14ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:29.683248 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd340ff-cdac-4f64-8bcf-1ea873f14ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:29.683528 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd340ff-cdac-4f64-8bcf-1ea873f14ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:29.683802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd340ff-cdac-4f64-8bcf-1ea873f14ba8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:29.684478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd340ff-cdac-4f64-8bcf-1ea873f14ba8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:52:29.684808 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd340ff-cdac-4f64-8bcf-1ea873f14ba8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:29.686386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd340ff-cdac-4f64-8bcf-1ea873f14ba8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:29.698865 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1322/2645] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:52:29.703352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d376c9-46e4-4794-a4a3-c8f72b90dedb None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:29.713239 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d376c9-46e4-4794-a4a3-c8f72b90dedb None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:29.718127 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab08d54-739d-45bd-a937-62c47474d6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:29.718720 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab08d54-739d-45bd-a937-62c47474d6cf admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:29.718999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab08d54-739d-45bd-a937-62c47474d6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:29.719276 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab08d54-739d-45bd-a937-62c47474d6cf admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:29.719919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab08d54-739d-45bd-a937-62c47474d6cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:29.721829 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab08d54-739d-45bd-a937-62c47474d6cf admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:29.750889 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1324/2646] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:52:29 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:52:29.755128 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd340ff-cdac-4f64-8bcf-1ea873f14ba8 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:29.765081 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd340ff-cdac-4f64-8bcf-1ea873f14ba8 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:29.784103 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:29.824410 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdb228-413f-4821-9b77-ccb0d70bc625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:29.825055 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdb228-413f-4821-9b77-ccb0d70bc625 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:29.825339 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdb228-413f-4821-9b77-ccb0d70bc625 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:29.825615 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdb228-413f-4821-9b77-ccb0d70bc625 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:29.826254 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdb228-413f-4821-9b77-ccb0d70bc625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:29.828153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdb228-413f-4821-9b77-ccb0d70bc625 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:29.849930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1323/2647] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:52:29 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:52:29.853967 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab08d54-739d-45bd-a937-62c47474d6cf admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:29.864863 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab08d54-739d-45bd-a937-62c47474d6cf admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:29.869462 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffa7e7-5b22-4f3f-83f7-ec9c290c0c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:29.870053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffa7e7-5b22-4f3f-83f7-ec9c290c0c41 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:29.870334 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffa7e7-5b22-4f3f-83f7-ec9c290c0c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:29.870607 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffa7e7-5b22-4f3f-83f7-ec9c290c0c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:29.871244 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffa7e7-5b22-4f3f-83f7-ec9c290c0c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:29.872854 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffa7e7-5b22-4f3f-83f7-ec9c290c0c41 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:29.882668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1325/2648] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:52:29.886533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdb228-413f-4821-9b77-ccb0d70bc625 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:29.896204 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdb228-413f-4821-9b77-ccb0d70bc625 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:29.900750 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432c615-e5c4-495a-91b4-310a034a2079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:29.901337 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432c615-e5c4-495a-91b4-310a034a2079 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:29.901614 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432c615-e5c4-495a-91b4-310a034a2079 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:29.901881 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432c615-e5c4-495a-91b4-310a034a2079 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:29.902628 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432c615-e5c4-495a-91b4-310a034a2079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:29.904189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432c615-e5c4-495a-91b4-310a034a2079 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:29.915949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1324/2649] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:52:29.919809 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffa7e7-5b22-4f3f-83f7-ec9c290c0c41 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:29.930301 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffa7e7-5b22-4f3f-83f7-ec9c290c0c41 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:29.934881 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029347ac-8254-482d-b702-88f9af5efb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:29.935520 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029347ac-8254-482d-b702-88f9af5efb21 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:29.935812 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029347ac-8254-482d-b702-88f9af5efb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:29.936094 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029347ac-8254-482d-b702-88f9af5efb21 admin admin] PATH_INFO: `/v3/projects/de9fbb40ed8b4fc9bdcda54213b5226e/users/d3a252b661164690819ec23c02f670ee/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:29.950372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029347ac-8254-482d-b702-88f9af5efb21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de9fbb40ed8b4fc9bdcda54213b5226e, user_id=d3a252b661164690819ec23c02f670ee, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:29.953036 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029347ac-8254-482d-b702-88f9af5efb21 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:29.966900 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1326/2650] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:52:29 2022] PUT /identity/v3/projects/de9fbb40ed8b4fc9bdcda54213b5226e/users/d3a252b661164690819ec23c02f670ee/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:29.977763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdad32-c226-49b6-96c1-46872fa4f6b5 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:29.978046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdad32-c226-49b6-96c1-46872fa4f6b5 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:29.978317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdad32-c226-49b6-96c1-46872fa4f6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:30.005619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-6afdad32-c226-49b6-96c1-46872fa4f6b5 None None] MFA Rules not processed for user `d3a252b661164690819ec23c02f670ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:30.006850 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6afdad32-c226-49b6-96c1-46872fa4f6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:30.072311 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1325/2651] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:30.076850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029347ac-8254-482d-b702-88f9af5efb21 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:30.102501 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:30.149381 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029347ac-8254-482d-b702-88f9af5efb21 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:30.154192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4e58a-33d9-44c3-85f2-0cdce1b3c948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:30.154794 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4e58a-33d9-44c3-85f2-0cdce1b3c948 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:30.155075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4e58a-33d9-44c3-85f2-0cdce1b3c948 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:30.155350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4e58a-33d9-44c3-85f2-0cdce1b3c948 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:30.155983 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4e58a-33d9-44c3-85f2-0cdce1b3c948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:30.157901 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4e58a-33d9-44c3-85f2-0cdce1b3c948 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:30.183967 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1327/2652] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:52:30 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:52:30.188119 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdad32-c226-49b6-96c1-46872fa4f6b5 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:30.199094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdad32-c226-49b6-96c1-46872fa4f6b5 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:30.259066 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94ab4d-b89f-40d8-933e-a51523935d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:30.259670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94ab4d-b89f-40d8-933e-a51523935d21 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:30.259954 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94ab4d-b89f-40d8-933e-a51523935d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:30.260215 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94ab4d-b89f-40d8-933e-a51523935d21 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:30.260877 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94ab4d-b89f-40d8-933e-a51523935d21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:30.262806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94ab4d-b89f-40d8-933e-a51523935d21 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:30.286937 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1326/2653] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:52:30 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:52:30.290956 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4e58a-33d9-44c3-85f2-0cdce1b3c948 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:30.301508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4e58a-33d9-44c3-85f2-0cdce1b3c948 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:30.306774 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5af68-a328-4011-888c-3b68f8df1166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:30.307378 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5af68-a328-4011-888c-3b68f8df1166 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:30.307659 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5af68-a328-4011-888c-3b68f8df1166 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:30.307939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5af68-a328-4011-888c-3b68f8df1166 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:30.308606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5af68-a328-4011-888c-3b68f8df1166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:30.310447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5af68-a328-4011-888c-3b68f8df1166 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:30.324581 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1328/2654] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:52:30.327196 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94ab4d-b89f-40d8-933e-a51523935d21 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:30.338521 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94ab4d-b89f-40d8-933e-a51523935d21 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:30.343986 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580f063-6023-4056-9c46-a4cbfb8a1fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:30.344679 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580f063-6023-4056-9c46-a4cbfb8a1fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:30.344965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580f063-6023-4056-9c46-a4cbfb8a1fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:30.345364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580f063-6023-4056-9c46-a4cbfb8a1fbd admin admin] PATH_INFO: `/v3/projects/00351afc20ef487aa114c84bd6c1831d/users/78500f68e4cb4b469839a0c844301e35/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:30.361581 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580f063-6023-4056-9c46-a4cbfb8a1fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=00351afc20ef487aa114c84bd6c1831d, user_id=78500f68e4cb4b469839a0c844301e35, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:30.364263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580f063-6023-4056-9c46-a4cbfb8a1fbd admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:30.367845 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:30.378871 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1327/2655] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:52:30 2022] PUT /identity/v3/projects/00351afc20ef487aa114c84bd6c1831d/users/78500f68e4cb4b469839a0c844301e35/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:30.383566 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5af68-a328-4011-888c-3b68f8df1166 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:30.393342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5af68-a328-4011-888c-3b68f8df1166 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:30.465106 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f33242-d739-4f13-98b4-6022c8fd5999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:30.466155 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f33242-d739-4f13-98b4-6022c8fd5999 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:30.466632 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f33242-d739-4f13-98b4-6022c8fd5999 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:30.467074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f33242-d739-4f13-98b4-6022c8fd5999 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:30.468040 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f33242-d739-4f13-98b4-6022c8fd5999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:30.471712 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f33242-d739-4f13-98b4-6022c8fd5999 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:30.483578 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1329/2656] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:52:30.487956 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580f063-6023-4056-9c46-a4cbfb8a1fbd admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:30.499439 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580f063-6023-4056-9c46-a4cbfb8a1fbd admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:30.503963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ce9e9-bb12-4a2e-8f0f-6308a5d9a7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:30.504637 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ce9e9-bb12-4a2e-8f0f-6308a5d9a7b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:30.504916 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ce9e9-bb12-4a2e-8f0f-6308a5d9a7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:30.505184 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ce9e9-bb12-4a2e-8f0f-6308a5d9a7b3 admin admin] PATH_INFO: `/v3/projects/00351afc20ef487aa114c84bd6c1831d/users/78500f68e4cb4b469839a0c844301e35/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:30.507713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ce9e9-bb12-4a2e-8f0f-6308a5d9a7b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00351afc20ef487aa114c84bd6c1831d, user_id=78500f68e4cb4b469839a0c844301e35, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:30.510322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ce9e9-bb12-4a2e-8f0f-6308a5d9a7b3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:30.520353 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1328/2657] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:52:30 2022] PUT /identity/v3/projects/00351afc20ef487aa114c84bd6c1831d/users/78500f68e4cb4b469839a0c844301e35/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:30.531479 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f1229-4b19-4571-a3cf-b970b688fb9c None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:30.531766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f1229-4b19-4571-a3cf-b970b688fb9c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:30.532039 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f1229-4b19-4571-a3cf-b970b688fb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:30.560408 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-b15f1229-4b19-4571-a3cf-b970b688fb9c None None] MFA Rules not processed for user `78500f68e4cb4b469839a0c844301e35`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:30.561633 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b15f1229-4b19-4571-a3cf-b970b688fb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:30.627805 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1330/2658] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:30.638484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ce9e9-bb12-4a2e-8f0f-6308a5d9a7b3 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:30.640207 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7f8ce9e9-bb12-4a2e-8f0f-6308a5d9a7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:30.695768 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ce9e9-bb12-4a2e-8f0f-6308a5d9a7b3 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:30.699343 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047c3de-de8e-4feb-b474-1ba6a072e27a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:30.699928 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047c3de-de8e-4feb-b474-1ba6a072e27a service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:30.700205 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047c3de-de8e-4feb-b474-1ba6a072e27a service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:30.700473 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047c3de-de8e-4feb-b474-1ba6a072e27a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:30.710200 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047c3de-de8e-4feb-b474-1ba6a072e27a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:30.711997 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047c3de-de8e-4feb-b474-1ba6a072e27a service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:30.721797 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1329/2659] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:30.829249 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f1229-4b19-4571-a3cf-b970b688fb9c None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:30.839678 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f1229-4b19-4571-a3cf-b970b688fb9c None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:30.843271 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444afcb-36ae-4642-b69a-3f7f30fb41e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:30.843866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444afcb-36ae-4642-b69a-3f7f30fb41e6 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:30.844148 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444afcb-36ae-4642-b69a-3f7f30fb41e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:30.844430 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444afcb-36ae-4642-b69a-3f7f30fb41e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:30.857017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:30.903113 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444afcb-36ae-4642-b69a-3f7f30fb41e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:30.904574 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444afcb-36ae-4642-b69a-3f7f30fb41e6 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:30.913230 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1331/2660] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:32.518653 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047c3de-de8e-4feb-b474-1ba6a072e27a service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:32.520045 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c047c3de-de8e-4feb-b474-1ba6a072e27a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:32.586075 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047c3de-de8e-4feb-b474-1ba6a072e27a service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:32.590827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdc603-02a3-48d1-a66e-b716bc6d814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:32.591443 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdc603-02a3-48d1-a66e-b716bc6d814f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:32.591718 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdc603-02a3-48d1-a66e-b716bc6d814f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:32.591986 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdc603-02a3-48d1-a66e-b716bc6d814f admin admin] PATH_INFO: `/v3/users/3b253144389c4fe0a906f195c9e843cd` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:32.593129 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdc603-02a3-48d1-a66e-b716bc6d814f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b253144389c4fe0a906f195c9e843cd)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:32.595011 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdc603-02a3-48d1-a66e-b716bc6d814f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:32.638801 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-26fdc603-02a3-48d1-a66e-b716bc6d814f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b253144389c4fe0a906f195c9e843cd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:32.645820 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-26fdc603-02a3-48d1-a66e-b716bc6d814f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b253144389c4fe0a906f195c9e843cd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:32.646433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-26fdc603-02a3-48d1-a66e-b716bc6d814f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b253144389c4fe0a906f195c9e843cd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:32.647526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-26fdc603-02a3-48d1-a66e-b716bc6d814f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b253144389c4fe0a906f195c9e843cd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:32.654409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-26fdc603-02a3-48d1-a66e-b716bc6d814f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b253144389c4fe0a906f195c9e843cd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:32.672256 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1330/2661] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:52:32 2022] DELETE /identity/v3/users/3b253144389c4fe0a906f195c9e843cd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:32.676753 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1c5c5-ae9c-4f44-8256-62aaf45b32ae None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:32.677230 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1c5c5-ae9c-4f44-8256-62aaf45b32ae None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:32.677362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1c5c5-ae9c-4f44-8256-62aaf45b32ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:32.816367 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-1bb1c5c5-ae9c-4f44-8256-62aaf45b32ae None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:32.817612 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-1bb1c5c5-ae9c-4f44-8256-62aaf45b32ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:32.875571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1332/2662] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:32.885745 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdc603-02a3-48d1-a66e-b716bc6d814f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:32.887191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-26fdc603-02a3-48d1-a66e-b716bc6d814f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:32.893583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:32.944133 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdc603-02a3-48d1-a66e-b716bc6d814f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:32.947612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a32bf1-a711-471c-a027-d7785330dbbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:32.948199 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a32bf1-a711-471c-a027-d7785330dbbc service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:32.948477 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a32bf1-a711-471c-a027-d7785330dbbc service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:32.948773 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a32bf1-a711-471c-a027-d7785330dbbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:32.957376 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a32bf1-a711-471c-a027-d7785330dbbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:32.958763 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a32bf1-a711-471c-a027-d7785330dbbc service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:32.968734 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1331/2663] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:33.226866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1c5c5-ae9c-4f44-8256-62aaf45b32ae None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:33.228268 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-1bb1c5c5-ae9c-4f44-8256-62aaf45b32ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:33.242366 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1c5c5-ae9c-4f44-8256-62aaf45b32ae None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:33.246945 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505dcea9-41c4-41db-b297-b866cf59d9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:33.248177 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dcea9-41c4-41db-b297-b866cf59d9a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:33.248459 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dcea9-41c4-41db-b297-b866cf59d9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:33.248951 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dcea9-41c4-41db-b297-b866cf59d9a7 admin admin] PATH_INFO: `/v3/projects/abcb84d457404e25b96d725a8b723e8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:33.250213 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505dcea9-41c4-41db-b297-b866cf59d9a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abcb84d457404e25b96d725a8b723e8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:33.252155 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505dcea9-41c4-41db-b297-b866cf59d9a7 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:33.298858 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-505dcea9-41c4-41db-b297-b866cf59d9a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abcb84d457404e25b96d725a8b723e8e', 'request_id': 'req-505dcea9-41c4-41db-b297-b866cf59d9a7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:33.305633 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-505dcea9-41c4-41db-b297-b866cf59d9a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abcb84d457404e25b96d725a8b723e8e', 'request_id': 'req-505dcea9-41c4-41db-b297-b866cf59d9a7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:33.312928 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-505dcea9-41c4-41db-b297-b866cf59d9a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abcb84d457404e25b96d725a8b723e8e', 'request_id': 'req-505dcea9-41c4-41db-b297-b866cf59d9a7'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:33.324058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-505dcea9-41c4-41db-b297-b866cf59d9a7 admin admin] The token cache is being invalidate because project abcb84d457404e25b96d725a8b723e8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:52:33.324350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-505dcea9-41c4-41db-b297-b866cf59d9a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:33.324991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-505dcea9-41c4-41db-b297-b866cf59d9a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:33.326457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1333/2664] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:52:33 2022] DELETE /identity/v3/projects/abcb84d457404e25b96d725a8b723e8e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:33.507053 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a32bf1-a711-471c-a027-d7785330dbbc service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:33.508678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-48a32bf1-a711-471c-a027-d7785330dbbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:33.522271 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a32bf1-a711-471c-a027-d7785330dbbc service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:33.580456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a546967-c0f4-4ce2-a865-9e013350922e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:33.581119 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a546967-c0f4-4ce2-a865-9e013350922e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:33.581398 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a546967-c0f4-4ce2-a865-9e013350922e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:33.581668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a546967-c0f4-4ce2-a865-9e013350922e admin admin] PATH_INFO: `/v3/users/d3a252b661164690819ec23c02f670ee` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:33.582796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a546967-c0f4-4ce2-a865-9e013350922e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3a252b661164690819ec23c02f670ee)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:33.584724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a546967-c0f4-4ce2-a865-9e013350922e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:33.631204 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2a546967-c0f4-4ce2-a865-9e013350922e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3a252b661164690819ec23c02f670ee'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:33.637441 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2a546967-c0f4-4ce2-a865-9e013350922e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3a252b661164690819ec23c02f670ee'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:33.638068 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2a546967-c0f4-4ce2-a865-9e013350922e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3a252b661164690819ec23c02f670ee'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:33.638669 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2a546967-c0f4-4ce2-a865-9e013350922e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3a252b661164690819ec23c02f670ee'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:33.645723 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2a546967-c0f4-4ce2-a865-9e013350922e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3a252b661164690819ec23c02f670ee'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:33.663041 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1332/2665] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:52:33 2022] DELETE /identity/v3/users/d3a252b661164690819ec23c02f670ee => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:33.667641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e765f-4df3-4eb0-9261-5ca6eda593f5 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:33.667992 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e765f-4df3-4eb0-9261-5ca6eda593f5 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:33.668383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e765f-4df3-4eb0-9261-5ca6eda593f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:33.687367 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-4c8e765f-4df3-4eb0-9261-5ca6eda593f5 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:33.688571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-4c8e765f-4df3-4eb0-9261-5ca6eda593f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:33.720918 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:33.748409 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1334/2666] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:33.758127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a546967-c0f4-4ce2-a865-9e013350922e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:33.759555 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2a546967-c0f4-4ce2-a865-9e013350922e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:33.791993 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:33.820066 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a546967-c0f4-4ce2-a865-9e013350922e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:33.823678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa69710-41b3-4da1-8df0-dd5afabb3dca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:33.824269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa69710-41b3-4da1-8df0-dd5afabb3dca service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:33.824561 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa69710-41b3-4da1-8df0-dd5afabb3dca service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:33.824843 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa69710-41b3-4da1-8df0-dd5afabb3dca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:33.833479 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa69710-41b3-4da1-8df0-dd5afabb3dca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:33.834879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa69710-41b3-4da1-8df0-dd5afabb3dca service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:33.844406 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1333/2667] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:34.117253 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e765f-4df3-4eb0-9261-5ca6eda593f5 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:34.118649 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-4c8e765f-4df3-4eb0-9261-5ca6eda593f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:34.131206 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e765f-4df3-4eb0-9261-5ca6eda593f5 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:34.135693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcddf3a-29bb-454b-b284-7fe116172349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:34.136453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcddf3a-29bb-454b-b284-7fe116172349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:34.136800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcddf3a-29bb-454b-b284-7fe116172349 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:34.137058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcddf3a-29bb-454b-b284-7fe116172349 admin admin] PATH_INFO: `/v3/projects/de9fbb40ed8b4fc9bdcda54213b5226e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:34.138178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcddf3a-29bb-454b-b284-7fe116172349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de9fbb40ed8b4fc9bdcda54213b5226e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:34.140124 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcddf3a-29bb-454b-b284-7fe116172349 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:34.191771 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-1fcddf3a-29bb-454b-b284-7fe116172349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de9fbb40ed8b4fc9bdcda54213b5226e', 'request_id': 'req-1fcddf3a-29bb-454b-b284-7fe116172349'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:34.197923 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-1fcddf3a-29bb-454b-b284-7fe116172349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de9fbb40ed8b4fc9bdcda54213b5226e', 'request_id': 'req-1fcddf3a-29bb-454b-b284-7fe116172349'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:34.205410 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-1fcddf3a-29bb-454b-b284-7fe116172349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de9fbb40ed8b4fc9bdcda54213b5226e', 'request_id': 'req-1fcddf3a-29bb-454b-b284-7fe116172349'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:34.216723 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-1fcddf3a-29bb-454b-b284-7fe116172349 admin admin] The token cache is being invalidate because project de9fbb40ed8b4fc9bdcda54213b5226e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:52:34.217016 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-1fcddf3a-29bb-454b-b284-7fe116172349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:34.217642 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-1fcddf3a-29bb-454b-b284-7fe116172349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:34.219113 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1335/2668] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:52:34 2022] DELETE /identity/v3/projects/de9fbb40ed8b4fc9bdcda54213b5226e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:34.223138 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa69710-41b3-4da1-8df0-dd5afabb3dca service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:34.233112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa69710-41b3-4da1-8df0-dd5afabb3dca service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:34.289510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3860f77-60d8-4dc8-85b6-c5fab3441862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:34.290070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3860f77-60d8-4dc8-85b6-c5fab3441862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:34.290353 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3860f77-60d8-4dc8-85b6-c5fab3441862 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:34.290626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3860f77-60d8-4dc8-85b6-c5fab3441862 admin admin] PATH_INFO: `/v3/users/78500f68e4cb4b469839a0c844301e35` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:34.291745 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3860f77-60d8-4dc8-85b6-c5fab3441862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78500f68e4cb4b469839a0c844301e35)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:34.293683 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3860f77-60d8-4dc8-85b6-c5fab3441862 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:34.340149 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f3860f77-60d8-4dc8-85b6-c5fab3441862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78500f68e4cb4b469839a0c844301e35'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:34.347005 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f3860f77-60d8-4dc8-85b6-c5fab3441862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78500f68e4cb4b469839a0c844301e35'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:34.347609 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f3860f77-60d8-4dc8-85b6-c5fab3441862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78500f68e4cb4b469839a0c844301e35'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:34.348207 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f3860f77-60d8-4dc8-85b6-c5fab3441862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78500f68e4cb4b469839a0c844301e35'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:34.355072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f3860f77-60d8-4dc8-85b6-c5fab3441862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78500f68e4cb4b469839a0c844301e35'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:34.376182 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1334/2669] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:52:34 2022] DELETE /identity/v3/users/78500f68e4cb4b469839a0c844301e35 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:34.651603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcddf3a-29bb-454b-b284-7fe116172349 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:34.653540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-1fcddf3a-29bb-454b-b284-7fe116172349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:34.667616 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcddf3a-29bb-454b-b284-7fe116172349 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:34.734457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbea56-acbf-4d5b-819c-ad6bf8237b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:34.735095 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbea56-acbf-4d5b-819c-ad6bf8237b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:34.735376 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbea56-acbf-4d5b-819c-ad6bf8237b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:34.735663 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbea56-acbf-4d5b-819c-ad6bf8237b3f admin admin] PATH_INFO: `/v3/projects/00351afc20ef487aa114c84bd6c1831d` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:34.736804 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbea56-acbf-4d5b-819c-ad6bf8237b3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=00351afc20ef487aa114c84bd6c1831d)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:34.738709 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbea56-acbf-4d5b-819c-ad6bf8237b3f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:34.784922 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-08fbea56-acbf-4d5b-819c-ad6bf8237b3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00351afc20ef487aa114c84bd6c1831d', 'request_id': 'req-08fbea56-acbf-4d5b-819c-ad6bf8237b3f'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:34.791780 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-08fbea56-acbf-4d5b-819c-ad6bf8237b3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00351afc20ef487aa114c84bd6c1831d', 'request_id': 'req-08fbea56-acbf-4d5b-819c-ad6bf8237b3f'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:34.799735 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-08fbea56-acbf-4d5b-819c-ad6bf8237b3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00351afc20ef487aa114c84bd6c1831d', 'request_id': 'req-08fbea56-acbf-4d5b-819c-ad6bf8237b3f'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:34.804425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:34.812850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-08fbea56-acbf-4d5b-819c-ad6bf8237b3f admin admin] The token cache is being invalidate because project 00351afc20ef487aa114c84bd6c1831d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:52:34.813387 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-08fbea56-acbf-4d5b-819c-ad6bf8237b3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:34.814268 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-08fbea56-acbf-4d5b-819c-ad6bf8237b3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:34.815726 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1336/2670] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:52:34 2022] DELETE /identity/v3/projects/00351afc20ef487aa114c84bd6c1831d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:34.821397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60191b-123f-4896-81c4-3c25bf188829 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:34.821866 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60191b-123f-4896-81c4-3c25bf188829 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:34.821959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60191b-123f-4896-81c4-3c25bf188829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:34.841232 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3f60191b-123f-4896-81c4-3c25bf188829 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:34.842466 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3f60191b-123f-4896-81c4-3c25bf188829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:34.888379 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:34.904531 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1335/2671] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:34.912313 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e27a36-4ec6-431f-a36c-66efe432c6e9 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:34.912651 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e27a36-4ec6-431f-a36c-66efe432c6e9 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:34.912954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e27a36-4ec6-431f-a36c-66efe432c6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:34.932715 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-a9e27a36-4ec6-431f-a36c-66efe432c6e9 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:34.933929 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a9e27a36-4ec6-431f-a36c-66efe432c6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:34.941621 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1337/2672] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:34.946337 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60191b-123f-4896-81c4-3c25bf188829 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:34.955861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60191b-123f-4896-81c4-3c25bf188829 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:34.960367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a552b-59db-440e-8b40-e9a36a7f9e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:34.960997 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a552b-59db-440e-8b40-e9a36a7f9e9c admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:34.961535 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a552b-59db-440e-8b40-e9a36a7f9e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:34.961810 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a552b-59db-440e-8b40-e9a36a7f9e9c admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:34.962448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a552b-59db-440e-8b40-e9a36a7f9e9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:52:34.962749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a552b-59db-440e-8b40-e9a36a7f9e9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:34.964322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a552b-59db-440e-8b40-e9a36a7f9e9c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:34.975619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1336/2673] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:52:34.979678 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e27a36-4ec6-431f-a36c-66efe432c6e9 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:34.988656 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e27a36-4ec6-431f-a36c-66efe432c6e9 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:34.993665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31353bf-0351-44e9-8c8d-ceaef253c01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:34.994242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31353bf-0351-44e9-8c8d-ceaef253c01f admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:34.994519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31353bf-0351-44e9-8c8d-ceaef253c01f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:34.994788 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31353bf-0351-44e9-8c8d-ceaef253c01f admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:34.995411 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31353bf-0351-44e9-8c8d-ceaef253c01f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:34.997329 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31353bf-0351-44e9-8c8d-ceaef253c01f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:35.024183 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1338/2674] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:52:34 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:52:35.028253 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a552b-59db-440e-8b40-e9a36a7f9e9c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:35.038745 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a552b-59db-440e-8b40-e9a36a7f9e9c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:35.094824 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e811b24-e60e-4c35-95d1-5b0cb164611a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:35.095416 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e811b24-e60e-4c35-95d1-5b0cb164611a admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:35.095694 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e811b24-e60e-4c35-95d1-5b0cb164611a admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:35.095965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e811b24-e60e-4c35-95d1-5b0cb164611a admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:35.096615 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e811b24-e60e-4c35-95d1-5b0cb164611a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:35.098532 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e811b24-e60e-4c35-95d1-5b0cb164611a admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:35.118974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1337/2675] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:52:35 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:52:35.123100 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31353bf-0351-44e9-8c8d-ceaef253c01f admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:35.133642 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31353bf-0351-44e9-8c8d-ceaef253c01f admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:35.138111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35f8d9-365b-4520-8975-1e4b437fdc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:35.138696 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35f8d9-365b-4520-8975-1e4b437fdc9c admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:35.138978 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35f8d9-365b-4520-8975-1e4b437fdc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:35.139249 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35f8d9-365b-4520-8975-1e4b437fdc9c admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:35.139881 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35f8d9-365b-4520-8975-1e4b437fdc9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:35.141585 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35f8d9-365b-4520-8975-1e4b437fdc9c admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:35.151892 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1339/2676] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:52:35.155625 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e811b24-e60e-4c35-95d1-5b0cb164611a admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:35.165393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e811b24-e60e-4c35-95d1-5b0cb164611a admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:35.169898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77882c81-2268-4ed2-a249-65c9a947fbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:35.170474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77882c81-2268-4ed2-a249-65c9a947fbeb admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:35.170749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77882c81-2268-4ed2-a249-65c9a947fbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:35.171015 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77882c81-2268-4ed2-a249-65c9a947fbeb admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:35.171644 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77882c81-2268-4ed2-a249-65c9a947fbeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:35.173233 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77882c81-2268-4ed2-a249-65c9a947fbeb admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:35.183424 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1338/2677] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:52:35.187415 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35f8d9-365b-4520-8975-1e4b437fdc9c admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:35.197622 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35f8d9-365b-4520-8975-1e4b437fdc9c admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:35.202041 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022f71b-5474-4c36-bddd-fa0de2605f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:35.202694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f71b-5474-4c36-bddd-fa0de2605f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:35.202971 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f71b-5474-4c36-bddd-fa0de2605f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:35.203243 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f71b-5474-4c36-bddd-fa0de2605f0f admin admin] PATH_INFO: `/v3/projects/f896d084240c4161be00f02e589e1a4d/users/93f88cd5771e41038dd9e07c755ae273/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:35.218779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022f71b-5474-4c36-bddd-fa0de2605f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f896d084240c4161be00f02e589e1a4d, user_id=93f88cd5771e41038dd9e07c755ae273, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:35.221386 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022f71b-5474-4c36-bddd-fa0de2605f0f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:35.234214 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1340/2678] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:52:35 2022] PUT /identity/v3/projects/f896d084240c4161be00f02e589e1a4d/users/93f88cd5771e41038dd9e07c755ae273/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:35.244499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c7438-450b-41c1-9b9e-1cd6934dd62f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:35.244819 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c7438-450b-41c1-9b9e-1cd6934dd62f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:35.245132 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c7438-450b-41c1-9b9e-1cd6934dd62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:35.273927 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-1b3c7438-450b-41c1-9b9e-1cd6934dd62f None None] MFA Rules not processed for user `93f88cd5771e41038dd9e07c755ae273`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:35.275129 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1b3c7438-450b-41c1-9b9e-1cd6934dd62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:35.339868 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1339/2679] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:35.345079 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022f71b-5474-4c36-bddd-fa0de2605f0f admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:35.404537 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022f71b-5474-4c36-bddd-fa0de2605f0f admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:35.409083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c56a25-3602-42b2-894e-8ba4806f5bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:35.409672 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c56a25-3602-42b2-894e-8ba4806f5bac admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:35.409946 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c56a25-3602-42b2-894e-8ba4806f5bac admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:35.410221 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c56a25-3602-42b2-894e-8ba4806f5bac admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:35.410846 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c56a25-3602-42b2-894e-8ba4806f5bac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:35.412762 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c56a25-3602-42b2-894e-8ba4806f5bac admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:35.438503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1341/2680] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:52:35 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:52:35.442558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c7438-450b-41c1-9b9e-1cd6934dd62f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:35.453903 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c7438-450b-41c1-9b9e-1cd6934dd62f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:35.494576 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:35.510452 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d672f6-7d64-4f4b-b09e-c1e30fc29f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:35.511045 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d672f6-7d64-4f4b-b09e-c1e30fc29f59 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:35.511321 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d672f6-7d64-4f4b-b09e-c1e30fc29f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:35.511592 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d672f6-7d64-4f4b-b09e-c1e30fc29f59 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:35.512204 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d672f6-7d64-4f4b-b09e-c1e30fc29f59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:35.514113 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d672f6-7d64-4f4b-b09e-c1e30fc29f59 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:35.534251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1340/2681] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:52:35 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:52:35.538266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c56a25-3602-42b2-894e-8ba4806f5bac admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:35.548327 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c56a25-3602-42b2-894e-8ba4806f5bac admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:35.553593 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6797e-61e3-40eb-bcde-9e59674d8423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:35.554184 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6797e-61e3-40eb-bcde-9e59674d8423 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:35.554461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6797e-61e3-40eb-bcde-9e59674d8423 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:35.554733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6797e-61e3-40eb-bcde-9e59674d8423 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:35.555371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6797e-61e3-40eb-bcde-9e59674d8423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:35.556999 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6797e-61e3-40eb-bcde-9e59674d8423 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:35.567337 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1342/2682] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:52:35.571819 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d672f6-7d64-4f4b-b09e-c1e30fc29f59 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:35.581287 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d672f6-7d64-4f4b-b09e-c1e30fc29f59 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:35.585805 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b6afb-f148-4c65-b444-e2c2dfad8cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:35.586703 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b6afb-f148-4c65-b444-e2c2dfad8cec admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:35.586978 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b6afb-f148-4c65-b444-e2c2dfad8cec admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:35.587248 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b6afb-f148-4c65-b444-e2c2dfad8cec admin admin] PATH_INFO: `/v3/projects/5c880dd351464ff2b991fa10eaa1c497/users/e1b1fbfbded64964aee719596070beae/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:35.601478 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b6afb-f148-4c65-b444-e2c2dfad8cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c880dd351464ff2b991fa10eaa1c497, user_id=e1b1fbfbded64964aee719596070beae, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:35.603992 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b6afb-f148-4c65-b444-e2c2dfad8cec admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:35.617252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1341/2683] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:52:35 2022] PUT /identity/v3/projects/5c880dd351464ff2b991fa10eaa1c497/users/e1b1fbfbded64964aee719596070beae/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:35.621181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6797e-61e3-40eb-bcde-9e59674d8423 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:35.631622 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6797e-61e3-40eb-bcde-9e59674d8423 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:35.686469 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f5416-6425-4ff2-aa2f-990d44f98548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:35.687091 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f5416-6425-4ff2-aa2f-990d44f98548 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:35.687370 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f5416-6425-4ff2-aa2f-990d44f98548 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:35.687655 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f5416-6425-4ff2-aa2f-990d44f98548 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:35.688277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f5416-6425-4ff2-aa2f-990d44f98548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:35.689919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f5416-6425-4ff2-aa2f-990d44f98548 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:35.695425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:35.701232 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1343/2684] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:52:35.704755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b6afb-f148-4c65-b444-e2c2dfad8cec admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:35.715461 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b6afb-f148-4c65-b444-e2c2dfad8cec admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:35.720172 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688ce7-2e0a-44ed-8eb5-c227bd7501fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:35.720847 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688ce7-2e0a-44ed-8eb5-c227bd7501fa admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:35.721127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688ce7-2e0a-44ed-8eb5-c227bd7501fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:35.721400 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688ce7-2e0a-44ed-8eb5-c227bd7501fa admin admin] PATH_INFO: `/v3/projects/5c880dd351464ff2b991fa10eaa1c497/users/e1b1fbfbded64964aee719596070beae/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:35.723288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8688ce7-2e0a-44ed-8eb5-c227bd7501fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c880dd351464ff2b991fa10eaa1c497, user_id=e1b1fbfbded64964aee719596070beae, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:35.725921 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8688ce7-2e0a-44ed-8eb5-c227bd7501fa admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:35.735993 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1342/2685] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:52:35 2022] PUT /identity/v3/projects/5c880dd351464ff2b991fa10eaa1c497/users/e1b1fbfbded64964aee719596070beae/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:35.747683 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415ff66-87e5-45dd-8342-9b3f1bca61f1 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:35.748164 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415ff66-87e5-45dd-8342-9b3f1bca61f1 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:35.748266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415ff66-87e5-45dd-8342-9b3f1bca61f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:35.776967 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-3415ff66-87e5-45dd-8342-9b3f1bca61f1 None None] MFA Rules not processed for user `e1b1fbfbded64964aee719596070beae`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:35.778187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3415ff66-87e5-45dd-8342-9b3f1bca61f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:35.844216 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1344/2686] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:35.855963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688ce7-2e0a-44ed-8eb5-c227bd7501fa admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:35.857820 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c8688ce7-2e0a-44ed-8eb5-c227bd7501fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:35.915246 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688ce7-2e0a-44ed-8eb5-c227bd7501fa admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:35.918841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34f14b-2d9c-4d67-8938-7c1c8cfe9dc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:35.919435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34f14b-2d9c-4d67-8938-7c1c8cfe9dc0 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:35.919712 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34f14b-2d9c-4d67-8938-7c1c8cfe9dc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:35.919980 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34f14b-2d9c-4d67-8938-7c1c8cfe9dc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:35.929322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34f14b-2d9c-4d67-8938-7c1c8cfe9dc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:35.930719 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34f14b-2d9c-4d67-8938-7c1c8cfe9dc0 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:35.939879 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1343/2687] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:36.018382 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415ff66-87e5-45dd-8342-9b3f1bca61f1 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:36.027834 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415ff66-87e5-45dd-8342-9b3f1bca61f1 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:36.031363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d85e86-4a24-48f8-9e5c-0b80f03f00f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:36.031950 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d85e86-4a24-48f8-9e5c-0b80f03f00f2 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:36.032225 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d85e86-4a24-48f8-9e5c-0b80f03f00f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:36.032496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d85e86-4a24-48f8-9e5c-0b80f03f00f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:36.093024 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d85e86-4a24-48f8-9e5c-0b80f03f00f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:36.094445 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d85e86-4a24-48f8-9e5c-0b80f03f00f2 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:36.103739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1345/2688] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:40.777985 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34f14b-2d9c-4d67-8938-7c1c8cfe9dc0 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:40.838155 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34f14b-2d9c-4d67-8938-7c1c8cfe9dc0 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:40.842605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720f9f5-63ef-40a4-9b3f-5328f6864e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:40.843218 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720f9f5-63ef-40a4-9b3f-5328f6864e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:40.843494 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720f9f5-63ef-40a4-9b3f-5328f6864e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:40.843760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720f9f5-63ef-40a4-9b3f-5328f6864e5f admin admin] PATH_INFO: `/v3/users/93f88cd5771e41038dd9e07c755ae273` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:40.844943 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720f9f5-63ef-40a4-9b3f-5328f6864e5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f88cd5771e41038dd9e07c755ae273)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:40.846764 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720f9f5-63ef-40a4-9b3f-5328f6864e5f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:40.886583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:40.891907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d720f9f5-63ef-40a4-9b3f-5328f6864e5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f88cd5771e41038dd9e07c755ae273'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:40.900104 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d720f9f5-63ef-40a4-9b3f-5328f6864e5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f88cd5771e41038dd9e07c755ae273'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:40.900757 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d720f9f5-63ef-40a4-9b3f-5328f6864e5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f88cd5771e41038dd9e07c755ae273'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:40.901358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d720f9f5-63ef-40a4-9b3f-5328f6864e5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f88cd5771e41038dd9e07c755ae273'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:40.908392 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d720f9f5-63ef-40a4-9b3f-5328f6864e5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f88cd5771e41038dd9e07c755ae273'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:40.925623 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1344/2689] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:52:40 2022] DELETE /identity/v3/users/93f88cd5771e41038dd9e07c755ae273 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:40.930103 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f61ed-39ca-45bf-a939-2b88c498bc3a None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:40.930579 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f61ed-39ca-45bf-a939-2b88c498bc3a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:40.930694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f61ed-39ca-45bf-a939-2b88c498bc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:40.949272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-419f61ed-39ca-45bf-a939-2b88c498bc3a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:40.950470 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-419f61ed-39ca-45bf-a939-2b88c498bc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:41.008334 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1346/2690] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:41.018079 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720f9f5-63ef-40a4-9b3f-5328f6864e5f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:41.019504 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d720f9f5-63ef-40a4-9b3f-5328f6864e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:41.075346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720f9f5-63ef-40a4-9b3f-5328f6864e5f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:41.078931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45909b-a1d6-4e40-b4d6-cff21d70ea15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:41.079522 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45909b-a1d6-4e40-b4d6-cff21d70ea15 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:41.079802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45909b-a1d6-4e40-b4d6-cff21d70ea15 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:41.080072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45909b-a1d6-4e40-b4d6-cff21d70ea15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:41.090379 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45909b-a1d6-4e40-b4d6-cff21d70ea15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:41.091979 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45909b-a1d6-4e40-b4d6-cff21d70ea15 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:41.101610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1345/2691] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:41.371950 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f61ed-39ca-45bf-a939-2b88c498bc3a None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:41.373557 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-419f61ed-39ca-45bf-a939-2b88c498bc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:41.386412 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f61ed-39ca-45bf-a939-2b88c498bc3a None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:41.391087 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933a668-ab30-427e-be8f-e7cfaa23aada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:41.391834 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933a668-ab30-427e-be8f-e7cfaa23aada admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:41.392176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933a668-ab30-427e-be8f-e7cfaa23aada admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:41.392473 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933a668-ab30-427e-be8f-e7cfaa23aada admin admin] PATH_INFO: `/v3/projects/f896d084240c4161be00f02e589e1a4d` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:41.393600 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933a668-ab30-427e-be8f-e7cfaa23aada admin admin] RBAC: Authorizing `identity:delete_project(project_id=f896d084240c4161be00f02e589e1a4d)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:41.395486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933a668-ab30-427e-be8f-e7cfaa23aada admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:41.417313 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:41.442962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d933a668-ab30-427e-be8f-e7cfaa23aada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f896d084240c4161be00f02e589e1a4d', 'request_id': 'req-d933a668-ab30-427e-be8f-e7cfaa23aada'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:41.449820 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d933a668-ab30-427e-be8f-e7cfaa23aada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f896d084240c4161be00f02e589e1a4d', 'request_id': 'req-d933a668-ab30-427e-be8f-e7cfaa23aada'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:41.457518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d933a668-ab30-427e-be8f-e7cfaa23aada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f896d084240c4161be00f02e589e1a4d', 'request_id': 'req-d933a668-ab30-427e-be8f-e7cfaa23aada'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:41.468244 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d933a668-ab30-427e-be8f-e7cfaa23aada admin admin] The token cache is being invalidate because project f896d084240c4161be00f02e589e1a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:52:41.468535 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d933a668-ab30-427e-be8f-e7cfaa23aada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:41.469186 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d933a668-ab30-427e-be8f-e7cfaa23aada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:41.470663 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1347/2692] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:52:41 2022] DELETE /identity/v3/projects/f896d084240c4161be00f02e589e1a4d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:41.474686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45909b-a1d6-4e40-b4d6-cff21d70ea15 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:41.484226 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45909b-a1d6-4e40-b4d6-cff21d70ea15 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:41.539333 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a553ba-ac1a-4f14-a50c-21dcbc47e2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:41.539953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a553ba-ac1a-4f14-a50c-21dcbc47e2f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:41.540232 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a553ba-ac1a-4f14-a50c-21dcbc47e2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:41.540510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a553ba-ac1a-4f14-a50c-21dcbc47e2f9 admin admin] PATH_INFO: `/v3/users/e1b1fbfbded64964aee719596070beae` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:41.541660 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a553ba-ac1a-4f14-a50c-21dcbc47e2f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1b1fbfbded64964aee719596070beae)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:41.543545 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a553ba-ac1a-4f14-a50c-21dcbc47e2f9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:41.588464 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-92a553ba-ac1a-4f14-a50c-21dcbc47e2f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1b1fbfbded64964aee719596070beae'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:41.594910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-92a553ba-ac1a-4f14-a50c-21dcbc47e2f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1b1fbfbded64964aee719596070beae'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:41.595732 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-92a553ba-ac1a-4f14-a50c-21dcbc47e2f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1b1fbfbded64964aee719596070beae'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:41.596346 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-92a553ba-ac1a-4f14-a50c-21dcbc47e2f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1b1fbfbded64964aee719596070beae'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:41.603122 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-92a553ba-ac1a-4f14-a50c-21dcbc47e2f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1b1fbfbded64964aee719596070beae'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:41.604209 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:41.622224 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1346/2693] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:52:41 2022] DELETE /identity/v3/users/e1b1fbfbded64964aee719596070beae => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:52:41.902047 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933a668-ab30-427e-be8f-e7cfaa23aada admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:41.903497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d933a668-ab30-427e-be8f-e7cfaa23aada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:41.919286 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933a668-ab30-427e-be8f-e7cfaa23aada admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:41.974102 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d570a78-c0dd-43bf-b865-d17c347836ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:41.975302 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d570a78-c0dd-43bf-b865-d17c347836ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:41.975512 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d570a78-c0dd-43bf-b865-d17c347836ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:41.975777 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d570a78-c0dd-43bf-b865-d17c347836ba admin admin] PATH_INFO: `/v3/projects/5c880dd351464ff2b991fa10eaa1c497` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:41.976910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d570a78-c0dd-43bf-b865-d17c347836ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c880dd351464ff2b991fa10eaa1c497)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:41.978846 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d570a78-c0dd-43bf-b865-d17c347836ba admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:42.023633 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-5d570a78-c0dd-43bf-b865-d17c347836ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c880dd351464ff2b991fa10eaa1c497', 'request_id': 'req-5d570a78-c0dd-43bf-b865-d17c347836ba'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:42.029692 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-5d570a78-c0dd-43bf-b865-d17c347836ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c880dd351464ff2b991fa10eaa1c497', 'request_id': 'req-5d570a78-c0dd-43bf-b865-d17c347836ba'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:42.037395 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-5d570a78-c0dd-43bf-b865-d17c347836ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c880dd351464ff2b991fa10eaa1c497', 'request_id': 'req-5d570a78-c0dd-43bf-b865-d17c347836ba'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:42.047467 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-5d570a78-c0dd-43bf-b865-d17c347836ba admin admin] The token cache is being invalidate because project 5c880dd351464ff2b991fa10eaa1c497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:52:42.047751 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-5d570a78-c0dd-43bf-b865-d17c347836ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:42.048355 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-5d570a78-c0dd-43bf-b865-d17c347836ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:42.049830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1348/2694] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:52:41 2022] DELETE /identity/v3/projects/5c880dd351464ff2b991fa10eaa1c497 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:42.055173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32e1d8-ac70-41a8-969c-a3402a3a7a00 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:42.055631 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32e1d8-ac70-41a8-969c-a3402a3a7a00 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:42.055726 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32e1d8-ac70-41a8-969c-a3402a3a7a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:42.075261 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-0a32e1d8-ac70-41a8-969c-a3402a3a7a00 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:42.076443 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0a32e1d8-ac70-41a8-969c-a3402a3a7a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:42.140564 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1347/2695] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:42.149747 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96792a-f118-4b6e-a4cf-669cbb5cc666 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:42.149969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96792a-f118-4b6e-a4cf-669cbb5cc666 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:42.150239 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96792a-f118-4b6e-a4cf-669cbb5cc666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:42.171468 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-7d96792a-f118-4b6e-a4cf-669cbb5cc666 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:42.172688 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7d96792a-f118-4b6e-a4cf-669cbb5cc666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:42.180389 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1349/2696] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:42.184599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32e1d8-ac70-41a8-969c-a3402a3a7a00 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:42.194194 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32e1d8-ac70-41a8-969c-a3402a3a7a00 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:42.198674 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1009c8-c719-4ea0-bd16-61e76e301f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:42.199259 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1009c8-c719-4ea0-bd16-61e76e301f28 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:42.199537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1009c8-c719-4ea0-bd16-61e76e301f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:42.199806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1009c8-c719-4ea0-bd16-61e76e301f28 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:42.200441 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1009c8-c719-4ea0-bd16-61e76e301f28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:52:42.200796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1009c8-c719-4ea0-bd16-61e76e301f28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:42.202351 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1009c8-c719-4ea0-bd16-61e76e301f28 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:42.214421 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1348/2697] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:52:42.218368 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96792a-f118-4b6e-a4cf-669cbb5cc666 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:42.227981 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96792a-f118-4b6e-a4cf-669cbb5cc666 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:42.232426 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b08975-1e4c-4ce4-bfdf-9d770ef56e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:42.233033 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b08975-1e4c-4ce4-bfdf-9d770ef56e47 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:42.233313 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b08975-1e4c-4ce4-bfdf-9d770ef56e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:42.233586 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b08975-1e4c-4ce4-bfdf-9d770ef56e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:42.234213 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b08975-1e4c-4ce4-bfdf-9d770ef56e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:42.236056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b08975-1e4c-4ce4-bfdf-9d770ef56e47 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:42.264235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1350/2698] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:52:42 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:52:42.268384 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1009c8-c719-4ea0-bd16-61e76e301f28 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:42.279540 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1009c8-c719-4ea0-bd16-61e76e301f28 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:42.334128 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79def4a8-7b80-4043-8bed-1e8092f63c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:42.334731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79def4a8-7b80-4043-8bed-1e8092f63c12 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:42.335013 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79def4a8-7b80-4043-8bed-1e8092f63c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:42.335319 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79def4a8-7b80-4043-8bed-1e8092f63c12 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:42.336016 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79def4a8-7b80-4043-8bed-1e8092f63c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:42.338382 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79def4a8-7b80-4043-8bed-1e8092f63c12 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:42.359661 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1349/2699] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:52:42 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:52:42.363885 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b08975-1e4c-4ce4-bfdf-9d770ef56e47 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:42.374233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b08975-1e4c-4ce4-bfdf-9d770ef56e47 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:42.378736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a2941-3f54-4586-9545-f15b09c2fd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:42.379326 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a2941-3f54-4586-9545-f15b09c2fd53 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:42.379601 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a2941-3f54-4586-9545-f15b09c2fd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:42.379872 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a2941-3f54-4586-9545-f15b09c2fd53 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:42.380501 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a2941-3f54-4586-9545-f15b09c2fd53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:42.382112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a2941-3f54-4586-9545-f15b09c2fd53 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:42.384108 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:42.393971 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1351/2700] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:52:42.398289 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79def4a8-7b80-4043-8bed-1e8092f63c12 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:42.408033 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79def4a8-7b80-4043-8bed-1e8092f63c12 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:42.413493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ab827-74b8-47a7-a87c-f6fcc0bb5a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:42.414091 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ab827-74b8-47a7-a87c-f6fcc0bb5a00 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:42.414373 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ab827-74b8-47a7-a87c-f6fcc0bb5a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:42.414662 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ab827-74b8-47a7-a87c-f6fcc0bb5a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:42.415294 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ab827-74b8-47a7-a87c-f6fcc0bb5a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:42.416919 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ab827-74b8-47a7-a87c-f6fcc0bb5a00 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:42.427435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1350/2701] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:52:42.431567 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a2941-3f54-4586-9545-f15b09c2fd53 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:42.441423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a2941-3f54-4586-9545-f15b09c2fd53 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:42.447385 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ec5ff-0472-4d27-baaa-0986bbc5eed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:42.448019 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ec5ff-0472-4d27-baaa-0986bbc5eed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:42.448297 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ec5ff-0472-4d27-baaa-0986bbc5eed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:42.448590 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ec5ff-0472-4d27-baaa-0986bbc5eed3 admin admin] PATH_INFO: `/v3/projects/efe6d694a6d442ff8a271eeeed030063/users/f3bfd39604b14b9a869f92bd9859deef/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:42.464270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ec5ff-0472-4d27-baaa-0986bbc5eed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe6d694a6d442ff8a271eeeed030063, user_id=f3bfd39604b14b9a869f92bd9859deef, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:42.466905 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ec5ff-0472-4d27-baaa-0986bbc5eed3 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:42.479926 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1352/2702] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:52:42 2022] PUT /identity/v3/projects/efe6d694a6d442ff8a271eeeed030063/users/f3bfd39604b14b9a869f92bd9859deef/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:42.490206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c01147-a25b-4051-b3ec-09642c04f125 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:42.490542 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c01147-a25b-4051-b3ec-09642c04f125 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:42.490857 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c01147-a25b-4051-b3ec-09642c04f125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:42.517945 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-34c01147-a25b-4051-b3ec-09642c04f125 None None] MFA Rules not processed for user `f3bfd39604b14b9a869f92bd9859deef`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:42.519147 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-34c01147-a25b-4051-b3ec-09642c04f125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:42.552271 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:42.584927 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1351/2703] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:42.589611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ec5ff-0472-4d27-baaa-0986bbc5eed3 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:42.650098 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ec5ff-0472-4d27-baaa-0986bbc5eed3 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:42.654636 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e28fa7-e161-46cc-8833-b46c2598b77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:42.655226 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e28fa7-e161-46cc-8833-b46c2598b77b admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:42.655510 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e28fa7-e161-46cc-8833-b46c2598b77b admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:42.655782 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e28fa7-e161-46cc-8833-b46c2598b77b admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:42.656413 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e28fa7-e161-46cc-8833-b46c2598b77b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:42.658428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e28fa7-e161-46cc-8833-b46c2598b77b admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:42.684571 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1353/2704] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:52:42 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:52:42.688920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c01147-a25b-4051-b3ec-09642c04f125 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:42.700029 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c01147-a25b-4051-b3ec-09642c04f125 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:42.757102 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc3afc-2a93-4afb-83ed-70599ea70811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:42.757702 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc3afc-2a93-4afb-83ed-70599ea70811 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:42.757977 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc3afc-2a93-4afb-83ed-70599ea70811 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:42.758245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc3afc-2a93-4afb-83ed-70599ea70811 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:42.758854 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc3afc-2a93-4afb-83ed-70599ea70811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:42.760740 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc3afc-2a93-4afb-83ed-70599ea70811 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:42.781973 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1352/2705] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:52:42 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:52:42.785948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e28fa7-e161-46cc-8833-b46c2598b77b admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:42.795979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e28fa7-e161-46cc-8833-b46c2598b77b admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:42.800503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad8988-a989-4deb-ba30-9b683804a7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:42.801111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad8988-a989-4deb-ba30-9b683804a7fc admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:42.801387 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad8988-a989-4deb-ba30-9b683804a7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:42.801656 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad8988-a989-4deb-ba30-9b683804a7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:42.802285 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad8988-a989-4deb-ba30-9b683804a7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:42.803882 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad8988-a989-4deb-ba30-9b683804a7fc admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:42.814032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1354/2706] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:52:42.818443 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc3afc-2a93-4afb-83ed-70599ea70811 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:42.828043 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc3afc-2a93-4afb-83ed-70599ea70811 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:42.832575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ba0bb-8fd8-487c-b9f4-dd90ffe82df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:42.833197 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ba0bb-8fd8-487c-b9f4-dd90ffe82df9 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:42.833475 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ba0bb-8fd8-487c-b9f4-dd90ffe82df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:42.834354 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ba0bb-8fd8-487c-b9f4-dd90ffe82df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:42.834987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ba0bb-8fd8-487c-b9f4-dd90ffe82df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:42.836835 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ba0bb-8fd8-487c-b9f4-dd90ffe82df9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:42.846480 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1353/2707] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:52:42.850323 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad8988-a989-4deb-ba30-9b683804a7fc admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:42.859979 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad8988-a989-4deb-ba30-9b683804a7fc admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:42.864498 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c446d-cd2b-44b7-b71c-5322fd99a5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:42.865161 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c446d-cd2b-44b7-b71c-5322fd99a5ee admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:42.865437 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c446d-cd2b-44b7-b71c-5322fd99a5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:42.865708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c446d-cd2b-44b7-b71c-5322fd99a5ee admin admin] PATH_INFO: `/v3/projects/1a411d0c9cd14eaba15321b41944c659/users/611807cf3cf94f8a883849e4b0e15749/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:42.879776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c446d-cd2b-44b7-b71c-5322fd99a5ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a411d0c9cd14eaba15321b41944c659, user_id=611807cf3cf94f8a883849e4b0e15749, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:42.882911 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c446d-cd2b-44b7-b71c-5322fd99a5ee admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:42.895206 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1355/2708] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:52:42 2022] PUT /identity/v3/projects/1a411d0c9cd14eaba15321b41944c659/users/611807cf3cf94f8a883849e4b0e15749/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:42.906888 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5d5ea-9c51-4e6e-a76e-0c40426e6698 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:42.907173 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5d5ea-9c51-4e6e-a76e-0c40426e6698 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:42.907448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5d5ea-9c51-4e6e-a76e-0c40426e6698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:42.935077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f8d5d5ea-9c51-4e6e-a76e-0c40426e6698 None None] MFA Rules not processed for user `611807cf3cf94f8a883849e4b0e15749`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:42.936226 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f8d5d5ea-9c51-4e6e-a76e-0c40426e6698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:42.999548 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1354/2709] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:43.004196 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c446d-cd2b-44b7-b71c-5322fd99a5ee admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:43.064178 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c446d-cd2b-44b7-b71c-5322fd99a5ee admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:43.069205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18806d-b62a-411f-b981-2e0b3e029742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:43.069788 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18806d-b62a-411f-b981-2e0b3e029742 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:43.070063 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18806d-b62a-411f-b981-2e0b3e029742 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:43.070333 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18806d-b62a-411f-b981-2e0b3e029742 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:43.070946 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18806d-b62a-411f-b981-2e0b3e029742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:43.072864 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18806d-b62a-411f-b981-2e0b3e029742 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:43.098245 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1356/2710] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:52:43 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:52:43.102450 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5d5ea-9c51-4e6e-a76e-0c40426e6698 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:43.112753 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5d5ea-9c51-4e6e-a76e-0c40426e6698 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:43.153395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:43.169203 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff34c7-e9c8-4fe9-8624-f67c5f770e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:43.169797 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff34c7-e9c8-4fe9-8624-f67c5f770e35 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:43.170072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff34c7-e9c8-4fe9-8624-f67c5f770e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:43.170343 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff34c7-e9c8-4fe9-8624-f67c5f770e35 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:43.170965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff34c7-e9c8-4fe9-8624-f67c5f770e35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:43.172870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff34c7-e9c8-4fe9-8624-f67c5f770e35 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:43.194316 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1355/2711] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:52:43 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:52:43.198165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18806d-b62a-411f-b981-2e0b3e029742 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:43.208102 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18806d-b62a-411f-b981-2e0b3e029742 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:43.213032 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b6475-3184-4166-823a-d8fae1d83883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:43.213628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b6475-3184-4166-823a-d8fae1d83883 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:43.213908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b6475-3184-4166-823a-d8fae1d83883 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:43.214179 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b6475-3184-4166-823a-d8fae1d83883 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:43.214817 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b6475-3184-4166-823a-d8fae1d83883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:43.216418 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b6475-3184-4166-823a-d8fae1d83883 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:43.218530 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:43.228089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1357/2712] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:52:43.231931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff34c7-e9c8-4fe9-8624-f67c5f770e35 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:43.242309 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff34c7-e9c8-4fe9-8624-f67c5f770e35 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:43.247001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82067708-55ed-485f-b40b-58f61e5b1231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:43.247649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82067708-55ed-485f-b40b-58f61e5b1231 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:43.247931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82067708-55ed-485f-b40b-58f61e5b1231 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:43.248207 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82067708-55ed-485f-b40b-58f61e5b1231 admin admin] PATH_INFO: `/v3/projects/407b0c631c484bd4930c15bba2d46cd5/users/6b1e43442d7044d29aab326f9340408e/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:43.262947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82067708-55ed-485f-b40b-58f61e5b1231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=407b0c631c484bd4930c15bba2d46cd5, user_id=6b1e43442d7044d29aab326f9340408e, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:43.265832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82067708-55ed-485f-b40b-58f61e5b1231 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:43.278773 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1356/2713] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:52:43 2022] PUT /identity/v3/projects/407b0c631c484bd4930c15bba2d46cd5/users/6b1e43442d7044d29aab326f9340408e/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:43.282712 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b6475-3184-4166-823a-d8fae1d83883 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:43.293256 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b6475-3184-4166-823a-d8fae1d83883 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:43.349338 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b536aee-b322-4377-938c-a883ea776f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:43.349943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b536aee-b322-4377-938c-a883ea776f32 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:43.350224 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b536aee-b322-4377-938c-a883ea776f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:43.350560 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b536aee-b322-4377-938c-a883ea776f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:43.351207 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b536aee-b322-4377-938c-a883ea776f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:43.352851 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b536aee-b322-4377-938c-a883ea776f32 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:43.362753 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1358/2714] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:52:43.366768 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82067708-55ed-485f-b40b-58f61e5b1231 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:43.376957 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82067708-55ed-485f-b40b-58f61e5b1231 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:43.381992 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6594e7-fe26-4e1d-8c51-5c380db59758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:43.382630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6594e7-fe26-4e1d-8c51-5c380db59758 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:43.382907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6594e7-fe26-4e1d-8c51-5c380db59758 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:43.383174 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6594e7-fe26-4e1d-8c51-5c380db59758 admin admin] PATH_INFO: `/v3/projects/407b0c631c484bd4930c15bba2d46cd5/users/6b1e43442d7044d29aab326f9340408e/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:43.385104 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6594e7-fe26-4e1d-8c51-5c380db59758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=407b0c631c484bd4930c15bba2d46cd5, user_id=6b1e43442d7044d29aab326f9340408e, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:43.387665 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6594e7-fe26-4e1d-8c51-5c380db59758 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:43.398171 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1357/2715] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:52:43 2022] PUT /identity/v3/projects/407b0c631c484bd4930c15bba2d46cd5/users/6b1e43442d7044d29aab326f9340408e/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:43.408015 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caf88f-6338-4e84-9cd7-8aebf4a812bb None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:43.408293 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caf88f-6338-4e84-9cd7-8aebf4a812bb None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:43.408598 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caf88f-6338-4e84-9cd7-8aebf4a812bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:43.435004 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-76caf88f-6338-4e84-9cd7-8aebf4a812bb None None] MFA Rules not processed for user `6b1e43442d7044d29aab326f9340408e`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:43.436193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-76caf88f-6338-4e84-9cd7-8aebf4a812bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:43.504114 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1359/2716] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:43.516109 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6594e7-fe26-4e1d-8c51-5c380db59758 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:43.517827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9f6594e7-fe26-4e1d-8c51-5c380db59758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:43.573794 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6594e7-fe26-4e1d-8c51-5c380db59758 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:43.577365 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe85f7-25c3-4fce-86d1-30bda29be032 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:43.577950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe85f7-25c3-4fce-86d1-30bda29be032 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:43.578224 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe85f7-25c3-4fce-86d1-30bda29be032 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:43.578491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe85f7-25c3-4fce-86d1-30bda29be032 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:43.633878 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe85f7-25c3-4fce-86d1-30bda29be032 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:43.635301 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe85f7-25c3-4fce-86d1-30bda29be032 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:43.644224 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1358/2717] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:45.138505 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76caf88f-6338-4e84-9cd7-8aebf4a812bb None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:45.139868 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-76caf88f-6338-4e84-9cd7-8aebf4a812bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:45.152116 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76caf88f-6338-4e84-9cd7-8aebf4a812bb None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:45.155666 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea79f6-16b0-4d57-8940-e61fffeeb875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:45.156252 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea79f6-16b0-4d57-8940-e61fffeeb875 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:45.156537 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea79f6-16b0-4d57-8940-e61fffeeb875 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:45.156838 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea79f6-16b0-4d57-8940-e61fffeeb875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:45.211584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea79f6-16b0-4d57-8940-e61fffeeb875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:45.213045 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea79f6-16b0-4d57-8940-e61fffeeb875 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:45.221768 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1360/2718] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:45.745947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe85f7-25c3-4fce-86d1-30bda29be032 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:45.754391 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe85f7-25c3-4fce-86d1-30bda29be032 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:45.758507 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbebd1d-53ca-4437-8541-488d9680c7bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:45.759103 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbebd1d-53ca-4437-8541-488d9680c7bc service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:45.759381 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbebd1d-53ca-4437-8541-488d9680c7bc service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:45.759651 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbebd1d-53ca-4437-8541-488d9680c7bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:45.769156 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbebd1d-53ca-4437-8541-488d9680c7bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:45.770576 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbebd1d-53ca-4437-8541-488d9680c7bc service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:45.780562 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1359/2719] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:49.640177 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea79f6-16b0-4d57-8940-e61fffeeb875 service cinder] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:49.659379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=100 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:49.702825 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea79f6-16b0-4d57-8940-e61fffeeb875 service cinder] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:49.707534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da822a84-f34c-4187-bb75-b2697ea0e844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:49.708154 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da822a84-f34c-4187-bb75-b2697ea0e844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:49.708431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da822a84-f34c-4187-bb75-b2697ea0e844 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:49.708734 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da822a84-f34c-4187-bb75-b2697ea0e844 admin admin] PATH_INFO: `/v3/users/f3bfd39604b14b9a869f92bd9859deef` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:49.709842 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da822a84-f34c-4187-bb75-b2697ea0e844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3bfd39604b14b9a869f92bd9859deef)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:49.711997 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da822a84-f34c-4187-bb75-b2697ea0e844 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:49.758612 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-da822a84-f34c-4187-bb75-b2697ea0e844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3bfd39604b14b9a869f92bd9859deef'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:49.765784 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-da822a84-f34c-4187-bb75-b2697ea0e844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3bfd39604b14b9a869f92bd9859deef'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:49.766419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-da822a84-f34c-4187-bb75-b2697ea0e844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3bfd39604b14b9a869f92bd9859deef'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:49.767037 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-da822a84-f34c-4187-bb75-b2697ea0e844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3bfd39604b14b9a869f92bd9859deef'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:49.774024 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-da822a84-f34c-4187-bb75-b2697ea0e844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3bfd39604b14b9a869f92bd9859deef'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:49.791718 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1361/2720] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:52:49 2022] DELETE /identity/v3/users/f3bfd39604b14b9a869f92bd9859deef => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:49.796361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d93ca-6746-496b-b647-8a6b032e00c7 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:49.796857 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d93ca-6746-496b-b647-8a6b032e00c7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:49.796974 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d93ca-6746-496b-b647-8a6b032e00c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:49.815959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-565d93ca-6746-496b-b647-8a6b032e00c7 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:49.817178 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-565d93ca-6746-496b-b647-8a6b032e00c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:49.848778 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:49.876519 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1360/2721] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:49.887017 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da822a84-f34c-4187-bb75-b2697ea0e844 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:49.888403 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-da822a84-f34c-4187-bb75-b2697ea0e844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:49.943969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da822a84-f34c-4187-bb75-b2697ea0e844 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:49.947536 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43d000-0429-4791-99f0-b3f30f149317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:49.948127 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43d000-0429-4791-99f0-b3f30f149317 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:49.948412 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43d000-0429-4791-99f0-b3f30f149317 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:49.948747 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43d000-0429-4791-99f0-b3f30f149317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:49.957647 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43d000-0429-4791-99f0-b3f30f149317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:49.959084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43d000-0429-4791-99f0-b3f30f149317 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:49.969265 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1362/2722] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:50.241051 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d93ca-6746-496b-b647-8a6b032e00c7 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:50.242467 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-565d93ca-6746-496b-b647-8a6b032e00c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:50.254823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d93ca-6746-496b-b647-8a6b032e00c7 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:50.259443 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a0350-2bc0-4b70-8b24-7811b12bcb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:50.260075 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a0350-2bc0-4b70-8b24-7811b12bcb89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:50.260355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a0350-2bc0-4b70-8b24-7811b12bcb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:50.260678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a0350-2bc0-4b70-8b24-7811b12bcb89 admin admin] PATH_INFO: `/v3/projects/efe6d694a6d442ff8a271eeeed030063` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:50.261805 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a0350-2bc0-4b70-8b24-7811b12bcb89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe6d694a6d442ff8a271eeeed030063)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:50.263994 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a0350-2bc0-4b70-8b24-7811b12bcb89 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:50.311475 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e04a0350-2bc0-4b70-8b24-7811b12bcb89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe6d694a6d442ff8a271eeeed030063', 'request_id': 'req-e04a0350-2bc0-4b70-8b24-7811b12bcb89'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:50.317901 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e04a0350-2bc0-4b70-8b24-7811b12bcb89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe6d694a6d442ff8a271eeeed030063', 'request_id': 'req-e04a0350-2bc0-4b70-8b24-7811b12bcb89'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:50.325001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e04a0350-2bc0-4b70-8b24-7811b12bcb89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe6d694a6d442ff8a271eeeed030063', 'request_id': 'req-e04a0350-2bc0-4b70-8b24-7811b12bcb89'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:50.335222 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e04a0350-2bc0-4b70-8b24-7811b12bcb89 admin admin] The token cache is being invalidate because project efe6d694a6d442ff8a271eeeed030063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:52:50.335509 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e04a0350-2bc0-4b70-8b24-7811b12bcb89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:50.336406 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e04a0350-2bc0-4b70-8b24-7811b12bcb89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:50.338239 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1361/2723] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:52:50 2022] DELETE /identity/v3/projects/efe6d694a6d442ff8a271eeeed030063 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:50.342490 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43d000-0429-4791-99f0-b3f30f149317 service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:50.352706 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43d000-0429-4791-99f0-b3f30f149317 service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:50.389497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:50.410547 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35db7ed-fba9-47c2-9d2d-5d9a52f0340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:50.411171 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35db7ed-fba9-47c2-9d2d-5d9a52f0340d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:50.412022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35db7ed-fba9-47c2-9d2d-5d9a52f0340d admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:50.412305 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35db7ed-fba9-47c2-9d2d-5d9a52f0340d admin admin] PATH_INFO: `/v3/users/611807cf3cf94f8a883849e4b0e15749` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:50.413454 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35db7ed-fba9-47c2-9d2d-5d9a52f0340d admin admin] RBAC: Authorizing `identity:delete_user(user_id=611807cf3cf94f8a883849e4b0e15749)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:50.415377 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35db7ed-fba9-47c2-9d2d-5d9a52f0340d admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:50.460317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-c35db7ed-fba9-47c2-9d2d-5d9a52f0340d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '611807cf3cf94f8a883849e4b0e15749'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:50.467516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-c35db7ed-fba9-47c2-9d2d-5d9a52f0340d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '611807cf3cf94f8a883849e4b0e15749'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:50.468135 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-c35db7ed-fba9-47c2-9d2d-5d9a52f0340d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '611807cf3cf94f8a883849e4b0e15749'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:50.468745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-c35db7ed-fba9-47c2-9d2d-5d9a52f0340d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '611807cf3cf94f8a883849e4b0e15749'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:50.476201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-c35db7ed-fba9-47c2-9d2d-5d9a52f0340d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '611807cf3cf94f8a883849e4b0e15749'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:50.493384 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1363/2724] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:52:50 2022] DELETE /identity/v3/users/611807cf3cf94f8a883849e4b0e15749 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:50.763423 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a0350-2bc0-4b70-8b24-7811b12bcb89 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:50.764876 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e04a0350-2bc0-4b70-8b24-7811b12bcb89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:50.780429 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a0350-2bc0-4b70-8b24-7811b12bcb89 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:50.837137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79259927-4f03-4a59-b530-ee7ae7f230df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:50.837747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79259927-4f03-4a59-b530-ee7ae7f230df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:50.838022 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79259927-4f03-4a59-b530-ee7ae7f230df admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:50.838298 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79259927-4f03-4a59-b530-ee7ae7f230df admin admin] PATH_INFO: `/v3/projects/1a411d0c9cd14eaba15321b41944c659` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:50.839395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79259927-4f03-4a59-b530-ee7ae7f230df admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a411d0c9cd14eaba15321b41944c659)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:50.841306 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79259927-4f03-4a59-b530-ee7ae7f230df admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:50.887047 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-79259927-4f03-4a59-b530-ee7ae7f230df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a411d0c9cd14eaba15321b41944c659', 'request_id': 'req-79259927-4f03-4a59-b530-ee7ae7f230df'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:50.893212 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-79259927-4f03-4a59-b530-ee7ae7f230df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a411d0c9cd14eaba15321b41944c659', 'request_id': 'req-79259927-4f03-4a59-b530-ee7ae7f230df'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:50.900978 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-79259927-4f03-4a59-b530-ee7ae7f230df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a411d0c9cd14eaba15321b41944c659', 'request_id': 'req-79259927-4f03-4a59-b530-ee7ae7f230df'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:50.902919 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:50.912992 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-79259927-4f03-4a59-b530-ee7ae7f230df admin admin] The token cache is being invalidate because project 1a411d0c9cd14eaba15321b41944c659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:52:50.913277 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-79259927-4f03-4a59-b530-ee7ae7f230df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:50.913898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-79259927-4f03-4a59-b530-ee7ae7f230df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:50.915378 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1362/2725] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:52:50 2022] DELETE /identity/v3/projects/1a411d0c9cd14eaba15321b41944c659 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:50.919382 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35db7ed-fba9-47c2-9d2d-5d9a52f0340d admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:50.920817 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c35db7ed-fba9-47c2-9d2d-5d9a52f0340d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:50.933129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35db7ed-fba9-47c2-9d2d-5d9a52f0340d admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:50.988998 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5cda3-598b-47fc-bc88-610cd3d6b591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:50.989627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5cda3-598b-47fc-bc88-610cd3d6b591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:50.989903 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5cda3-598b-47fc-bc88-610cd3d6b591 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:50.990174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5cda3-598b-47fc-bc88-610cd3d6b591 admin admin] PATH_INFO: `/v3/users/6b1e43442d7044d29aab326f9340408e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:50.991280 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5cda3-598b-47fc-bc88-610cd3d6b591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b1e43442d7044d29aab326f9340408e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:50.993252 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5cda3-598b-47fc-bc88-610cd3d6b591 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:51.041453 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-fce5cda3-598b-47fc-bc88-610cd3d6b591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b1e43442d7044d29aab326f9340408e'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:51.048756 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-fce5cda3-598b-47fc-bc88-610cd3d6b591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b1e43442d7044d29aab326f9340408e'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:51.049366 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-fce5cda3-598b-47fc-bc88-610cd3d6b591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b1e43442d7044d29aab326f9340408e'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:51.049965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-fce5cda3-598b-47fc-bc88-610cd3d6b591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b1e43442d7044d29aab326f9340408e'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:51.055352 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:51.057460 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-fce5cda3-598b-47fc-bc88-610cd3d6b591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b1e43442d7044d29aab326f9340408e'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:51.086741 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1364/2726] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:52:50 2022] DELETE /identity/v3/users/6b1e43442d7044d29aab326f9340408e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:51.350818 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79259927-4f03-4a59-b530-ee7ae7f230df admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:51.352332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-79259927-4f03-4a59-b530-ee7ae7f230df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:51.367871 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79259927-4f03-4a59-b530-ee7ae7f230df admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:51.425245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ab9ff-1e39-4a0d-bb63-940624b2cc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:51.425795 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ab9ff-1e39-4a0d-bb63-940624b2cc05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:51.426070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ab9ff-1e39-4a0d-bb63-940624b2cc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:51.426338 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ab9ff-1e39-4a0d-bb63-940624b2cc05 admin admin] PATH_INFO: `/v3/projects/407b0c631c484bd4930c15bba2d46cd5` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:51.427972 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ab9ff-1e39-4a0d-bb63-940624b2cc05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=407b0c631c484bd4930c15bba2d46cd5)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:51.429880 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ab9ff-1e39-4a0d-bb63-940624b2cc05 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:51.474258 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5f6ab9ff-1e39-4a0d-bb63-940624b2cc05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '407b0c631c484bd4930c15bba2d46cd5', 'request_id': 'req-5f6ab9ff-1e39-4a0d-bb63-940624b2cc05'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:51.480618 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5f6ab9ff-1e39-4a0d-bb63-940624b2cc05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '407b0c631c484bd4930c15bba2d46cd5', 'request_id': 'req-5f6ab9ff-1e39-4a0d-bb63-940624b2cc05'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:51.487959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5f6ab9ff-1e39-4a0d-bb63-940624b2cc05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '407b0c631c484bd4930c15bba2d46cd5', 'request_id': 'req-5f6ab9ff-1e39-4a0d-bb63-940624b2cc05'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:51.498600 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5f6ab9ff-1e39-4a0d-bb63-940624b2cc05 admin admin] The token cache is being invalidate because project 407b0c631c484bd4930c15bba2d46cd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:52:51.498885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5f6ab9ff-1e39-4a0d-bb63-940624b2cc05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:51.499501 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5f6ab9ff-1e39-4a0d-bb63-940624b2cc05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:52:51.500995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1363/2727] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:52:51 2022] DELETE /identity/v3/projects/407b0c631c484bd4930c15bba2d46cd5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:51.505891 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385264e-d3de-42da-aeb3-25d54b2d17b8 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:51.506174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385264e-d3de-42da-aeb3-25d54b2d17b8 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:51.506447 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385264e-d3de-42da-aeb3-25d54b2d17b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:51.526236 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-2385264e-d3de-42da-aeb3-25d54b2d17b8 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:51.527421 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-2385264e-d3de-42da-aeb3-25d54b2d17b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:51.585488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1365/2728] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:51.648957 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f41022-cfe8-4333-af84-50e2f1780a4f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:51.649240 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f41022-cfe8-4333-af84-50e2f1780a4f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:51.649510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f41022-cfe8-4333-af84-50e2f1780a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:51.668951 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-92f41022-cfe8-4333-af84-50e2f1780a4f None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:51.670185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-92f41022-cfe8-4333-af84-50e2f1780a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:51.678152 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1364/2729] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:51.682184 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385264e-d3de-42da-aeb3-25d54b2d17b8 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:51.691874 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385264e-d3de-42da-aeb3-25d54b2d17b8 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:51.697002 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d448c8c-cfb4-4724-bb9b-7c845d1f985a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:51.697600 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d448c8c-cfb4-4724-bb9b-7c845d1f985a admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:51.697884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d448c8c-cfb4-4724-bb9b-7c845d1f985a admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:51.698157 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d448c8c-cfb4-4724-bb9b-7c845d1f985a admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:51.698805 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d448c8c-cfb4-4724-bb9b-7c845d1f985a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:52:51.699111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d448c8c-cfb4-4724-bb9b-7c845d1f985a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:51.700728 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d448c8c-cfb4-4724-bb9b-7c845d1f985a admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:51.716147 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1366/2730] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:52:51.720157 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f41022-cfe8-4333-af84-50e2f1780a4f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:51.729244 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f41022-cfe8-4333-af84-50e2f1780a4f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:51.733788 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb19204-f0ff-4df0-83a2-f7f38536f921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:51.734359 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb19204-f0ff-4df0-83a2-f7f38536f921 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:51.734632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb19204-f0ff-4df0-83a2-f7f38536f921 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:51.734897 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb19204-f0ff-4df0-83a2-f7f38536f921 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:51.735520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb19204-f0ff-4df0-83a2-f7f38536f921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:51.737395 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb19204-f0ff-4df0-83a2-f7f38536f921 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:51.763475 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1365/2731] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:52:51 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:52:51.767603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d448c8c-cfb4-4724-bb9b-7c845d1f985a admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:51.778358 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d448c8c-cfb4-4724-bb9b-7c845d1f985a admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:51.834405 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff26f8f-b96b-4c38-841b-6e7f7f42d9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:51.835001 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff26f8f-b96b-4c38-841b-6e7f7f42d9ce admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:51.835277 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff26f8f-b96b-4c38-841b-6e7f7f42d9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:51.835546 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff26f8f-b96b-4c38-841b-6e7f7f42d9ce admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:51.836433 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff26f8f-b96b-4c38-841b-6e7f7f42d9ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:51.838397 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff26f8f-b96b-4c38-841b-6e7f7f42d9ce admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:51.861105 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1367/2732] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:52:51 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:52:51.865183 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb19204-f0ff-4df0-83a2-f7f38536f921 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:51.875570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb19204-f0ff-4df0-83a2-f7f38536f921 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:51.880623 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089259af-f472-4652-9844-d41228436422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:51.881217 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089259af-f472-4652-9844-d41228436422 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:51.881491 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089259af-f472-4652-9844-d41228436422 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:51.881777 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089259af-f472-4652-9844-d41228436422 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:51.882390 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089259af-f472-4652-9844-d41228436422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:51.883958 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089259af-f472-4652-9844-d41228436422 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:51.893768 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1366/2733] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 10:52:51.898290 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff26f8f-b96b-4c38-841b-6e7f7f42d9ce admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:51.908060 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff26f8f-b96b-4c38-841b-6e7f7f42d9ce admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:51.912575 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572aa14c-463d-43e4-b2e2-1308b79b123d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:51.913174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572aa14c-463d-43e4-b2e2-1308b79b123d admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:51.913451 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572aa14c-463d-43e4-b2e2-1308b79b123d admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:51.913722 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572aa14c-463d-43e4-b2e2-1308b79b123d admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:51.914356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572aa14c-463d-43e4-b2e2-1308b79b123d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:51.915916 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572aa14c-463d-43e4-b2e2-1308b79b123d admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:51.926139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1368/2734] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 10:52:51.930632 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089259af-f472-4652-9844-d41228436422 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:51.940166 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089259af-f472-4652-9844-d41228436422 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:51.945406 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68a50c-2283-4230-8b35-ffbc741754fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:51.946038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68a50c-2283-4230-8b35-ffbc741754fc admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:51.946315 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68a50c-2283-4230-8b35-ffbc741754fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:51.946586 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68a50c-2283-4230-8b35-ffbc741754fc admin admin] PATH_INFO: `/v3/projects/bd0e0673893a4de5ad012202a9ea7956/users/10e46658a7b342b38e7472dbbae1f719/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:51.960717 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68a50c-2283-4230-8b35-ffbc741754fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd0e0673893a4de5ad012202a9ea7956, user_id=10e46658a7b342b38e7472dbbae1f719, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:51.963568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68a50c-2283-4230-8b35-ffbc741754fc admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:51.977350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1367/2735] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:52:51 2022] PUT /identity/v3/projects/bd0e0673893a4de5ad012202a9ea7956/users/10e46658a7b342b38e7472dbbae1f719/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:52:51.982215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5769bab-47be-4b62-8313-a6d5bd5af1c7 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:51.982501 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5769bab-47be-4b62-8313-a6d5bd5af1c7 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:51.982776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5769bab-47be-4b62-8313-a6d5bd5af1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:52.001974 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-f5769bab-47be-4b62-8313-a6d5bd5af1c7 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:52.003182 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f5769bab-47be-4b62-8313-a6d5bd5af1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:52.043337 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:52.063617 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1369/2736] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:52.073926 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68a50c-2283-4230-8b35-ffbc741754fc admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:52.075742 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8b68a50c-2283-4230-8b35-ffbc741754fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:52.095910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:52:52.139004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68a50c-2283-4230-8b35-ffbc741754fc admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:52.142647 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3e7fb-e154-4045-86a7-8ed8e9e630f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:52.143249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3e7fb-e154-4045-86a7-8ed8e9e630f3 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:52.143528 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3e7fb-e154-4045-86a7-8ed8e9e630f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:52.143800 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3e7fb-e154-4045-86a7-8ed8e9e630f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:52.152868 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3e7fb-e154-4045-86a7-8ed8e9e630f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:52.154286 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3e7fb-e154-4045-86a7-8ed8e9e630f3 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:52.166717 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1368/2737] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:52.768378 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebee622-281e-4101-bf97-b78962805be2 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:52.768714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebee622-281e-4101-bf97-b78962805be2 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:52.768992 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebee622-281e-4101-bf97-b78962805be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:52.798114 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-6ebee622-281e-4101-bf97-b78962805be2 None None] MFA Rules not processed for user `10e46658a7b342b38e7472dbbae1f719`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:52.799481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6ebee622-281e-4101-bf97-b78962805be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:52.863958 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1370/2738] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:52.874861 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3e7fb-e154-4045-86a7-8ed8e9e630f3 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:52.876354 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-29a3e7fb-e154-4045-86a7-8ed8e9e630f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:52.935058 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3e7fb-e154-4045-86a7-8ed8e9e630f3 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:52.938751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d96eb-3531-4cf4-aa2c-6aef4151bb99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:52.939350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d96eb-3531-4cf4-aa2c-6aef4151bb99 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:52.939624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d96eb-3531-4cf4-aa2c-6aef4151bb99 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:52.939891 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d96eb-3531-4cf4-aa2c-6aef4151bb99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:52.948134 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d96eb-3531-4cf4-aa2c-6aef4151bb99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:52.949579 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d96eb-3531-4cf4-aa2c-6aef4151bb99 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:52.958669 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1369/2739] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:54.307456 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578949eb-5f8e-4a4d-8cfd-e110179089ea None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:54.307947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578949eb-5f8e-4a4d-8cfd-e110179089ea None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:54.308061 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578949eb-5f8e-4a4d-8cfd-e110179089ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:54.326948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-578949eb-5f8e-4a4d-8cfd-e110179089ea None None] MFA Rules not processed for user `10e46658a7b342b38e7472dbbae1f719`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:52:54.328135 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-578949eb-5f8e-4a4d-8cfd-e110179089ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:54.334888 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1371/2740] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:52:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:52:54.572539 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d96eb-3531-4cf4-aa2c-6aef4151bb99 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:54.581885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d96eb-3531-4cf4-aa2c-6aef4151bb99 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:54.585472 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6c536-0c8d-4073-9cba-3458e368d28c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:54.586060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6c536-0c8d-4073-9cba-3458e368d28c service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:54.586593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6c536-0c8d-4073-9cba-3458e368d28c service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:54.586863 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6c536-0c8d-4073-9cba-3458e368d28c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:54.588602 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ced6c536-0c8d-4073-9cba-3458e368d28c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:54.597893 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6c536-0c8d-4073-9cba-3458e368d28c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:54.599862 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6c536-0c8d-4073-9cba-3458e368d28c service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:54.607703 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1370/2741] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:57.242512 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578949eb-5f8e-4a4d-8cfd-e110179089ea None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:57.244269 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-578949eb-5f8e-4a4d-8cfd-e110179089ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:57.341436 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578949eb-5f8e-4a4d-8cfd-e110179089ea None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:57.348195 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c276d4-b00e-4d7f-a076-8888c6290075 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:57.348921 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c276d4-b00e-4d7f-a076-8888c6290075 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:57.349204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c276d4-b00e-4d7f-a076-8888c6290075 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:57.349478 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c276d4-b00e-4d7f-a076-8888c6290075 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:57.351353 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b2c276d4-b00e-4d7f-a076-8888c6290075 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:57.365791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c276d4-b00e-4d7f-a076-8888c6290075 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:57.367306 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c276d4-b00e-4d7f-a076-8888c6290075 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:57.378929 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1372/2742] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:52:58.445019 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6c536-0c8d-4073-9cba-3458e368d28c service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:52:58.446388 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ced6c536-0c8d-4073-9cba-3458e368d28c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:58.457593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6c536-0c8d-4073-9cba-3458e368d28c service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:52:58.462062 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456f1ce-9187-45e3-a897-b5782419cf6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:52:58.462643 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456f1ce-9187-45e3-a897-b5782419cf6d service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:52:58.462917 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456f1ce-9187-45e3-a897-b5782419cf6d service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:52:58.463186 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456f1ce-9187-45e3-a897-b5782419cf6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:52:58.464857 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2456f1ce-9187-45e3-a897-b5782419cf6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:52:58.521880 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456f1ce-9187-45e3-a897-b5782419cf6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:52:58.523288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456f1ce-9187-45e3-a897-b5782419cf6d service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:52:58.532119 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1371/2743] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:52:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:53:05.501462 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c276d4-b00e-4d7f-a076-8888c6290075 service nova] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:05.511224 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c276d4-b00e-4d7f-a076-8888c6290075 service nova] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:05.514922 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4f9a9-8a84-4977-a2de-bf846e361803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:05.515603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4f9a9-8a84-4977-a2de-bf846e361803 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:05.515971 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4f9a9-8a84-4977-a2de-bf846e361803 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:05.516314 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4f9a9-8a84-4977-a2de-bf846e361803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:05.518255 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3dd4f9a9-8a84-4977-a2de-bf846e361803 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:05.530766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4f9a9-8a84-4977-a2de-bf846e361803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:05.532174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4f9a9-8a84-4977-a2de-bf846e361803 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:05.542366 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1373/2744] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:53:07.981508 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e31490-0249-4ff3-8755-affd7f3f0249 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:07.981966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e31490-0249-4ff3-8755-affd7f3f0249 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:07.982209 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e31490-0249-4ff3-8755-affd7f3f0249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:08.002077 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f2e31490-0249-4ff3-8755-affd7f3f0249 None None] MFA Rules not processed for user `10e46658a7b342b38e7472dbbae1f719`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:53:08.003530 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f2e31490-0249-4ff3-8755-affd7f3f0249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:08.011751 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1372/2745] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:53:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:53:08.354446 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4f9a9-8a84-4977-a2de-bf846e361803 service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:08.356031 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3dd4f9a9-8a84-4977-a2de-bf846e361803 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:08.376484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4f9a9-8a84-4977-a2de-bf846e361803 service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:08.381053 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e0075-ca55-4da7-9792-3a6232e6dc0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:08.382461 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e0075-ca55-4da7-9792-3a6232e6dc0e service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:08.382927 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e0075-ca55-4da7-9792-3a6232e6dc0e service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:08.383350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e0075-ca55-4da7-9792-3a6232e6dc0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:08.385562 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a65e0075-ca55-4da7-9792-3a6232e6dc0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:08.396140 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e0075-ca55-4da7-9792-3a6232e6dc0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:08.397827 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e0075-ca55-4da7-9792-3a6232e6dc0e service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:08.408005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1374/2746] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:53:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:53:09.262965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e31490-0249-4ff3-8755-affd7f3f0249 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:09.264570 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f2e31490-0249-4ff3-8755-affd7f3f0249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:09.338372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e0075-ca55-4da7-9792-3a6232e6dc0e service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:09.340073 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-a65e0075-ca55-4da7-9792-3a6232e6dc0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:09.359325 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e0075-ca55-4da7-9792-3a6232e6dc0e service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:09.362678 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:53:09.367627 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a220b-9de7-4978-be7c-885080984781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:09.368259 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a220b-9de7-4978-be7c-885080984781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:09.368539 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a220b-9de7-4978-be7c-885080984781 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:09.368837 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a220b-9de7-4978-be7c-885080984781 admin admin] PATH_INFO: `/v3/users/80be130a10624a81bd3e874a3745b571` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:09.370496 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a220b-9de7-4978-be7c-885080984781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80be130a10624a81bd3e874a3745b571)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:09.372406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a220b-9de7-4978-be7c-885080984781 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:09.403725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e31490-0249-4ff3-8755-affd7f3f0249 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:09.410261 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f881f-7cec-423c-bb8b-7ba01d2dcc9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0211a05cca4e72b30d64eef4ba527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:09.410998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f881f-7cec-423c-bb8b-7ba01d2dcc9b service placement] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:09.411772 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f881f-7cec-423c-bb8b-7ba01d2dcc9b service placement] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:09.411772 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f881f-7cec-423c-bb8b-7ba01d2dcc9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:09.413667 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1c7f881f-7cec-423c-bb8b-7ba01d2dcc9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:09.420832 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:53:09.429079 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f881f-7cec-423c-bb8b-7ba01d2dcc9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:09.430755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f881f-7cec-423c-bb8b-7ba01d2dcc9b service placement] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:09.442983 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1373/2747] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:53:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:53:09.461694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-675a220b-9de7-4978-be7c-885080984781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80be130a10624a81bd3e874a3745b571'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:53:09.473212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-675a220b-9de7-4978-be7c-885080984781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80be130a10624a81bd3e874a3745b571'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:53:09.474085 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-675a220b-9de7-4978-be7c-885080984781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80be130a10624a81bd3e874a3745b571'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:53:09.474728 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-675a220b-9de7-4978-be7c-885080984781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80be130a10624a81bd3e874a3745b571'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:53:09.483166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-675a220b-9de7-4978-be7c-885080984781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80be130a10624a81bd3e874a3745b571'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:53:09.503708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1375/2748] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:53:09 2022] DELETE /identity/v3/users/80be130a10624a81bd3e874a3745b571 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:53:09.686321 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f881f-7cec-423c-bb8b-7ba01d2dcc9b service placement] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:09.697877 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f881f-7cec-423c-bb8b-7ba01d2dcc9b service placement] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:09.759617 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7208e-6f5e-4a23-b37b-32777a4e3aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:09.760260 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7208e-6f5e-4a23-b37b-32777a4e3aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:09.760619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7208e-6f5e-4a23-b37b-32777a4e3aae admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:09.760929 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7208e-6f5e-4a23-b37b-32777a4e3aae admin admin] PATH_INFO: `/v3/projects/99612539394f4578983fad9cbbd4a9b6` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:09.762263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7208e-6f5e-4a23-b37b-32777a4e3aae admin admin] RBAC: Authorizing `identity:delete_project(project_id=99612539394f4578983fad9cbbd4a9b6)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:09.764497 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7208e-6f5e-4a23-b37b-32777a4e3aae admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:09.817414 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-aae7208e-6f5e-4a23-b37b-32777a4e3aae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99612539394f4578983fad9cbbd4a9b6', 'request_id': 'req-aae7208e-6f5e-4a23-b37b-32777a4e3aae'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:53:09.824235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-aae7208e-6f5e-4a23-b37b-32777a4e3aae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99612539394f4578983fad9cbbd4a9b6', 'request_id': 'req-aae7208e-6f5e-4a23-b37b-32777a4e3aae'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:53:09.831916 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-aae7208e-6f5e-4a23-b37b-32777a4e3aae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99612539394f4578983fad9cbbd4a9b6', 'request_id': 'req-aae7208e-6f5e-4a23-b37b-32777a4e3aae'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:53:09.842774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-aae7208e-6f5e-4a23-b37b-32777a4e3aae admin admin] The token cache is being invalidate because project 99612539394f4578983fad9cbbd4a9b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:53:09.843120 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-aae7208e-6f5e-4a23-b37b-32777a4e3aae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:53:09.843749 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-aae7208e-6f5e-4a23-b37b-32777a4e3aae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:53:09.845320 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1374/2749] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:53:09 2022] DELETE /identity/v3/projects/99612539394f4578983fad9cbbd4a9b6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:53:09.850955 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a326d-f113-42a9-a855-c5761c7adbbe None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:09.851247 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a326d-f113-42a9-a855-c5761c7adbbe None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:09.851529 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a326d-f113-42a9-a855-c5761c7adbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:09.871395 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-9b1a326d-f113-42a9-a855-c5761c7adbbe None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:53:09.872629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9b1a326d-f113-42a9-a855-c5761c7adbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:09.930728 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1376/2750] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:53:09.938878 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a2673-12e9-4f4b-bece-c47539439ce6 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:09.939158 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a2673-12e9-4f4b-bece-c47539439ce6 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:09.939427 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a2673-12e9-4f4b-bece-c47539439ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:09.959694 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4e6a2673-12e9-4f4b-bece-c47539439ce6 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:53:09.961275 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4e6a2673-12e9-4f4b-bece-c47539439ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:09.969444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1375/2751] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:53:09.974414 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a326d-f113-42a9-a855-c5761c7adbbe None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:09.984082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a326d-f113-42a9-a855-c5761c7adbbe None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:09.988691 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ea4ca-5de4-4afc-bd74-4c0ff195c4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:09.989284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ea4ca-5de4-4afc-bd74-4c0ff195c4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:09.989567 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ea4ca-5de4-4afc-bd74-4c0ff195c4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:09.989844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ea4ca-5de4-4afc-bd74-4c0ff195c4e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:09.990490 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ea4ca-5de4-4afc-bd74-4c0ff195c4e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:53:09.990817 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ea4ca-5de4-4afc-bd74-4c0ff195c4e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:09.992449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ea4ca-5de4-4afc-bd74-4c0ff195c4e7 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:10.004130 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1377/2752] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:53:10.008356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a2673-12e9-4f4b-bece-c47539439ce6 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:10.017469 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a2673-12e9-4f4b-bece-c47539439ce6 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:10.022548 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8259b-819d-4596-8b3d-66ef5d2dbc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:10.023128 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8259b-819d-4596-8b3d-66ef5d2dbc24 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:10.023397 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8259b-819d-4596-8b3d-66ef5d2dbc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:10.023673 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8259b-819d-4596-8b3d-66ef5d2dbc24 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:10.024288 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8259b-819d-4596-8b3d-66ef5d2dbc24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:10.026210 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8259b-819d-4596-8b3d-66ef5d2dbc24 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:10.054239 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1376/2753] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:53:10 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:53:10.058392 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ea4ca-5de4-4afc-bd74-4c0ff195c4e7 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:10.068360 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ea4ca-5de4-4afc-bd74-4c0ff195c4e7 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:10.126631 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b040363-4122-4d73-bccf-d1b20692850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:10.127171 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b040363-4122-4d73-bccf-d1b20692850f admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:10.127574 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b040363-4122-4d73-bccf-d1b20692850f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:10.127859 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b040363-4122-4d73-bccf-d1b20692850f admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:10.128519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b040363-4122-4d73-bccf-d1b20692850f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:10.130530 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b040363-4122-4d73-bccf-d1b20692850f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:10.153014 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1378/2754] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:53:10 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:53:10.157251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8259b-819d-4596-8b3d-66ef5d2dbc24 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:10.168997 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8259b-819d-4596-8b3d-66ef5d2dbc24 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:10.174158 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fac8b1-7422-414b-905e-4b9c79cf23ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:10.174778 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fac8b1-7422-414b-905e-4b9c79cf23ea admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:10.175061 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fac8b1-7422-414b-905e-4b9c79cf23ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:10.175462 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fac8b1-7422-414b-905e-4b9c79cf23ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:10.176161 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fac8b1-7422-414b-905e-4b9c79cf23ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:10.178543 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fac8b1-7422-414b-905e-4b9c79cf23ea admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:10.189432 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1377/2755] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 10:53:10.193566 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b040363-4122-4d73-bccf-d1b20692850f admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:10.205066 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b040363-4122-4d73-bccf-d1b20692850f admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:10.210469 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab72e7-9b83-478e-938d-e312e13f0e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:10.211342 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab72e7-9b83-478e-938d-e312e13f0e6b admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:10.211677 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab72e7-9b83-478e-938d-e312e13f0e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:10.211955 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab72e7-9b83-478e-938d-e312e13f0e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:10.212777 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab72e7-9b83-478e-938d-e312e13f0e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:10.214381 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab72e7-9b83-478e-938d-e312e13f0e6b admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:10.226556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1379/2756] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:53:10.230939 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fac8b1-7422-414b-905e-4b9c79cf23ea admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:10.244448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fac8b1-7422-414b-905e-4b9c79cf23ea admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:10.251125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7867f-ce3b-47bb-8595-a9417bd72c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:10.251900 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7867f-ce3b-47bb-8595-a9417bd72c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:10.252188 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7867f-ce3b-47bb-8595-a9417bd72c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:10.252467 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7867f-ce3b-47bb-8595-a9417bd72c02 admin admin] PATH_INFO: `/v3/projects/15267a5194aa40dfa60aa431130afa3b/users/3f3f2225da6a45f19ff736c459430cf8/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:10.277094 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7867f-ce3b-47bb-8595-a9417bd72c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15267a5194aa40dfa60aa431130afa3b, user_id=3f3f2225da6a45f19ff736c459430cf8, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:10.280597 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7867f-ce3b-47bb-8595-a9417bd72c02 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:10.290739 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:53:10.307300 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1378/2757] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:53:10 2022] PUT /identity/v3/projects/15267a5194aa40dfa60aa431130afa3b/users/3f3f2225da6a45f19ff736c459430cf8/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:53:10.312312 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a13099-9154-42e8-a51c-81c32c4b1e55 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:10.312728 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a13099-9154-42e8-a51c-81c32c4b1e55 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:10.313251 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a13099-9154-42e8-a51c-81c32c4b1e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:10.324296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:53:10.341524 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-f8a13099-9154-42e8-a51c-81c32c4b1e55 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:53:10.343205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f8a13099-9154-42e8-a51c-81c32c4b1e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:10.415560 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1380/2758] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:53:10.424876 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7867f-ce3b-47bb-8595-a9417bd72c02 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:10.426746 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-76f7867f-ce3b-47bb-8595-a9417bd72c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:10.487248 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7867f-ce3b-47bb-8595-a9417bd72c02 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:10.491154 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3185b23-b115-4403-8e83-d0e490ac4759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:10.491762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3185b23-b115-4403-8e83-d0e490ac4759 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:10.492046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3185b23-b115-4403-8e83-d0e490ac4759 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:10.492379 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3185b23-b115-4403-8e83-d0e490ac4759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:10.502462 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3185b23-b115-4403-8e83-d0e490ac4759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:10.503799 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3185b23-b115-4403-8e83-d0e490ac4759 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:10.515760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1379/2759] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:53:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:53:15.291422 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004b65d-d55d-45ca-bed3-c1b70b2b726d None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:15.291925 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004b65d-d55d-45ca-bed3-c1b70b2b726d None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:15.292023 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004b65d-d55d-45ca-bed3-c1b70b2b726d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:15.328708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-f004b65d-d55d-45ca-bed3-c1b70b2b726d None None] MFA Rules not processed for user `3f3f2225da6a45f19ff736c459430cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:53:15.331079 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f004b65d-d55d-45ca-bed3-c1b70b2b726d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:15.409025 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1381/2760] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:53:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:53:15.424049 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3185b23-b115-4403-8e83-d0e490ac4759 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:15.425481 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b3185b23-b115-4403-8e83-d0e490ac4759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:15.533475 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3185b23-b115-4403-8e83-d0e490ac4759 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:15.541408 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98ff1f-4aa3-4b82-8263-c03bae19982b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:15.542219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98ff1f-4aa3-4b82-8263-c03bae19982b service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:15.542515 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98ff1f-4aa3-4b82-8263-c03bae19982b service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:15.542858 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98ff1f-4aa3-4b82-8263-c03bae19982b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:15.553141 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98ff1f-4aa3-4b82-8263-c03bae19982b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:15.554779 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98ff1f-4aa3-4b82-8263-c03bae19982b service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:15.564668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1380/2761] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:53:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:53:17.045262 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d5a12-5681-4492-846b-b6d9b626a548 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:17.045998 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d5a12-5681-4492-846b-b6d9b626a548 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:17.045998 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d5a12-5681-4492-846b-b6d9b626a548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:17.068080 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-0f4d5a12-5681-4492-846b-b6d9b626a548 None None] MFA Rules not processed for user `3f3f2225da6a45f19ff736c459430cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:53:17.069319 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0f4d5a12-5681-4492-846b-b6d9b626a548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:17.076623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1382/2762] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:53:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:53:24.960092 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d1400-894f-4841-a4cd-014a21466bf9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:24.960626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d1400-894f-4841-a4cd-014a21466bf9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:24.960732 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d1400-894f-4841-a4cd-014a21466bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:24.980519 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-5f5d1400-894f-4841-a4cd-014a21466bf9 None None] MFA Rules not processed for user `bdc800f1d4174b5cba4f6f496207ec95`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:53:24.981874 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5f5d1400-894f-4841-a4cd-014a21466bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:25.043725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1381/2763] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 10:53:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:53:25.067345 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d5a12-5681-4492-846b-b6d9b626a548 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:25.069112 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0f4d5a12-5681-4492-846b-b6d9b626a548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:25.138568 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d5a12-5681-4492-846b-b6d9b626a548 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:25.143591 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b3f38-561c-423d-b0ce-a7b30af2f1f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ff72290fd14ddaba6ed757051e182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:25.144217 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b3f38-561c-423d-b0ce-a7b30af2f1f5 service swift] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:25.144500 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b3f38-561c-423d-b0ce-a7b30af2f1f5 service swift] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:25.144807 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b3f38-561c-423d-b0ce-a7b30af2f1f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:25.153041 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b3f38-561c-423d-b0ce-a7b30af2f1f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:25.154535 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b3f38-561c-423d-b0ce-a7b30af2f1f5 service swift] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:25.163177 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1383/2764] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 10:53:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 10:53:35.035326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=86 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:53:35.159929 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=92 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:53:40.683905 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190e366-2bab-4c6c-ad15-3d90a88be5cc None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:40.684340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190e366-2bab-4c6c-ad15-3d90a88be5cc None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:40.684448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190e366-2bab-4c6c-ad15-3d90a88be5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:40.703912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c190e366-2bab-4c6c-ad15-3d90a88be5cc None None] MFA Rules not processed for user `bdc800f1d4174b5cba4f6f496207ec95`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:53:40.705169 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c190e366-2bab-4c6c-ad15-3d90a88be5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:40.712641 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1382/2765] 10.222.0.20 () {58 vars in 967 bytes} [Sun Sep 11 10:53:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:53:40.725268 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b3f38-561c-423d-b0ce-a7b30af2f1f5 service swift] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:40.735873 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b3f38-561c-423d-b0ce-a7b30af2f1f5 service swift] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:40.741579 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fae39-2b9d-4471-96ed-f822648c2001 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ff72290fd14ddaba6ed757051e182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:40.742216 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fae39-2b9d-4471-96ed-f822648c2001 service swift] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:40.742441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fae39-2b9d-4471-96ed-f822648c2001 service swift] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:40.742709 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fae39-2b9d-4471-96ed-f822648c2001 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:40.750683 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560fae39-2b9d-4471-96ed-f822648c2001 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:40.752244 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560fae39-2b9d-4471-96ed-f822648c2001 service swift] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:40.760334 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1384/2766] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 10:53:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 10:53:42.659644 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190e366-2bab-4c6c-ad15-3d90a88be5cc None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:42.661138 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c190e366-2bab-4c6c-ad15-3d90a88be5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:42.675165 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190e366-2bab-4c6c-ad15-3d90a88be5cc None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:42.679630 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5ce50-0c3d-4df0-bd6a-39ab622333ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:42.680255 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5ce50-0c3d-4df0-bd6a-39ab622333ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:42.680533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5ce50-0c3d-4df0-bd6a-39ab622333ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:42.680847 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5ce50-0c3d-4df0-bd6a-39ab622333ea admin admin] PATH_INFO: `/v3/users/10e46658a7b342b38e7472dbbae1f719` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:42.681963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5ce50-0c3d-4df0-bd6a-39ab622333ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=10e46658a7b342b38e7472dbbae1f719)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:42.683863 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5ce50-0c3d-4df0-bd6a-39ab622333ea admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:42.730854 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-95b5ce50-0c3d-4df0-bd6a-39ab622333ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10e46658a7b342b38e7472dbbae1f719'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:53:42.738719 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-95b5ce50-0c3d-4df0-bd6a-39ab622333ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10e46658a7b342b38e7472dbbae1f719'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:53:42.739341 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-95b5ce50-0c3d-4df0-bd6a-39ab622333ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10e46658a7b342b38e7472dbbae1f719'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:53:42.739950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-95b5ce50-0c3d-4df0-bd6a-39ab622333ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10e46658a7b342b38e7472dbbae1f719'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:53:42.746868 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-95b5ce50-0c3d-4df0-bd6a-39ab622333ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10e46658a7b342b38e7472dbbae1f719'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:53:42.763696 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1383/2767] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:53:42 2022] DELETE /identity/v3/users/10e46658a7b342b38e7472dbbae1f719 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:53:42.933589 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fae39-2b9d-4471-96ed-f822648c2001 service swift] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:42.945814 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fae39-2b9d-4471-96ed-f822648c2001 service swift] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:43.003380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d32efc-cf9b-479f-bf61-4456fc9a1556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:43.003939 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d32efc-cf9b-479f-bf61-4456fc9a1556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:43.004218 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d32efc-cf9b-479f-bf61-4456fc9a1556 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:43.004488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d32efc-cf9b-479f-bf61-4456fc9a1556 admin admin] PATH_INFO: `/v3/projects/bd0e0673893a4de5ad012202a9ea7956` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:43.005699 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d32efc-cf9b-479f-bf61-4456fc9a1556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd0e0673893a4de5ad012202a9ea7956)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:43.007651 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d32efc-cf9b-479f-bf61-4456fc9a1556 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:43.054155 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-47d32efc-cf9b-479f-bf61-4456fc9a1556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd0e0673893a4de5ad012202a9ea7956', 'request_id': 'req-47d32efc-cf9b-479f-bf61-4456fc9a1556'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:53:43.060253 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-47d32efc-cf9b-479f-bf61-4456fc9a1556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd0e0673893a4de5ad012202a9ea7956', 'request_id': 'req-47d32efc-cf9b-479f-bf61-4456fc9a1556'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:53:43.067956 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-47d32efc-cf9b-479f-bf61-4456fc9a1556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd0e0673893a4de5ad012202a9ea7956', 'request_id': 'req-47d32efc-cf9b-479f-bf61-4456fc9a1556'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:53:43.078305 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-47d32efc-cf9b-479f-bf61-4456fc9a1556 admin admin] The token cache is being invalidate because project bd0e0673893a4de5ad012202a9ea7956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:53:43.078580 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-47d32efc-cf9b-479f-bf61-4456fc9a1556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:53:43.079234 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-47d32efc-cf9b-479f-bf61-4456fc9a1556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:53:43.080733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1385/2768] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:53:42 2022] DELETE /identity/v3/projects/bd0e0673893a4de5ad012202a9ea7956 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:53:43.087010 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3298b-8159-43d9-9959-9f9948b871ac None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:43.087332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3298b-8159-43d9-9959-9f9948b871ac None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:43.087605 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3298b-8159-43d9-9959-9f9948b871ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:43.107195 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3ce3298b-8159-43d9-9959-9f9948b871ac None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:53:43.108394 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3ce3298b-8159-43d9-9959-9f9948b871ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:43.165803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1384/2769] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:53:43.173404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd33097-4b25-47e3-8a99-1623b10914c6 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:43.173819 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd33097-4b25-47e3-8a99-1623b10914c6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:43.174154 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd33097-4b25-47e3-8a99-1623b10914c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:43.193777 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-6dd33097-4b25-47e3-8a99-1623b10914c6 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:53:43.194963 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6dd33097-4b25-47e3-8a99-1623b10914c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:43.202581 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1386/2770] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:53:43.207385 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3298b-8159-43d9-9959-9f9948b871ac None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:43.217365 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3298b-8159-43d9-9959-9f9948b871ac None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:43.221807 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f20df-d1bf-4d33-892c-5a6cd5156bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:43.222425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f20df-d1bf-4d33-892c-5a6cd5156bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:43.222700 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f20df-d1bf-4d33-892c-5a6cd5156bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:43.222967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f20df-d1bf-4d33-892c-5a6cd5156bd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:43.223611 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f20df-d1bf-4d33-892c-5a6cd5156bd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:53:43.223934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f20df-d1bf-4d33-892c-5a6cd5156bd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:43.225541 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f20df-d1bf-4d33-892c-5a6cd5156bd2 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:43.236985 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1385/2771] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:53:43.241096 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd33097-4b25-47e3-8a99-1623b10914c6 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:43.250123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd33097-4b25-47e3-8a99-1623b10914c6 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:43.255294 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38736d4f-b217-4d67-ba17-02ed6b922415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:43.255818 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38736d4f-b217-4d67-ba17-02ed6b922415 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:43.256093 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38736d4f-b217-4d67-ba17-02ed6b922415 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:43.256362 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38736d4f-b217-4d67-ba17-02ed6b922415 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:43.257036 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38736d4f-b217-4d67-ba17-02ed6b922415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:43.258894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38736d4f-b217-4d67-ba17-02ed6b922415 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:43.285917 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1387/2772] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:53:43 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:53:43.289957 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f20df-d1bf-4d33-892c-5a6cd5156bd2 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:43.300586 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f20df-d1bf-4d33-892c-5a6cd5156bd2 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:43.353805 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:53:43.365393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83807a7f-2845-4117-96e7-6b4d8c3d7bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:43.365997 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807a7f-2845-4117-96e7-6b4d8c3d7bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:43.366270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807a7f-2845-4117-96e7-6b4d8c3d7bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:43.366544 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807a7f-2845-4117-96e7-6b4d8c3d7bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:43.367178 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83807a7f-2845-4117-96e7-6b4d8c3d7bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:43.369103 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83807a7f-2845-4117-96e7-6b4d8c3d7bf0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:43.391327 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1386/2773] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:53:43 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:53:43.395523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38736d4f-b217-4d67-ba17-02ed6b922415 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:43.405808 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38736d4f-b217-4d67-ba17-02ed6b922415 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:43.410445 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0a7ec-b4fe-4352-b63c-b71c47bb31f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:43.411038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0a7ec-b4fe-4352-b63c-b71c47bb31f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:43.411328 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0a7ec-b4fe-4352-b63c-b71c47bb31f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:43.411619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0a7ec-b4fe-4352-b63c-b71c47bb31f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:43.412242 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0a7ec-b4fe-4352-b63c-b71c47bb31f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:43.413870 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0a7ec-b4fe-4352-b63c-b71c47bb31f2 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:43.423658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1388/2774] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 10:53:43.427943 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83807a7f-2845-4117-96e7-6b4d8c3d7bf0 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:43.437629 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83807a7f-2845-4117-96e7-6b4d8c3d7bf0 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:43.443080 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fe6e9-e842-444a-bc92-3901b8d663a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:43.443664 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fe6e9-e842-444a-bc92-3901b8d663a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:43.443940 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fe6e9-e842-444a-bc92-3901b8d663a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:43.444207 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fe6e9-e842-444a-bc92-3901b8d663a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:43.444876 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fe6e9-e842-444a-bc92-3901b8d663a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:43.446438 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fe6e9-e842-444a-bc92-3901b8d663a7 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:43.456922 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1387/2775] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:53:43.461300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0a7ec-b4fe-4352-b63c-b71c47bb31f2 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:43.471164 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0a7ec-b4fe-4352-b63c-b71c47bb31f2 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:43.475768 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f42a40-3098-41e0-be5f-78dc2e407327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:43.476438 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f42a40-3098-41e0-be5f-78dc2e407327 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:43.476754 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f42a40-3098-41e0-be5f-78dc2e407327 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:43.477034 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f42a40-3098-41e0-be5f-78dc2e407327 admin admin] PATH_INFO: `/v3/projects/fe14ed3c1162454fbe3f8a307296d2b7/users/7032732e89824d1fb77e8cb6b6a5c704/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:43.491957 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f42a40-3098-41e0-be5f-78dc2e407327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe14ed3c1162454fbe3f8a307296d2b7, user_id=7032732e89824d1fb77e8cb6b6a5c704, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:43.494597 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f42a40-3098-41e0-be5f-78dc2e407327 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:43.507452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1389/2776] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:53:43 2022] PUT /identity/v3/projects/fe14ed3c1162454fbe3f8a307296d2b7/users/7032732e89824d1fb77e8cb6b6a5c704/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:53:43.512484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62660c-971e-4ef0-b421-a3b345281bc9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:43.512820 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62660c-971e-4ef0-b421-a3b345281bc9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:43.513093 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62660c-971e-4ef0-b421-a3b345281bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:43.531296 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2c62660c-971e-4ef0-b421-a3b345281bc9 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:53:43.532476 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2c62660c-971e-4ef0-b421-a3b345281bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:43.590227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1388/2777] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:53:43.599838 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f42a40-3098-41e0-be5f-78dc2e407327 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:43.601576 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-85f42a40-3098-41e0-be5f-78dc2e407327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:43.616390 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:53:43.659535 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f42a40-3098-41e0-be5f-78dc2e407327 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:43.663166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ed4e9-f4b6-47c4-b9a2-a5ad799eae7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:43.663773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ed4e9-f4b6-47c4-b9a2-a5ad799eae7f service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:43.664057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ed4e9-f4b6-47c4-b9a2-a5ad799eae7f service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:43.664333 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ed4e9-f4b6-47c4-b9a2-a5ad799eae7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:43.674107 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ed4e9-f4b6-47c4-b9a2-a5ad799eae7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:43.676043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ed4e9-f4b6-47c4-b9a2-a5ad799eae7f service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:43.687199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1390/2778] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:53:47.594492 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79709fa9-9edb-4c62-805a-7923330c7009 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:47.595085 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79709fa9-9edb-4c62-805a-7923330c7009 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:47.595227 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79709fa9-9edb-4c62-805a-7923330c7009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:47.624325 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-79709fa9-9edb-4c62-805a-7923330c7009 None None] MFA Rules not processed for user `7032732e89824d1fb77e8cb6b6a5c704`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:53:47.626001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-79709fa9-9edb-4c62-805a-7923330c7009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:47.693235 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1389/2779] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:53:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:53:47.697706 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ed4e9-f4b6-47c4-b9a2-a5ad799eae7f service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:47.708214 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ed4e9-f4b6-47c4-b9a2-a5ad799eae7f service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:47.714862 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b194b-a083-4edd-858e-5d4f8ca1f1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:47.715923 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b194b-a083-4edd-858e-5d4f8ca1f1ac admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:47.716281 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b194b-a083-4edd-858e-5d4f8ca1f1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:47.716742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b194b-a083-4edd-858e-5d4f8ca1f1ac admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:47.717485 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b194b-a083-4edd-858e-5d4f8ca1f1ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:47.719415 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b194b-a083-4edd-858e-5d4f8ca1f1ac admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:47.754404 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1391/2780] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:53:47 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:53:47.755487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79709fa9-9edb-4c62-805a-7923330c7009 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:47.766954 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79709fa9-9edb-4c62-805a-7923330c7009 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:47.826860 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f13558-e4d4-48dc-9b2c-cd6554e5a3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:47.827514 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f13558-e4d4-48dc-9b2c-cd6554e5a3ba admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:47.827794 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f13558-e4d4-48dc-9b2c-cd6554e5a3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:47.828065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f13558-e4d4-48dc-9b2c-cd6554e5a3ba admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:47.832116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f13558-e4d4-48dc-9b2c-cd6554e5a3ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:47.832116 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f13558-e4d4-48dc-9b2c-cd6554e5a3ba admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:47.841057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:53:47.854422 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1390/2781] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:53:47 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:53:47.858454 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b194b-a083-4edd-858e-5d4f8ca1f1ac admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:47.869156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b194b-a083-4edd-858e-5d4f8ca1f1ac admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:47.873974 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419094b8-f715-45d0-af17-c7858f527e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:47.874588 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419094b8-f715-45d0-af17-c7858f527e39 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:47.874866 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419094b8-f715-45d0-af17-c7858f527e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:47.875139 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419094b8-f715-45d0-af17-c7858f527e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:47.875796 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419094b8-f715-45d0-af17-c7858f527e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:47.877427 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419094b8-f715-45d0-af17-c7858f527e39 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:47.888888 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1392/2782] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:53:47.893834 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f13558-e4d4-48dc-9b2c-cd6554e5a3ba admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:47.904377 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f13558-e4d4-48dc-9b2c-cd6554e5a3ba admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:47.909878 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a571ce-e70e-4008-9d8e-ea63f625775e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:47.910529 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a571ce-e70e-4008-9d8e-ea63f625775e admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:47.910804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a571ce-e70e-4008-9d8e-ea63f625775e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:47.911069 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a571ce-e70e-4008-9d8e-ea63f625775e admin admin] PATH_INFO: `/v3/projects/761414033150411b9920894ba1849b10/users/3975f1b1a6f24f749848ef8c0c5dd32c/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:47.926543 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a571ce-e70e-4008-9d8e-ea63f625775e admin admin] RBAC: Authorizing `identity:create_grant(project_id=761414033150411b9920894ba1849b10, user_id=3975f1b1a6f24f749848ef8c0c5dd32c, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:47.929320 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a571ce-e70e-4008-9d8e-ea63f625775e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:47.943358 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1391/2783] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:53:47 2022] PUT /identity/v3/projects/761414033150411b9920894ba1849b10/users/3975f1b1a6f24f749848ef8c0c5dd32c/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:53:47.947341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419094b8-f715-45d0-af17-c7858f527e39 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:47.958199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419094b8-f715-45d0-af17-c7858f527e39 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:48.030054 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eaf3c7-2b3d-457e-af52-02b04fecbd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:48.030663 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eaf3c7-2b3d-457e-af52-02b04fecbd82 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:48.030941 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eaf3c7-2b3d-457e-af52-02b04fecbd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:48.031211 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eaf3c7-2b3d-457e-af52-02b04fecbd82 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:48.031847 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eaf3c7-2b3d-457e-af52-02b04fecbd82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:48.033463 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eaf3c7-2b3d-457e-af52-02b04fecbd82 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:48.047428 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1393/2784] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:53:48.054426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a571ce-e70e-4008-9d8e-ea63f625775e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:48.065467 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a571ce-e70e-4008-9d8e-ea63f625775e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:48.070518 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23322976-e755-47ae-8baf-a1c5a0c07f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:48.071460 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23322976-e755-47ae-8baf-a1c5a0c07f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:48.071735 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23322976-e755-47ae-8baf-a1c5a0c07f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:48.072001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23322976-e755-47ae-8baf-a1c5a0c07f70 admin admin] PATH_INFO: `/v3/projects/761414033150411b9920894ba1849b10/users/3975f1b1a6f24f749848ef8c0c5dd32c/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:48.074137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23322976-e755-47ae-8baf-a1c5a0c07f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=761414033150411b9920894ba1849b10, user_id=3975f1b1a6f24f749848ef8c0c5dd32c, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:48.076804 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23322976-e755-47ae-8baf-a1c5a0c07f70 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:48.088743 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1392/2785] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:53:48 2022] PUT /identity/v3/projects/761414033150411b9920894ba1849b10/users/3975f1b1a6f24f749848ef8c0c5dd32c/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:53:52.632166 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d835b-578a-4081-b5e5-f410b5318a62 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:52.632746 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d835b-578a-4081-b5e5-f410b5318a62 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:52.632746 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d835b-578a-4081-b5e5-f410b5318a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:52.664002 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-532d835b-578a-4081-b5e5-f410b5318a62 None None] MFA Rules not processed for user `3975f1b1a6f24f749848ef8c0c5dd32c`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:53:52.665241 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-532d835b-578a-4081-b5e5-f410b5318a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:52.738386 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1394/2786] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:53:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:53:52.758735 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23322976-e755-47ae-8baf-a1c5a0c07f70 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:53:52.760608 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-23322976-e755-47ae-8baf-a1c5a0c07f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:52.852756 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23322976-e755-47ae-8baf-a1c5a0c07f70 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:53:52.858389 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3bd7f-75ab-4321-8117-2b77284373f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:53:52.858987 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3bd7f-75ab-4321-8117-2b77284373f5 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:52.859264 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3bd7f-75ab-4321-8117-2b77284373f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:52.859531 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3bd7f-75ab-4321-8117-2b77284373f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:52.917115 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3bd7f-75ab-4321-8117-2b77284373f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:53:52.918691 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3bd7f-75ab-4321-8117-2b77284373f5 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:53:52.928326 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1393/2787] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:53:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:53:53.959082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3c3a3-c090-4e8e-aca3-41495bcfbb80 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:53:53.959623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3c3a3-c090-4e8e-aca3-41495bcfbb80 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:53:53.959623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3c3a3-c090-4e8e-aca3-41495bcfbb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:53:53.968120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:53:53.980379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-b7f3c3a3-c090-4e8e-aca3-41495bcfbb80 None None] MFA Rules not processed for user `7032732e89824d1fb77e8cb6b6a5c704`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:53:53.981618 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b7f3c3a3-c090-4e8e-aca3-41495bcfbb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:53:53.988969 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1395/2788] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:54:02.923609 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:INSERT=4,keystone:SELECT=73 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:54:03.977545 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:54:17.520433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3bd7f-75ab-4321-8117-2b77284373f5 service nova] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:54:17.574740 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3bd7f-75ab-4321-8117-2b77284373f5 service nova] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:54:17.578481 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa48b1b-3e06-473d-a530-fcb9f1920ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:54:17.579082 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa48b1b-3e06-473d-a530-fcb9f1920ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:54:17.579863 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa48b1b-3e06-473d-a530-fcb9f1920ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:54:17.580134 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa48b1b-3e06-473d-a530-fcb9f1920ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:54:17.589841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa48b1b-3e06-473d-a530-fcb9f1920ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:54:17.591267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa48b1b-3e06-473d-a530-fcb9f1920ba2 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:54:17.601289 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1394/2789] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:54:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:54:27.596990 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=26 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:54:46.368936 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3c3a3-c090-4e8e-aca3-41495bcfbb80 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:54:46.370337 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b7f3c3a3-c090-4e8e-aca3-41495bcfbb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:54:46.503703 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3c3a3-c090-4e8e-aca3-41495bcfbb80 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:54:46.508631 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbc4d1-b349-41bc-9f85-7fd0bf4466a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0211a05cca4e72b30d64eef4ba527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:54:46.509222 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbc4d1-b349-41bc-9f85-7fd0bf4466a8 service placement] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:54:46.509501 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbc4d1-b349-41bc-9f85-7fd0bf4466a8 service placement] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:54:46.509768 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbc4d1-b349-41bc-9f85-7fd0bf4466a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:54:46.511423 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-1adbc4d1-b349-41bc-9f85-7fd0bf4466a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:54:46.522382 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbc4d1-b349-41bc-9f85-7fd0bf4466a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:54:46.523921 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbc4d1-b349-41bc-9f85-7fd0bf4466a8 service placement] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:54:46.533922 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1396/2790] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:54:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:54:56.529346 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=63 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:55:54.119463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6961af-9e9e-40da-9aa8-14cbc3305a33 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:55:54.120007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6961af-9e9e-40da-9aa8-14cbc3305a33 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:55:54.120007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6961af-9e9e-40da-9aa8-14cbc3305a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:55:54.139536 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ba6961af-9e9e-40da-9aa8-14cbc3305a33 None None] MFA Rules not processed for user `3f3f2225da6a45f19ff736c459430cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:55:54.140766 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ba6961af-9e9e-40da-9aa8-14cbc3305a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:55:54.194290 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1395/2791] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:55:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:56:04.187795 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=25 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:56:04.594674 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbc4d1-b349-41bc-9f85-7fd0bf4466a8 service placement] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:56:04.624660 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbc4d1-b349-41bc-9f85-7fd0bf4466a8 service placement] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:56:04.631011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281ab7b-7906-4cd1-b881-4197e799cb47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:56:04.631711 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281ab7b-7906-4cd1-b881-4197e799cb47 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:56:04.632010 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281ab7b-7906-4cd1-b881-4197e799cb47 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:56:04.632287 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281ab7b-7906-4cd1-b881-4197e799cb47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:56:04.634773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b281ab7b-7906-4cd1-b881-4197e799cb47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:56:04.663989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281ab7b-7906-4cd1-b881-4197e799cb47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:56:04.665981 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281ab7b-7906-4cd1-b881-4197e799cb47 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:56:04.678278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1397/2792] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:56:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:56:14.672873 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=18 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:56:27.673948 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6961af-9e9e-40da-9aa8-14cbc3305a33 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:56:27.676088 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ba6961af-9e9e-40da-9aa8-14cbc3305a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:56:27.718426 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6961af-9e9e-40da-9aa8-14cbc3305a33 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:56:27.722130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670cba8-8960-4bf2-829e-07be110ad86d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:56:27.722769 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670cba8-8960-4bf2-829e-07be110ad86d service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:56:27.723046 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670cba8-8960-4bf2-829e-07be110ad86d service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:56:27.723317 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670cba8-8960-4bf2-829e-07be110ad86d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:56:27.725071 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a670cba8-8960-4bf2-829e-07be110ad86d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:56:27.735521 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670cba8-8960-4bf2-829e-07be110ad86d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:56:27.737082 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670cba8-8960-4bf2-829e-07be110ad86d service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:56:27.745490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1396/2793] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:56:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:56:27.837789 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281ab7b-7906-4cd1-b881-4197e799cb47 service nova] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:56:27.847443 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281ab7b-7906-4cd1-b881-4197e799cb47 service nova] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:56:27.850966 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71507ba0-d576-46b2-9d50-041f070418e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:56:27.851557 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71507ba0-d576-46b2-9d50-041f070418e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:56:27.851839 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71507ba0-d576-46b2-9d50-041f070418e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:56:27.852113 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71507ba0-d576-46b2-9d50-041f070418e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:56:27.853831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-71507ba0-d576-46b2-9d50-041f070418e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:56:27.866922 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71507ba0-d576-46b2-9d50-041f070418e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:56:27.868414 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71507ba0-d576-46b2-9d50-041f070418e8 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:56:27.879326 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1398/2794] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:56:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:56:37.741731 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=15 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:56:37.874425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=6 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:08.797589 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670cba8-8960-4bf2-829e-07be110ad86d service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:08.798967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a670cba8-8960-4bf2-829e-07be110ad86d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:57:08.874210 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670cba8-8960-4bf2-829e-07be110ad86d service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:08.877703 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825072f2-08de-479a-afb9-cdf57bb721db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:08.878289 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825072f2-08de-479a-afb9-cdf57bb721db service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:08.878566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825072f2-08de-479a-afb9-cdf57bb721db service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:08.878832 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825072f2-08de-479a-afb9-cdf57bb721db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:08.880528 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-825072f2-08de-479a-afb9-cdf57bb721db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:57:08.893759 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825072f2-08de-479a-afb9-cdf57bb721db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:08.895146 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825072f2-08de-479a-afb9-cdf57bb721db service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:08.905737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1397/2795] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:57:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:57:11.763874 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71507ba0-d576-46b2-9d50-041f070418e8 service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:11.773036 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71507ba0-d576-46b2-9d50-041f070418e8 service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:11.777146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f45f01-8071-46dc-9c66-9c4a7971b116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:11.777729 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f45f01-8071-46dc-9c66-9c4a7971b116 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:11.778005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f45f01-8071-46dc-9c66-9c4a7971b116 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:11.778274 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f45f01-8071-46dc-9c66-9c4a7971b116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:11.779957 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-73f45f01-8071-46dc-9c66-9c4a7971b116 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:57:11.792767 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f45f01-8071-46dc-9c66-9c4a7971b116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:11.794173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f45f01-8071-46dc-9c66-9c4a7971b116 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:11.804850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1399/2796] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:57:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:57:18.900958 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=35 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:21.800084 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=6 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:28.198427 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99922c2-9c9b-473f-b1a2-2f0a2c712916 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:28.198903 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99922c2-9c9b-473f-b1a2-2f0a2c712916 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:28.199137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99922c2-9c9b-473f-b1a2-2f0a2c712916 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:28.200525 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1398/2797] 10.222.0.20 () {54 vars in 961 bytes} [Sun Sep 11 10:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 10:57:28.205645 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f5c3d-4e90-4a1d-90f2-6bb4abee5e55 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:28.206086 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f5c3d-4e90-4a1d-90f2-6bb4abee5e55 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:28.206187 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f5c3d-4e90-4a1d-90f2-6bb4abee5e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:28.274328 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-3a7f5c3d-4e90-4a1d-90f2-6bb4abee5e55 None None] MFA Rules not processed for user `7f0211a05cca4e72b30d64eef4ba527c`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:57:28.275539 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3a7f5c3d-4e90-4a1d-90f2-6bb4abee5e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:57:28.276238 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99922c2-9c9b-473f-b1a2-2f0a2c712916 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:28.278578 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f99922c2-9c9b-473f-b1a2-2f0a2c712916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:57:28.295990 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1400/2798] 10.222.0.20 () {58 vars in 1058 bytes} [Sun Sep 11 10:57:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:57:28.299739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f5c3d-4e90-4a1d-90f2-6bb4abee5e55 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:28.310236 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f5c3d-4e90-4a1d-90f2-6bb4abee5e55 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:28.315308 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684a6e9-4f79-4951-904f-aa5ec6f4b924 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0211a05cca4e72b30d64eef4ba527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:28.315934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684a6e9-4f79-4951-904f-aa5ec6f4b924 service placement] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:28.316214 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684a6e9-4f79-4951-904f-aa5ec6f4b924 service placement] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:28.316482 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684a6e9-4f79-4951-904f-aa5ec6f4b924 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:28.318884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0684a6e9-4f79-4951-904f-aa5ec6f4b924 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:57:28.330657 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684a6e9-4f79-4951-904f-aa5ec6f4b924 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:28.332246 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684a6e9-4f79-4951-904f-aa5ec6f4b924 service placement] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:28.343940 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1401/2799] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:57:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 10:57:28.398848 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99922c2-9c9b-473f-b1a2-2f0a2c712916 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:28.403334 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e9268-591e-469b-9929-72c8c85ccc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:28.403967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e9268-591e-469b-9929-72c8c85ccc17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:28.404266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e9268-591e-469b-9929-72c8c85ccc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:28.404532 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e9268-591e-469b-9929-72c8c85ccc17 admin admin] PATH_INFO: `/v3/users/3f3f2225da6a45f19ff736c459430cf8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:28.405659 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e9268-591e-469b-9929-72c8c85ccc17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f3f2225da6a45f19ff736c459430cf8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:28.407828 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e9268-591e-469b-9929-72c8c85ccc17 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:28.461496 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-198e9268-591e-469b-9929-72c8c85ccc17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f3f2225da6a45f19ff736c459430cf8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:28.468935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-198e9268-591e-469b-9929-72c8c85ccc17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f3f2225da6a45f19ff736c459430cf8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:28.469567 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-198e9268-591e-469b-9929-72c8c85ccc17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f3f2225da6a45f19ff736c459430cf8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:28.470184 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-198e9268-591e-469b-9929-72c8c85ccc17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f3f2225da6a45f19ff736c459430cf8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:28.477042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-198e9268-591e-469b-9929-72c8c85ccc17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f3f2225da6a45f19ff736c459430cf8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:28.494541 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1399/2800] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:57:28 2022] DELETE /identity/v3/users/3f3f2225da6a45f19ff736c459430cf8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:57:28.664587 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684a6e9-4f79-4951-904f-aa5ec6f4b924 service placement] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:28.676126 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684a6e9-4f79-4951-904f-aa5ec6f4b924 service placement] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:28.735835 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eedc0c-8847-49dc-bff4-e1b9f1d6fca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:28.736468 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eedc0c-8847-49dc-bff4-e1b9f1d6fca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:28.736799 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eedc0c-8847-49dc-bff4-e1b9f1d6fca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:28.737075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eedc0c-8847-49dc-bff4-e1b9f1d6fca5 admin admin] PATH_INFO: `/v3/projects/15267a5194aa40dfa60aa431130afa3b` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:28.738189 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eedc0c-8847-49dc-bff4-e1b9f1d6fca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15267a5194aa40dfa60aa431130afa3b)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:28.740078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eedc0c-8847-49dc-bff4-e1b9f1d6fca5 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:28.785380 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-14eedc0c-8847-49dc-bff4-e1b9f1d6fca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15267a5194aa40dfa60aa431130afa3b', 'request_id': 'req-14eedc0c-8847-49dc-bff4-e1b9f1d6fca5'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:28.791977 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-14eedc0c-8847-49dc-bff4-e1b9f1d6fca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15267a5194aa40dfa60aa431130afa3b', 'request_id': 'req-14eedc0c-8847-49dc-bff4-e1b9f1d6fca5'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:28.798698 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-14eedc0c-8847-49dc-bff4-e1b9f1d6fca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15267a5194aa40dfa60aa431130afa3b', 'request_id': 'req-14eedc0c-8847-49dc-bff4-e1b9f1d6fca5'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:28.811351 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-14eedc0c-8847-49dc-bff4-e1b9f1d6fca5 admin admin] The token cache is being invalidate because project 15267a5194aa40dfa60aa431130afa3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:57:28.811641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-14eedc0c-8847-49dc-bff4-e1b9f1d6fca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:28.812255 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-14eedc0c-8847-49dc-bff4-e1b9f1d6fca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:28.813766 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1402/2801] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:57:28 2022] DELETE /identity/v3/projects/15267a5194aa40dfa60aa431130afa3b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:57:28.818668 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb6bdc-7925-45cc-a2ec-b10e9eb213a2 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:28.818956 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb6bdc-7925-45cc-a2ec-b10e9eb213a2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:28.819279 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb6bdc-7925-45cc-a2ec-b10e9eb213a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:28.867292 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-cadb6bdc-7925-45cc-a2ec-b10e9eb213a2 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:57:28.868499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cadb6bdc-7925-45cc-a2ec-b10e9eb213a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:57:28.892606 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:28.927056 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1400/2802] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:57:28.934821 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f4165-d3ce-400a-97e2-161b59bad07c None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:28.935215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f4165-d3ce-400a-97e2-161b59bad07c None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:28.935495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f4165-d3ce-400a-97e2-161b59bad07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:28.955519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-9e5f4165-d3ce-400a-97e2-161b59bad07c None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:57:28.956677 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9e5f4165-d3ce-400a-97e2-161b59bad07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:57:28.965330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1403/2803] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:57:28.969583 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb6bdc-7925-45cc-a2ec-b10e9eb213a2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:28.979645 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb6bdc-7925-45cc-a2ec-b10e9eb213a2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:28.984152 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cd83e-0e55-4883-b47b-20e15013aa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:28.984794 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cd83e-0e55-4883-b47b-20e15013aa89 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:28.985072 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cd83e-0e55-4883-b47b-20e15013aa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:28.985340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cd83e-0e55-4883-b47b-20e15013aa89 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:28.986006 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cd83e-0e55-4883-b47b-20e15013aa89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:57:28.986303 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cd83e-0e55-4883-b47b-20e15013aa89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:28.987898 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cd83e-0e55-4883-b47b-20e15013aa89 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:28.999586 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1401/2804] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:57:29.003904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f4165-d3ce-400a-97e2-161b59bad07c None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:29.013748 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f4165-d3ce-400a-97e2-161b59bad07c None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:29.018400 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fe05f-a76f-4816-bbe7-bbaec97d09f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:29.018989 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fe05f-a76f-4816-bbe7-bbaec97d09f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:29.019270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fe05f-a76f-4816-bbe7-bbaec97d09f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:29.019544 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fe05f-a76f-4816-bbe7-bbaec97d09f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:29.020188 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291fe05f-a76f-4816-bbe7-bbaec97d09f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:29.022107 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291fe05f-a76f-4816-bbe7-bbaec97d09f3 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:29.059713 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1404/2805] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:57:29 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:57:29.063920 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cd83e-0e55-4883-b47b-20e15013aa89 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:29.074088 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cd83e-0e55-4883-b47b-20e15013aa89 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:29.128983 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92e4a3-5e9c-4c42-80b5-ed0545f431d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:29.129608 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92e4a3-5e9c-4c42-80b5-ed0545f431d8 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:29.129891 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92e4a3-5e9c-4c42-80b5-ed0545f431d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:29.130158 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92e4a3-5e9c-4c42-80b5-ed0545f431d8 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:29.130797 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92e4a3-5e9c-4c42-80b5-ed0545f431d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:29.132703 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92e4a3-5e9c-4c42-80b5-ed0545f431d8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:29.154934 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1402/2806] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:57:29 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:57:29.159312 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fe05f-a76f-4816-bbe7-bbaec97d09f3 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:29.164735 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:29.170900 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fe05f-a76f-4816-bbe7-bbaec97d09f3 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:29.176584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa4a4f-b1e6-45dc-b6e5-500a5ef7b0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:29.177188 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa4a4f-b1e6-45dc-b6e5-500a5ef7b0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:29.177462 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa4a4f-b1e6-45dc-b6e5-500a5ef7b0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:29.177731 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa4a4f-b1e6-45dc-b6e5-500a5ef7b0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:29.178371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa4a4f-b1e6-45dc-b6e5-500a5ef7b0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:29.179925 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa4a4f-b1e6-45dc-b6e5-500a5ef7b0e1 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:29.189906 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1405/2807] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:57:29.193980 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92e4a3-5e9c-4c42-80b5-ed0545f431d8 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:29.206787 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92e4a3-5e9c-4c42-80b5-ed0545f431d8 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:29.211690 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674c127-17d3-4777-94a7-8b35bcc4af52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:29.212961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674c127-17d3-4777-94a7-8b35bcc4af52 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:29.213244 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674c127-17d3-4777-94a7-8b35bcc4af52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:29.213514 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674c127-17d3-4777-94a7-8b35bcc4af52 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:29.214158 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674c127-17d3-4777-94a7-8b35bcc4af52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:29.215772 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674c127-17d3-4777-94a7-8b35bcc4af52 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:29.237907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1403/2808] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 10:57:29.242170 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa4a4f-b1e6-45dc-b6e5-500a5ef7b0e1 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:29.252452 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa4a4f-b1e6-45dc-b6e5-500a5ef7b0e1 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:29.257014 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb8b1e-e871-4957-9e9c-766bdd1e9334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:29.257659 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb8b1e-e871-4957-9e9c-766bdd1e9334 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:29.257938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb8b1e-e871-4957-9e9c-766bdd1e9334 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:29.258211 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb8b1e-e871-4957-9e9c-766bdd1e9334 admin admin] PATH_INFO: `/v3/projects/63a9b55b0bc442eaa1b60b3b2c2998fd/users/7ec9377ff41248628d51a50c57934760/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:29.273170 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb8b1e-e871-4957-9e9c-766bdd1e9334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a9b55b0bc442eaa1b60b3b2c2998fd, user_id=7ec9377ff41248628d51a50c57934760, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:29.275761 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb8b1e-e871-4957-9e9c-766bdd1e9334 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:29.288890 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1406/2809] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:57:29 2022] PUT /identity/v3/projects/63a9b55b0bc442eaa1b60b3b2c2998fd/users/7ec9377ff41248628d51a50c57934760/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:57:29.300312 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8d30a-b1d7-4a8e-acc1-4a8865ca1c55 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:29.300621 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8d30a-b1d7-4a8e-acc1-4a8865ca1c55 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:29.300897 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8d30a-b1d7-4a8e-acc1-4a8865ca1c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:29.329552 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f2d8d30a-b1d7-4a8e-acc1-4a8865ca1c55 None None] MFA Rules not processed for user `7ec9377ff41248628d51a50c57934760`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:57:29.330768 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f2d8d30a-b1d7-4a8e-acc1-4a8865ca1c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:57:29.395593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1404/2810] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:57:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:57:29.400266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb8b1e-e871-4957-9e9c-766bdd1e9334 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:29.463441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb8b1e-e871-4957-9e9c-766bdd1e9334 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:29.467926 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07601b-c00f-427b-85c8-03751856fef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:29.468520 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07601b-c00f-427b-85c8-03751856fef6 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:29.468820 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07601b-c00f-427b-85c8-03751856fef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:29.469088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07601b-c00f-427b-85c8-03751856fef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:29.469724 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07601b-c00f-427b-85c8-03751856fef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:29.471585 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07601b-c00f-427b-85c8-03751856fef6 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:29.500625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1407/2811] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:57:29 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:57:29.504750 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8d30a-b1d7-4a8e-acc1-4a8865ca1c55 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:29.515835 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8d30a-b1d7-4a8e-acc1-4a8865ca1c55 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:29.537550 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:29.576149 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f350d6-3de8-4221-b45b-3067ec59bd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:29.576806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f350d6-3de8-4221-b45b-3067ec59bd69 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:29.577086 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f350d6-3de8-4221-b45b-3067ec59bd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:29.577355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f350d6-3de8-4221-b45b-3067ec59bd69 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:29.577965 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f350d6-3de8-4221-b45b-3067ec59bd69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:29.579843 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f350d6-3de8-4221-b45b-3067ec59bd69 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:29.600926 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1405/2812] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:57:29 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:57:29.605619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07601b-c00f-427b-85c8-03751856fef6 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:29.615779 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07601b-c00f-427b-85c8-03751856fef6 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:29.620907 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dfe6a-7cbc-4349-941e-0989f945a537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:29.621487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dfe6a-7cbc-4349-941e-0989f945a537 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:29.621762 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dfe6a-7cbc-4349-941e-0989f945a537 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:29.622031 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dfe6a-7cbc-4349-941e-0989f945a537 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:29.622693 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dfe6a-7cbc-4349-941e-0989f945a537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:29.624291 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dfe6a-7cbc-4349-941e-0989f945a537 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:29.634844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1408/2813] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 10:57:29.638967 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f350d6-3de8-4221-b45b-3067ec59bd69 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:29.648982 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f350d6-3de8-4221-b45b-3067ec59bd69 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:29.653633 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39c003-cc5a-4719-ac24-628574ae4b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:29.654279 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39c003-cc5a-4719-ac24-628574ae4b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:29.654556 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39c003-cc5a-4719-ac24-628574ae4b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:29.654830 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39c003-cc5a-4719-ac24-628574ae4b08 admin admin] PATH_INFO: `/v3/projects/4968cedd4be94260a22011d399d05d1c/users/efd16765e1e84c61a5d64412ee7a2c85/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:29.670014 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39c003-cc5a-4719-ac24-628574ae4b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4968cedd4be94260a22011d399d05d1c, user_id=efd16765e1e84c61a5d64412ee7a2c85, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:29.672652 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39c003-cc5a-4719-ac24-628574ae4b08 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:29.685761 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1406/2814] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:57:29 2022] PUT /identity/v3/projects/4968cedd4be94260a22011d399d05d1c/users/efd16765e1e84c61a5d64412ee7a2c85/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:57:29.689824 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dfe6a-7cbc-4349-941e-0989f945a537 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:29.699653 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dfe6a-7cbc-4349-941e-0989f945a537 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:29.756753 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a1dfb-3a72-4ffd-8212-5457295aea17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:29.757558 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a1dfb-3a72-4ffd-8212-5457295aea17 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:29.757846 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a1dfb-3a72-4ffd-8212-5457295aea17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:29.758117 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a1dfb-3a72-4ffd-8212-5457295aea17 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:29.758760 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a1dfb-3a72-4ffd-8212-5457295aea17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:29.760393 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a1dfb-3a72-4ffd-8212-5457295aea17 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:29.772310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1409/2815] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:57:29.776800 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39c003-cc5a-4719-ac24-628574ae4b08 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:29.787599 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39c003-cc5a-4719-ac24-628574ae4b08 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:29.792884 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e33154-d9e6-466a-8341-d1edd10d47e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:29.793538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e33154-d9e6-466a-8341-d1edd10d47e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:29.793862 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e33154-d9e6-466a-8341-d1edd10d47e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:29.794178 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e33154-d9e6-466a-8341-d1edd10d47e2 admin admin] PATH_INFO: `/v3/projects/4968cedd4be94260a22011d399d05d1c/users/efd16765e1e84c61a5d64412ee7a2c85/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:29.796386 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e33154-d9e6-466a-8341-d1edd10d47e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4968cedd4be94260a22011d399d05d1c, user_id=efd16765e1e84c61a5d64412ee7a2c85, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:29.798998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e33154-d9e6-466a-8341-d1edd10d47e2 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:29.813842 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1407/2816] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:57:29 2022] PUT /identity/v3/projects/4968cedd4be94260a22011d399d05d1c/users/efd16765e1e84c61a5d64412ee7a2c85/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:57:29.824441 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c693058-aec6-4a38-9294-4b011cf6d8cb None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:29.824841 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c693058-aec6-4a38-9294-4b011cf6d8cb None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:29.825124 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c693058-aec6-4a38-9294-4b011cf6d8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:29.854563 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-9c693058-aec6-4a38-9294-4b011cf6d8cb None None] MFA Rules not processed for user `efd16765e1e84c61a5d64412ee7a2c85`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:57:29.855777 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-9c693058-aec6-4a38-9294-4b011cf6d8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:57:29.884320 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:29.926697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1410/2817] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:57:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:57:29.938761 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e33154-d9e6-466a-8341-d1edd10d47e2 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:29.940443 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f1e33154-d9e6-466a-8341-d1edd10d47e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:57:29.999602 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e33154-d9e6-466a-8341-d1edd10d47e2 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:30.003594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70a00a-b25d-4a91-af44-c0b6faf06320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:30.004695 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70a00a-b25d-4a91-af44-c0b6faf06320 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:30.005053 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70a00a-b25d-4a91-af44-c0b6faf06320 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:30.005332 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70a00a-b25d-4a91-af44-c0b6faf06320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:30.014948 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70a00a-b25d-4a91-af44-c0b6faf06320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:30.016465 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70a00a-b25d-4a91-af44-c0b6faf06320 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:30.027036 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1408/2818] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:57:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:57:30.109948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c693058-aec6-4a38-9294-4b011cf6d8cb None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:30.119740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c693058-aec6-4a38-9294-4b011cf6d8cb None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:30.123433 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95b5df-70ca-4c75-95e5-47822e1252d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:30.124022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95b5df-70ca-4c75-95e5-47822e1252d9 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:30.124296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95b5df-70ca-4c75-95e5-47822e1252d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:30.124962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95b5df-70ca-4c75-95e5-47822e1252d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:30.185196 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95b5df-70ca-4c75-95e5-47822e1252d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:30.187556 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95b5df-70ca-4c75-95e5-47822e1252d9 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:30.201076 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1411/2819] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:57:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:57:40.022004 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=59,keystone:INSERT=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:40.194790 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=45 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:43.511242 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70a00a-b25d-4a91-af44-c0b6faf06320 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:43.512796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ce70a00a-b25d-4a91-af44-c0b6faf06320 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:57:43.582369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70a00a-b25d-4a91-af44-c0b6faf06320 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:43.589782 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951b768-a782-4061-bc43-4c15af1270ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:43.590552 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951b768-a782-4061-bc43-4c15af1270ff service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:43.590910 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951b768-a782-4061-bc43-4c15af1270ff service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:43.591236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951b768-a782-4061-bc43-4c15af1270ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:43.593134 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4951b768-a782-4061-bc43-4c15af1270ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:57:43.604262 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951b768-a782-4061-bc43-4c15af1270ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:43.605750 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951b768-a782-4061-bc43-4c15af1270ff service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:43.615663 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1409/2820] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:57:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:57:53.573564 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95b5df-70ca-4c75-95e5-47822e1252d9 service cinder] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:53.575031 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-0c95b5df-70ca-4c75-95e5-47822e1252d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:57:53.611039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=26 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:53.645204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95b5df-70ca-4c75-95e5-47822e1252d9 service cinder] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:53.650066 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6dae9-5a98-446c-a9d7-95b25748357b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:53.650691 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6dae9-5a98-446c-a9d7-95b25748357b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:53.650971 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6dae9-5a98-446c-a9d7-95b25748357b admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:53.651243 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6dae9-5a98-446c-a9d7-95b25748357b admin admin] PATH_INFO: `/v3/users/7032732e89824d1fb77e8cb6b6a5c704` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:53.652359 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6dae9-5a98-446c-a9d7-95b25748357b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7032732e89824d1fb77e8cb6b6a5c704)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:53.654284 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6dae9-5a98-446c-a9d7-95b25748357b admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:53.710314 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d3c6dae9-5a98-446c-a9d7-95b25748357b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7032732e89824d1fb77e8cb6b6a5c704'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:53.718740 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d3c6dae9-5a98-446c-a9d7-95b25748357b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7032732e89824d1fb77e8cb6b6a5c704'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:53.719395 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d3c6dae9-5a98-446c-a9d7-95b25748357b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7032732e89824d1fb77e8cb6b6a5c704'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:53.720037 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d3c6dae9-5a98-446c-a9d7-95b25748357b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7032732e89824d1fb77e8cb6b6a5c704'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:53.727185 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-d3c6dae9-5a98-446c-a9d7-95b25748357b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7032732e89824d1fb77e8cb6b6a5c704'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:53.744005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1412/2821] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:57:53 2022] DELETE /identity/v3/users/7032732e89824d1fb77e8cb6b6a5c704 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:57:53.909997 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951b768-a782-4061-bc43-4c15af1270ff service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:53.924189 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951b768-a782-4061-bc43-4c15af1270ff service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:53.987798 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0763e5-0a9d-4b84-8997-b3500b2fed27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:53.988433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0763e5-0a9d-4b84-8997-b3500b2fed27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:53.988753 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0763e5-0a9d-4b84-8997-b3500b2fed27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:53.989026 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0763e5-0a9d-4b84-8997-b3500b2fed27 admin admin] PATH_INFO: `/v3/projects/fe14ed3c1162454fbe3f8a307296d2b7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:53.990187 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0763e5-0a9d-4b84-8997-b3500b2fed27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe14ed3c1162454fbe3f8a307296d2b7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:53.992791 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0763e5-0a9d-4b84-8997-b3500b2fed27 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:54.039633 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ad0763e5-0a9d-4b84-8997-b3500b2fed27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe14ed3c1162454fbe3f8a307296d2b7', 'request_id': 'req-ad0763e5-0a9d-4b84-8997-b3500b2fed27'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:54.045802 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ad0763e5-0a9d-4b84-8997-b3500b2fed27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe14ed3c1162454fbe3f8a307296d2b7', 'request_id': 'req-ad0763e5-0a9d-4b84-8997-b3500b2fed27'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:54.053791 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ad0763e5-0a9d-4b84-8997-b3500b2fed27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe14ed3c1162454fbe3f8a307296d2b7', 'request_id': 'req-ad0763e5-0a9d-4b84-8997-b3500b2fed27'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:54.065226 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ad0763e5-0a9d-4b84-8997-b3500b2fed27 admin admin] The token cache is being invalidate because project fe14ed3c1162454fbe3f8a307296d2b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:57:54.065516 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ad0763e5-0a9d-4b84-8997-b3500b2fed27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:54.066143 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ad0763e5-0a9d-4b84-8997-b3500b2fed27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:54.067641 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1410/2822] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:57:53 2022] DELETE /identity/v3/projects/fe14ed3c1162454fbe3f8a307296d2b7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:57:54.072584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6dae9-5a98-446c-a9d7-95b25748357b admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:54.073965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-d3c6dae9-5a98-446c-a9d7-95b25748357b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:57:54.088366 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6dae9-5a98-446c-a9d7-95b25748357b admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:54.146641 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bfa5b-4adc-4d04-a48c-7c2d19f4d511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:54.147281 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bfa5b-4adc-4d04-a48c-7c2d19f4d511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:54.148074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bfa5b-4adc-4d04-a48c-7c2d19f4d511 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:54.148074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bfa5b-4adc-4d04-a48c-7c2d19f4d511 admin admin] PATH_INFO: `/v3/users/3975f1b1a6f24f749848ef8c0c5dd32c` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:54.149092 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bfa5b-4adc-4d04-a48c-7c2d19f4d511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3975f1b1a6f24f749848ef8c0c5dd32c)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:54.151073 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bfa5b-4adc-4d04-a48c-7c2d19f4d511 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:54.173821 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:54.202086 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-996bfa5b-4adc-4d04-a48c-7c2d19f4d511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3975f1b1a6f24f749848ef8c0c5dd32c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:54.212684 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-996bfa5b-4adc-4d04-a48c-7c2d19f4d511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3975f1b1a6f24f749848ef8c0c5dd32c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:54.213527 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-996bfa5b-4adc-4d04-a48c-7c2d19f4d511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3975f1b1a6f24f749848ef8c0c5dd32c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:54.214235 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-996bfa5b-4adc-4d04-a48c-7c2d19f4d511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3975f1b1a6f24f749848ef8c0c5dd32c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:54.224540 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-996bfa5b-4adc-4d04-a48c-7c2d19f4d511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3975f1b1a6f24f749848ef8c0c5dd32c'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:54.252603 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1413/2823] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:57:54 2022] DELETE /identity/v3/users/3975f1b1a6f24f749848ef8c0c5dd32c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:57:54.440353 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0763e5-0a9d-4b84-8997-b3500b2fed27 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:54.441901 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ad0763e5-0a9d-4b84-8997-b3500b2fed27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:57:54.457811 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0763e5-0a9d-4b84-8997-b3500b2fed27 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:54.518737 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8c0e4-c228-49cb-ae0c-57281205d3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:54.519301 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8c0e4-c228-49cb-ae0c-57281205d3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:54.519582 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8c0e4-c228-49cb-ae0c-57281205d3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:54.519859 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8c0e4-c228-49cb-ae0c-57281205d3fe admin admin] PATH_INFO: `/v3/projects/761414033150411b9920894ba1849b10` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:54.521070 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8c0e4-c228-49cb-ae0c-57281205d3fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=761414033150411b9920894ba1849b10)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:54.523038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8c0e4-c228-49cb-ae0c-57281205d3fe admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:54.557249 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:54.570850 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bbb8c0e4-c228-49cb-ae0c-57281205d3fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '761414033150411b9920894ba1849b10', 'request_id': 'req-bbb8c0e4-c228-49cb-ae0c-57281205d3fe'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:54.576935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bbb8c0e4-c228-49cb-ae0c-57281205d3fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '761414033150411b9920894ba1849b10', 'request_id': 'req-bbb8c0e4-c228-49cb-ae0c-57281205d3fe'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:54.584573 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bbb8c0e4-c228-49cb-ae0c-57281205d3fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '761414033150411b9920894ba1849b10', 'request_id': 'req-bbb8c0e4-c228-49cb-ae0c-57281205d3fe'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:54.594932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bbb8c0e4-c228-49cb-ae0c-57281205d3fe admin admin] The token cache is being invalidate because project 761414033150411b9920894ba1849b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:57:54.595220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bbb8c0e4-c228-49cb-ae0c-57281205d3fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:54.595836 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bbb8c0e4-c228-49cb-ae0c-57281205d3fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:54.597398 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1411/2824] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:57:54 2022] DELETE /identity/v3/projects/761414033150411b9920894ba1849b10 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:57:59.652646 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bfa5b-4adc-4d04-a48c-7c2d19f4d511 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:59.654078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-996bfa5b-4adc-4d04-a48c-7c2d19f4d511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:57:59.666456 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bfa5b-4adc-4d04-a48c-7c2d19f4d511 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:59.723517 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caad097-bc79-4ac6-8536-e47ba051939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:59.724147 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caad097-bc79-4ac6-8536-e47ba051939c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:59.724424 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caad097-bc79-4ac6-8536-e47ba051939c admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:59.724733 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caad097-bc79-4ac6-8536-e47ba051939c admin admin] PATH_INFO: `/v3/users/7ec9377ff41248628d51a50c57934760` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:59.725835 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caad097-bc79-4ac6-8536-e47ba051939c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ec9377ff41248628d51a50c57934760)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:59.728233 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caad097-bc79-4ac6-8536-e47ba051939c admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:59.772503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3caad097-bc79-4ac6-8536-e47ba051939c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ec9377ff41248628d51a50c57934760'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:59.780356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3caad097-bc79-4ac6-8536-e47ba051939c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ec9377ff41248628d51a50c57934760'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:59.781075 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3caad097-bc79-4ac6-8536-e47ba051939c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ec9377ff41248628d51a50c57934760'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:59.781667 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3caad097-bc79-4ac6-8536-e47ba051939c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ec9377ff41248628d51a50c57934760'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:59.788831 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-3caad097-bc79-4ac6-8536-e47ba051939c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ec9377ff41248628d51a50c57934760'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:57:59.807082 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1414/2825] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:57:59 2022] DELETE /identity/v3/users/7ec9377ff41248628d51a50c57934760 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:57:59.811533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174becc-0983-4c09-a543-bb5f788e29b9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:59.812010 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174becc-0983-4c09-a543-bb5f788e29b9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:59.812114 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174becc-0983-4c09-a543-bb5f788e29b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:59.830741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f174becc-0983-4c09-a543-bb5f788e29b9 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:57:59.831928 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f174becc-0983-4c09-a543-bb5f788e29b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:57:59.888401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1412/2826] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:57:59.898406 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caad097-bc79-4ac6-8536-e47ba051939c admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:57:59.899834 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3caad097-bc79-4ac6-8536-e47ba051939c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:57:59.919883 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:57:59.957935 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caad097-bc79-4ac6-8536-e47ba051939c admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:57:59.962253 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9b6e0-05d8-4ee5-bb8f-ef33a7368b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:57:59.962845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9b6e0-05d8-4ee5-bb8f-ef33a7368b16 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:57:59.963120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9b6e0-05d8-4ee5-bb8f-ef33a7368b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:57:59.963389 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9b6e0-05d8-4ee5-bb8f-ef33a7368b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:57:59.972077 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9b6e0-05d8-4ee5-bb8f-ef33a7368b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:57:59.973508 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9b6e0-05d8-4ee5-bb8f-ef33a7368b16 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:57:59.983195 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1415/2827] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:57:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:58:00.260490 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174becc-0983-4c09-a543-bb5f788e29b9 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:00.262095 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f174becc-0983-4c09-a543-bb5f788e29b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:00.279819 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174becc-0983-4c09-a543-bb5f788e29b9 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:00.284958 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6d4e0-bbe6-4575-907b-9138aa58269c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:00.285796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6d4e0-bbe6-4575-907b-9138aa58269c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:00.286191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6d4e0-bbe6-4575-907b-9138aa58269c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:00.286497 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6d4e0-bbe6-4575-907b-9138aa58269c admin admin] PATH_INFO: `/v3/projects/63a9b55b0bc442eaa1b60b3b2c2998fd` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:00.287611 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6d4e0-bbe6-4575-907b-9138aa58269c admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a9b55b0bc442eaa1b60b3b2c2998fd)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:00.290486 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6d4e0-bbe6-4575-907b-9138aa58269c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:00.338853 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e2e6d4e0-bbe6-4575-907b-9138aa58269c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a9b55b0bc442eaa1b60b3b2c2998fd', 'request_id': 'req-e2e6d4e0-bbe6-4575-907b-9138aa58269c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:00.344931 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e2e6d4e0-bbe6-4575-907b-9138aa58269c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a9b55b0bc442eaa1b60b3b2c2998fd', 'request_id': 'req-e2e6d4e0-bbe6-4575-907b-9138aa58269c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:00.352318 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e2e6d4e0-bbe6-4575-907b-9138aa58269c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a9b55b0bc442eaa1b60b3b2c2998fd', 'request_id': 'req-e2e6d4e0-bbe6-4575-907b-9138aa58269c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:00.362619 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e2e6d4e0-bbe6-4575-907b-9138aa58269c admin admin] The token cache is being invalidate because project 63a9b55b0bc442eaa1b60b3b2c2998fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:58:00.362908 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e2e6d4e0-bbe6-4575-907b-9138aa58269c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:00.363566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e2e6d4e0-bbe6-4575-907b-9138aa58269c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:00.365112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1413/2828] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:58:00 2022] DELETE /identity/v3/projects/63a9b55b0bc442eaa1b60b3b2c2998fd => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:58:00.369198 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9b6e0-05d8-4ee5-bb8f-ef33a7368b16 service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:00.378672 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9b6e0-05d8-4ee5-bb8f-ef33a7368b16 service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:00.438905 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07774f16-19ac-4841-892d-48324a6275dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:00.439524 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07774f16-19ac-4841-892d-48324a6275dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:00.439798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07774f16-19ac-4841-892d-48324a6275dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:00.440074 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07774f16-19ac-4841-892d-48324a6275dd admin admin] PATH_INFO: `/v3/users/efd16765e1e84c61a5d64412ee7a2c85` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:00.441192 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07774f16-19ac-4841-892d-48324a6275dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd16765e1e84c61a5d64412ee7a2c85)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:00.443069 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07774f16-19ac-4841-892d-48324a6275dd admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:00.490333 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-07774f16-19ac-4841-892d-48324a6275dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd16765e1e84c61a5d64412ee7a2c85'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:00.497144 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-07774f16-19ac-4841-892d-48324a6275dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd16765e1e84c61a5d64412ee7a2c85'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:00.498005 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-07774f16-19ac-4841-892d-48324a6275dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd16765e1e84c61a5d64412ee7a2c85'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:00.498629 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-07774f16-19ac-4841-892d-48324a6275dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd16765e1e84c61a5d64412ee7a2c85'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:00.505523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-07774f16-19ac-4841-892d-48324a6275dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd16765e1e84c61a5d64412ee7a2c85'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:00.523269 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1416/2829] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:58:00 2022] DELETE /identity/v3/users/efd16765e1e84c61a5d64412ee7a2c85 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:58:00.789476 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6d4e0-bbe6-4575-907b-9138aa58269c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:00.791023 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e2e6d4e0-bbe6-4575-907b-9138aa58269c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:00.806844 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6d4e0-bbe6-4575-907b-9138aa58269c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:00.850760 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:00.866670 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730cce7-130d-43fa-8795-3fb00f6ec557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:00.867811 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730cce7-130d-43fa-8795-3fb00f6ec557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:00.868085 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730cce7-130d-43fa-8795-3fb00f6ec557 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:00.868352 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730cce7-130d-43fa-8795-3fb00f6ec557 admin admin] PATH_INFO: `/v3/projects/4968cedd4be94260a22011d399d05d1c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:00.869538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730cce7-130d-43fa-8795-3fb00f6ec557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4968cedd4be94260a22011d399d05d1c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:00.871390 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730cce7-130d-43fa-8795-3fb00f6ec557 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:00.915560 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7730cce7-130d-43fa-8795-3fb00f6ec557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4968cedd4be94260a22011d399d05d1c', 'request_id': 'req-7730cce7-130d-43fa-8795-3fb00f6ec557'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:00.921759 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7730cce7-130d-43fa-8795-3fb00f6ec557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4968cedd4be94260a22011d399d05d1c', 'request_id': 'req-7730cce7-130d-43fa-8795-3fb00f6ec557'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:00.929122 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7730cce7-130d-43fa-8795-3fb00f6ec557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4968cedd4be94260a22011d399d05d1c', 'request_id': 'req-7730cce7-130d-43fa-8795-3fb00f6ec557'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:00.939796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7730cce7-130d-43fa-8795-3fb00f6ec557 admin admin] The token cache is being invalidate because project 4968cedd4be94260a22011d399d05d1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:58:00.940078 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7730cce7-130d-43fa-8795-3fb00f6ec557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:00.940724 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7730cce7-130d-43fa-8795-3fb00f6ec557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:00.942154 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1414/2830] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:58:00 2022] DELETE /identity/v3/projects/4968cedd4be94260a22011d399d05d1c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:58:00.947042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340a865-4f44-476d-bb11-9c0e023c271a None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:00.947525 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340a865-4f44-476d-bb11-9c0e023c271a None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:00.947632 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340a865-4f44-476d-bb11-9c0e023c271a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:00.967518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-8340a865-4f44-476d-bb11-9c0e023c271a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:00.968746 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8340a865-4f44-476d-bb11-9c0e023c271a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:01.001569 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:01.027726 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1417/2831] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:58:01.035648 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5451b34-0202-48de-8f4c-36307d02d4fa None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:01.035933 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5451b34-0202-48de-8f4c-36307d02d4fa None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:01.036206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5451b34-0202-48de-8f4c-36307d02d4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:01.056006 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b5451b34-0202-48de-8f4c-36307d02d4fa None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:01.057474 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b5451b34-0202-48de-8f4c-36307d02d4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:01.065372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1415/2832] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:58:01.069443 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340a865-4f44-476d-bb11-9c0e023c271a None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:01.079407 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340a865-4f44-476d-bb11-9c0e023c271a None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:01.084306 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51660a47-8916-42fb-b6bf-dbfc9fd81f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:01.084930 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51660a47-8916-42fb-b6bf-dbfc9fd81f6e admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:01.085213 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51660a47-8916-42fb-b6bf-dbfc9fd81f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:01.085487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51660a47-8916-42fb-b6bf-dbfc9fd81f6e admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:01.086737 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51660a47-8916-42fb-b6bf-dbfc9fd81f6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:58:01.087042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51660a47-8916-42fb-b6bf-dbfc9fd81f6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:01.088639 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51660a47-8916-42fb-b6bf-dbfc9fd81f6e admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:01.099985 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1418/2833] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:58:01.104153 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5451b34-0202-48de-8f4c-36307d02d4fa None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:01.113065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5451b34-0202-48de-8f4c-36307d02d4fa None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:01.117707 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08457d7d-d4d3-44ac-a9ed-916845bc2cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:01.118292 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08457d7d-d4d3-44ac-a9ed-916845bc2cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:01.118566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08457d7d-d4d3-44ac-a9ed-916845bc2cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:01.118831 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08457d7d-d4d3-44ac-a9ed-916845bc2cc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:01.119449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08457d7d-d4d3-44ac-a9ed-916845bc2cc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:01.121392 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08457d7d-d4d3-44ac-a9ed-916845bc2cc0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:01.148230 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1416/2834] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:58:01 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:58:01.152773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51660a47-8916-42fb-b6bf-dbfc9fd81f6e admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:01.162488 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51660a47-8916-42fb-b6bf-dbfc9fd81f6e admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:01.217557 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0ee7c-d44f-4fd4-8337-60ffd86dce24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:01.218154 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0ee7c-d44f-4fd4-8337-60ffd86dce24 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:01.218431 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0ee7c-d44f-4fd4-8337-60ffd86dce24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:01.218702 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0ee7c-d44f-4fd4-8337-60ffd86dce24 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:01.219325 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0ee7c-d44f-4fd4-8337-60ffd86dce24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:01.221267 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0ee7c-d44f-4fd4-8337-60ffd86dce24 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:01.242034 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1419/2835] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:58:01 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:58:01.246812 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08457d7d-d4d3-44ac-a9ed-916845bc2cc0 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:01.256971 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08457d7d-d4d3-44ac-a9ed-916845bc2cc0 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:01.261591 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b484cb-98c9-4923-b839-e2feac14f652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:01.262181 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b484cb-98c9-4923-b839-e2feac14f652 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:01.262458 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b484cb-98c9-4923-b839-e2feac14f652 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:01.262727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b484cb-98c9-4923-b839-e2feac14f652 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:01.263361 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b484cb-98c9-4923-b839-e2feac14f652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:01.264998 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b484cb-98c9-4923-b839-e2feac14f652 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:01.274655 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1417/2836] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:58:01.278350 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0ee7c-d44f-4fd4-8337-60ffd86dce24 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:01.288043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0ee7c-d44f-4fd4-8337-60ffd86dce24 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:01.293195 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e3535-cac7-4fd2-8310-aa90bb00624f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:01.293778 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e3535-cac7-4fd2-8310-aa90bb00624f admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:01.294058 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e3535-cac7-4fd2-8310-aa90bb00624f admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:01.294331 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e3535-cac7-4fd2-8310-aa90bb00624f admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:01.294968 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e3535-cac7-4fd2-8310-aa90bb00624f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:01.296534 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e3535-cac7-4fd2-8310-aa90bb00624f admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:01.307704 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1420/2837] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:58:01.312038 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b484cb-98c9-4923-b839-e2feac14f652 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:01.321913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b484cb-98c9-4923-b839-e2feac14f652 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:01.326439 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7a475-0ca9-4237-8661-6cb74d3fed10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:01.327075 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7a475-0ca9-4237-8661-6cb74d3fed10 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:01.327353 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7a475-0ca9-4237-8661-6cb74d3fed10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:01.327626 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7a475-0ca9-4237-8661-6cb74d3fed10 admin admin] PATH_INFO: `/v3/projects/242cdbe69e724d13897a706e2380f24e/users/f4b83835fc324dd6ae71928665e09a76/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:01.342363 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7a475-0ca9-4237-8661-6cb74d3fed10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=242cdbe69e724d13897a706e2380f24e, user_id=f4b83835fc324dd6ae71928665e09a76, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:01.345020 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7a475-0ca9-4237-8661-6cb74d3fed10 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:01.358013 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1418/2838] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:58:01 2022] PUT /identity/v3/projects/242cdbe69e724d13897a706e2380f24e/users/f4b83835fc324dd6ae71928665e09a76/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:58:01.369482 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc76177-17fa-433b-a402-95209e69ecf8 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:01.369775 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc76177-17fa-433b-a402-95209e69ecf8 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:01.370056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc76177-17fa-433b-a402-95209e69ecf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:01.397478 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-bdc76177-17fa-433b-a402-95209e69ecf8 None None] MFA Rules not processed for user `f4b83835fc324dd6ae71928665e09a76`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:01.398605 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-bdc76177-17fa-433b-a402-95209e69ecf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:01.461658 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1421/2839] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:58:01.466311 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7a475-0ca9-4237-8661-6cb74d3fed10 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:01.526700 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7a475-0ca9-4237-8661-6cb74d3fed10 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:01.531497 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e13a7-4c8a-4c86-9fe0-021f67f5d085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:01.532100 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e13a7-4c8a-4c86-9fe0-021f67f5d085 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:01.532381 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e13a7-4c8a-4c86-9fe0-021f67f5d085 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:01.532686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e13a7-4c8a-4c86-9fe0-021f67f5d085 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:01.533447 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e13a7-4c8a-4c86-9fe0-021f67f5d085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:01.535336 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e13a7-4c8a-4c86-9fe0-021f67f5d085 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:01.551341 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:01.568088 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1419/2840] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:58:01 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:58:01.569262 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc76177-17fa-433b-a402-95209e69ecf8 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:01.579792 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc76177-17fa-433b-a402-95209e69ecf8 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:01.612860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:01.637811 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffd54e-5187-495c-9641-362e7a68ad44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:01.638414 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffd54e-5187-495c-9641-362e7a68ad44 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:01.638694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffd54e-5187-495c-9641-362e7a68ad44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:01.638965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffd54e-5187-495c-9641-362e7a68ad44 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:01.639606 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffd54e-5187-495c-9641-362e7a68ad44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:01.641537 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffd54e-5187-495c-9641-362e7a68ad44 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:01.662146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1422/2841] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:58:01 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:58:01.666685 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e13a7-4c8a-4c86-9fe0-021f67f5d085 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:01.676883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e13a7-4c8a-4c86-9fe0-021f67f5d085 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:01.681585 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1c9ee-aa84-4080-b03c-66a20e442b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:01.682185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1c9ee-aa84-4080-b03c-66a20e442b89 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:01.682466 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1c9ee-aa84-4080-b03c-66a20e442b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:01.682739 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1c9ee-aa84-4080-b03c-66a20e442b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:01.683379 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1c9ee-aa84-4080-b03c-66a20e442b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:01.684989 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1c9ee-aa84-4080-b03c-66a20e442b89 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:01.695289 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1420/2842] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:58:01.699309 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffd54e-5187-495c-9641-362e7a68ad44 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:01.709439 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffd54e-5187-495c-9641-362e7a68ad44 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:01.714498 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d52da-277c-47a2-94bd-1a66b2800353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:01.715150 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d52da-277c-47a2-94bd-1a66b2800353 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:01.715430 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d52da-277c-47a2-94bd-1a66b2800353 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:01.715720 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d52da-277c-47a2-94bd-1a66b2800353 admin admin] PATH_INFO: `/v3/projects/e9f3a4976a2b4baaa4b628e01077ba29/users/cea67b9c5b2b450789bd234ae54c2af2/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:01.732470 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d52da-277c-47a2-94bd-1a66b2800353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f3a4976a2b4baaa4b628e01077ba29, user_id=cea67b9c5b2b450789bd234ae54c2af2, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:01.735090 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d52da-277c-47a2-94bd-1a66b2800353 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:01.747938 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1423/2843] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:58:01 2022] PUT /identity/v3/projects/e9f3a4976a2b4baaa4b628e01077ba29/users/cea67b9c5b2b450789bd234ae54c2af2/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:58:01.751946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1c9ee-aa84-4080-b03c-66a20e442b89 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:01.762037 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1c9ee-aa84-4080-b03c-66a20e442b89 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:01.817946 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119f26a-bd98-453e-93d9-bf493e01797c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:01.818556 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119f26a-bd98-453e-93d9-bf493e01797c admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:01.818840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119f26a-bd98-453e-93d9-bf493e01797c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:01.819112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119f26a-bd98-453e-93d9-bf493e01797c admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:01.819756 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119f26a-bd98-453e-93d9-bf493e01797c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:01.821885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119f26a-bd98-453e-93d9-bf493e01797c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:01.831806 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1421/2844] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:58:01.836875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d52da-277c-47a2-94bd-1a66b2800353 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:01.847008 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d52da-277c-47a2-94bd-1a66b2800353 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:01.851530 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ecc6b-7b37-4415-ae48-d54911665570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:01.852174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ecc6b-7b37-4415-ae48-d54911665570 admin admin] REQUEST_METHOD: `PUT` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:01.852450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ecc6b-7b37-4415-ae48-d54911665570 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:01.852748 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ecc6b-7b37-4415-ae48-d54911665570 admin admin] PATH_INFO: `/v3/projects/e9f3a4976a2b4baaa4b628e01077ba29/users/cea67b9c5b2b450789bd234ae54c2af2/roles/529cb3511f3a498b9b7169ed5b0f6b8e` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:01.854623 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ecc6b-7b37-4415-ae48-d54911665570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f3a4976a2b4baaa4b628e01077ba29, user_id=cea67b9c5b2b450789bd234ae54c2af2, role_id=529cb3511f3a498b9b7169ed5b0f6b8e)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:01.857246 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ecc6b-7b37-4415-ae48-d54911665570 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:01.867198 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1424/2845] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:58:01 2022] PUT /identity/v3/projects/e9f3a4976a2b4baaa4b628e01077ba29/users/cea67b9c5b2b450789bd234ae54c2af2/roles/529cb3511f3a498b9b7169ed5b0f6b8e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:58:01.930947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fad9b-ed51-4355-9d37-a0058283a4cd None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:01.931513 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fad9b-ed51-4355-9d37-a0058283a4cd None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:01.931513 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fad9b-ed51-4355-9d37-a0058283a4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:01.959369 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-6f2fad9b-ed51-4355-9d37-a0058283a4cd None None] MFA Rules not processed for user `cea67b9c5b2b450789bd234ae54c2af2`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:01.960587 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6f2fad9b-ed51-4355-9d37-a0058283a4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:02.027579 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1422/2846] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:58:02.038739 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ecc6b-7b37-4415-ae48-d54911665570 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:02.040433 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-c93ecc6b-7b37-4415-ae48-d54911665570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:02.098902 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ecc6b-7b37-4415-ae48-d54911665570 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:02.102484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a0dea-6d37-4b0a-8f15-db37740f3711 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:02.103077 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a0dea-6d37-4b0a-8f15-db37740f3711 service cinder] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:02.103356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a0dea-6d37-4b0a-8f15-db37740f3711 service cinder] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:02.103628 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a0dea-6d37-4b0a-8f15-db37740f3711 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:02.113042 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a0dea-6d37-4b0a-8f15-db37740f3711 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:02.114476 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a0dea-6d37-4b0a-8f15-db37740f3711 service cinder] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:02.124518 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1425/2847] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:58:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:58:02.202725 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fad9b-ed51-4355-9d37-a0058283a4cd None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:02.212590 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fad9b-ed51-4355-9d37-a0058283a4cd None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:02.216171 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87277f27-3051-4673-a823-c7450b51a401 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:02.216800 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87277f27-3051-4673-a823-c7450b51a401 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:02.217079 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87277f27-3051-4673-a823-c7450b51a401 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:02.217350 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87277f27-3051-4673-a823-c7450b51a401 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:02.272201 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87277f27-3051-4673-a823-c7450b51a401 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:02.273745 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87277f27-3051-4673-a823-c7450b51a401 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:02.282520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1423/2848] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:58:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:58:05.003378 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a0dea-6d37-4b0a-8f15-db37740f3711 service cinder] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:05.066231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a0dea-6d37-4b0a-8f15-db37740f3711 service cinder] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:05.071184 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c346308-9e26-4049-b0e4-680cf5260896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:05.071802 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c346308-9e26-4049-b0e4-680cf5260896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:05.072079 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c346308-9e26-4049-b0e4-680cf5260896 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:05.072349 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c346308-9e26-4049-b0e4-680cf5260896 admin admin] PATH_INFO: `/v3/users/f4b83835fc324dd6ae71928665e09a76` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:05.073562 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c346308-9e26-4049-b0e4-680cf5260896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4b83835fc324dd6ae71928665e09a76)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:05.075379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c346308-9e26-4049-b0e4-680cf5260896 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:05.110587 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:05.125450 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8c346308-9e26-4049-b0e4-680cf5260896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4b83835fc324dd6ae71928665e09a76'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:05.134122 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8c346308-9e26-4049-b0e4-680cf5260896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4b83835fc324dd6ae71928665e09a76'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:05.134962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8c346308-9e26-4049-b0e4-680cf5260896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4b83835fc324dd6ae71928665e09a76'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:05.135802 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8c346308-9e26-4049-b0e4-680cf5260896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4b83835fc324dd6ae71928665e09a76'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:05.143703 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-8c346308-9e26-4049-b0e4-680cf5260896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4b83835fc324dd6ae71928665e09a76'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:05.162790 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1426/2849] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:58:05 2022] DELETE /identity/v3/users/f4b83835fc324dd6ae71928665e09a76 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:58:05.167435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0784c-4d61-4748-a511-2cf627df4f8d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:05.167935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0784c-4d61-4748-a511-2cf627df4f8d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:05.168044 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0784c-4d61-4748-a511-2cf627df4f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:05.175995 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:05.189463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-38e0784c-4d61-4748-a511-2cf627df4f8d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:05.190657 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-38e0784c-4d61-4748-a511-2cf627df4f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:05.248533 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1424/2850] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:58:05.258965 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c346308-9e26-4049-b0e4-680cf5260896 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:05.260344 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8c346308-9e26-4049-b0e4-680cf5260896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:05.315875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c346308-9e26-4049-b0e4-680cf5260896 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:05.319481 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e632f-91e9-4f4d-a2e8-cbcb75043b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:05.320088 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e632f-91e9-4f4d-a2e8-cbcb75043b99 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:05.321018 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e632f-91e9-4f4d-a2e8-cbcb75043b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:05.321288 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e632f-91e9-4f4d-a2e8-cbcb75043b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:05.330104 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e632f-91e9-4f4d-a2e8-cbcb75043b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:05.331503 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e632f-91e9-4f4d-a2e8-cbcb75043b99 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:05.341036 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1427/2851] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:58:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:58:05.619334 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0784c-4d61-4748-a511-2cf627df4f8d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:05.620859 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-38e0784c-4d61-4748-a511-2cf627df4f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:05.633573 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0784c-4d61-4748-a511-2cf627df4f8d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:05.638225 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bb408-45ec-4883-a5d8-f149e17b1235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:05.638851 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bb408-45ec-4883-a5d8-f149e17b1235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:05.639126 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bb408-45ec-4883-a5d8-f149e17b1235 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:05.639450 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bb408-45ec-4883-a5d8-f149e17b1235 admin admin] PATH_INFO: `/v3/projects/242cdbe69e724d13897a706e2380f24e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:05.640634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160bb408-45ec-4883-a5d8-f149e17b1235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=242cdbe69e724d13897a706e2380f24e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:05.642588 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160bb408-45ec-4883-a5d8-f149e17b1235 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:05.689449 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-160bb408-45ec-4883-a5d8-f149e17b1235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '242cdbe69e724d13897a706e2380f24e', 'request_id': 'req-160bb408-45ec-4883-a5d8-f149e17b1235'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:05.696138 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-160bb408-45ec-4883-a5d8-f149e17b1235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '242cdbe69e724d13897a706e2380f24e', 'request_id': 'req-160bb408-45ec-4883-a5d8-f149e17b1235'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:05.703793 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-160bb408-45ec-4883-a5d8-f149e17b1235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '242cdbe69e724d13897a706e2380f24e', 'request_id': 'req-160bb408-45ec-4883-a5d8-f149e17b1235'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:05.715966 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-160bb408-45ec-4883-a5d8-f149e17b1235 admin admin] The token cache is being invalidate because project 242cdbe69e724d13897a706e2380f24e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:58:05.716154 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-160bb408-45ec-4883-a5d8-f149e17b1235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:05.716825 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-160bb408-45ec-4883-a5d8-f149e17b1235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:05.718307 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1425/2852] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:58:05 2022] DELETE /identity/v3/projects/242cdbe69e724d13897a706e2380f24e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:58:05.722262 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e632f-91e9-4f4d-a2e8-cbcb75043b99 service neutron] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:05.732184 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e632f-91e9-4f4d-a2e8-cbcb75043b99 service neutron] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:05.787337 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5c77d-dd9e-4ea9-9b73-4735732ecabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:05.788001 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5c77d-dd9e-4ea9-9b73-4735732ecabd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:05.788278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5c77d-dd9e-4ea9-9b73-4735732ecabd admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:05.788624 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5c77d-dd9e-4ea9-9b73-4735732ecabd admin admin] PATH_INFO: `/v3/users/cea67b9c5b2b450789bd234ae54c2af2` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:05.790318 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5c77d-dd9e-4ea9-9b73-4735732ecabd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea67b9c5b2b450789bd234ae54c2af2)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:05.792696 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5c77d-dd9e-4ea9-9b73-4735732ecabd admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:05.840574 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bfa5c77d-dd9e-4ea9-9b73-4735732ecabd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea67b9c5b2b450789bd234ae54c2af2'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:05.848025 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bfa5c77d-dd9e-4ea9-9b73-4735732ecabd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea67b9c5b2b450789bd234ae54c2af2'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:05.848762 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bfa5c77d-dd9e-4ea9-9b73-4735732ecabd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea67b9c5b2b450789bd234ae54c2af2'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:05.849400 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bfa5c77d-dd9e-4ea9-9b73-4735732ecabd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea67b9c5b2b450789bd234ae54c2af2'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:05.850614 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:05.859514 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bfa5c77d-dd9e-4ea9-9b73-4735732ecabd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea67b9c5b2b450789bd234ae54c2af2'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:05.876920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1428/2853] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:58:05 2022] DELETE /identity/v3/users/cea67b9c5b2b450789bd234ae54c2af2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:58:06.142594 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bb408-45ec-4883-a5d8-f149e17b1235 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:06.144045 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-160bb408-45ec-4883-a5d8-f149e17b1235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:06.157409 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bb408-45ec-4883-a5d8-f149e17b1235 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:06.213502 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a848c-402e-432e-9291-746c6c3b07e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:06.214140 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a848c-402e-432e-9291-746c6c3b07e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:06.214385 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a848c-402e-432e-9291-746c6c3b07e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:06.214651 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a848c-402e-432e-9291-746c6c3b07e0 admin admin] PATH_INFO: `/v3/projects/e9f3a4976a2b4baaa4b628e01077ba29` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:06.215752 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a848c-402e-432e-9291-746c6c3b07e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9f3a4976a2b4baaa4b628e01077ba29)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:06.217703 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a848c-402e-432e-9291-746c6c3b07e0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:06.250863 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:06.265336 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-783a848c-402e-432e-9291-746c6c3b07e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9f3a4976a2b4baaa4b628e01077ba29', 'request_id': 'req-783a848c-402e-432e-9291-746c6c3b07e0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:06.271608 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-783a848c-402e-432e-9291-746c6c3b07e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9f3a4976a2b4baaa4b628e01077ba29', 'request_id': 'req-783a848c-402e-432e-9291-746c6c3b07e0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:06.279205 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-783a848c-402e-432e-9291-746c6c3b07e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9f3a4976a2b4baaa4b628e01077ba29', 'request_id': 'req-783a848c-402e-432e-9291-746c6c3b07e0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:06.289841 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-783a848c-402e-432e-9291-746c6c3b07e0 admin admin] The token cache is being invalidate because project e9f3a4976a2b4baaa4b628e01077ba29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:58:06.290125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-783a848c-402e-432e-9291-746c6c3b07e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:06.290746 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-783a848c-402e-432e-9291-746c6c3b07e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:06.292270 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1426/2854] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:58:06 2022] DELETE /identity/v3/projects/e9f3a4976a2b4baaa4b628e01077ba29 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:58:06.297553 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd8828-c8ab-47e2-89ea-e8412b0c7840 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:06.298026 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd8828-c8ab-47e2-89ea-e8412b0c7840 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:06.298206 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd8828-c8ab-47e2-89ea-e8412b0c7840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:06.318029 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-21bd8828-c8ab-47e2-89ea-e8412b0c7840 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:06.319230 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-21bd8828-c8ab-47e2-89ea-e8412b0c7840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:06.377665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1429/2855] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:58:06.386440 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7ac3a-09b7-4f85-b116-f93407645fe4 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:06.386722 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7ac3a-09b7-4f85-b116-f93407645fe4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:06.386993 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7ac3a-09b7-4f85-b116-f93407645fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:06.406733 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a1c7ac3a-09b7-4f85-b116-f93407645fe4 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:06.407927 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a1c7ac3a-09b7-4f85-b116-f93407645fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:06.415611 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1427/2856] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:58:06.419728 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd8828-c8ab-47e2-89ea-e8412b0c7840 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:06.429324 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd8828-c8ab-47e2-89ea-e8412b0c7840 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:06.433776 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ee26e-8324-49ec-a885-fe1b17b72bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:06.434363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ee26e-8324-49ec-a885-fe1b17b72bdd admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:06.434640 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ee26e-8324-49ec-a885-fe1b17b72bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:06.434908 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ee26e-8324-49ec-a885-fe1b17b72bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:06.435550 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ee26e-8324-49ec-a885-fe1b17b72bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:58:06.435850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ee26e-8324-49ec-a885-fe1b17b72bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:06.437456 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ee26e-8324-49ec-a885-fe1b17b72bdd admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:06.449486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1430/2857] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:58:06.453811 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7ac3a-09b7-4f85-b116-f93407645fe4 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:06.463674 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7ac3a-09b7-4f85-b116-f93407645fe4 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:06.468294 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454e80c-d415-455d-92aa-c58e7a9ffa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:06.468913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454e80c-d415-455d-92aa-c58e7a9ffa8e admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:06.469191 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454e80c-d415-455d-92aa-c58e7a9ffa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:06.469464 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454e80c-d415-455d-92aa-c58e7a9ffa8e admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:06.470090 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454e80c-d415-455d-92aa-c58e7a9ffa8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:06.471953 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454e80c-d415-455d-92aa-c58e7a9ffa8e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:06.498185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1428/2858] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:58:06 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:58:06.502463 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ee26e-8324-49ec-a885-fe1b17b72bdd admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:06.513161 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ee26e-8324-49ec-a885-fe1b17b72bdd admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:06.567149 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e7cc2-9fb1-4fe4-a2ec-aa2674387bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:06.567736 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e7cc2-9fb1-4fe4-a2ec-aa2674387bcb admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:06.568015 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e7cc2-9fb1-4fe4-a2ec-aa2674387bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:06.568341 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e7cc2-9fb1-4fe4-a2ec-aa2674387bcb admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:06.568948 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e7cc2-9fb1-4fe4-a2ec-aa2674387bcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:06.571330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e7cc2-9fb1-4fe4-a2ec-aa2674387bcb admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:06.593486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1431/2859] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:58:06 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:58:06.597820 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454e80c-d415-455d-92aa-c58e7a9ffa8e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:06.607788 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454e80c-d415-455d-92aa-c58e7a9ffa8e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:06.612291 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19097cf6-6f0d-4c01-8604-d1833faae2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:06.612911 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19097cf6-6f0d-4c01-8604-d1833faae2eb admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:06.613184 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19097cf6-6f0d-4c01-8604-d1833faae2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:06.613448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19097cf6-6f0d-4c01-8604-d1833faae2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:06.614079 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19097cf6-6f0d-4c01-8604-d1833faae2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:06.615649 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19097cf6-6f0d-4c01-8604-d1833faae2eb admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:06.625252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1429/2860] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:58:06.629038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e7cc2-9fb1-4fe4-a2ec-aa2674387bcb admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:06.639325 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e7cc2-9fb1-4fe4-a2ec-aa2674387bcb admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:06.643814 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3c11b-827f-49d9-87f2-df022d90c045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:06.644398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3c11b-827f-49d9-87f2-df022d90c045 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:06.644718 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3c11b-827f-49d9-87f2-df022d90c045 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:06.644996 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3c11b-827f-49d9-87f2-df022d90c045 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:06.645636 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3c11b-827f-49d9-87f2-df022d90c045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:06.647207 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3c11b-827f-49d9-87f2-df022d90c045 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:06.658445 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1432/2861] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:58:06.662334 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19097cf6-6f0d-4c01-8604-d1833faae2eb admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:06.672000 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19097cf6-6f0d-4c01-8604-d1833faae2eb admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:06.676423 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271992a-c648-4b01-833d-f06911f72b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:06.677084 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271992a-c648-4b01-833d-f06911f72b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:06.677362 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271992a-c648-4b01-833d-f06911f72b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:06.677634 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271992a-c648-4b01-833d-f06911f72b1f admin admin] PATH_INFO: `/v3/projects/3c089987de984dae9e76ae876eada563/users/7dd67a14d6fb46fc82aaf76d7c24260b/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:06.693159 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271992a-c648-4b01-833d-f06911f72b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c089987de984dae9e76ae876eada563, user_id=7dd67a14d6fb46fc82aaf76d7c24260b, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:06.696433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271992a-c648-4b01-833d-f06911f72b1f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:06.709729 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1430/2862] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:58:06 2022] PUT /identity/v3/projects/3c089987de984dae9e76ae876eada563/users/7dd67a14d6fb46fc82aaf76d7c24260b/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:58:06.719751 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2f7dc-5f7c-454a-8c2f-a823b571ec16 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:06.720039 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2f7dc-5f7c-454a-8c2f-a823b571ec16 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:06.720312 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2f7dc-5f7c-454a-8c2f-a823b571ec16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:06.749038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-54b2f7dc-5f7c-454a-8c2f-a823b571ec16 None None] MFA Rules not processed for user `7dd67a14d6fb46fc82aaf76d7c24260b`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:06.750231 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-54b2f7dc-5f7c-454a-8c2f-a823b571ec16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:06.775613 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:06.814903 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1433/2863] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:58:06.827312 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271992a-c648-4b01-833d-f06911f72b1f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:06.829063 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c271992a-c648-4b01-833d-f06911f72b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:06.904488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271992a-c648-4b01-833d-f06911f72b1f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:06.908244 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b80b0-6e2d-40e5-8688-0be11316fd31 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28614526d50d4201b93b20df45465d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:06.908876 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b80b0-6e2d-40e5-8688-0be11316fd31 service glance] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:06.909160 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b80b0-6e2d-40e5-8688-0be11316fd31 service glance] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:06.909433 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b80b0-6e2d-40e5-8688-0be11316fd31 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:06.917545 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b80b0-6e2d-40e5-8688-0be11316fd31 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:06.918963 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b80b0-6e2d-40e5-8688-0be11316fd31 service glance] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:06.927593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1431/2864] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:58:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:58:16.811884 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=15 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:16.923695 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=75,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:27.620335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2f7dc-5f7c-454a-8c2f-a823b571ec16 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:27.681527 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2f7dc-5f7c-454a-8c2f-a823b571ec16 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:27.685997 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f247a-a3ae-43de-8982-02ce4a14858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:27.686615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f247a-a3ae-43de-8982-02ce4a14858e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:27.686893 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f247a-a3ae-43de-8982-02ce4a14858e admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:27.687165 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f247a-a3ae-43de-8982-02ce4a14858e admin admin] PATH_INFO: `/v3/users/7dd67a14d6fb46fc82aaf76d7c24260b` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:27.688270 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f247a-a3ae-43de-8982-02ce4a14858e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd67a14d6fb46fc82aaf76d7c24260b)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:27.690208 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f247a-a3ae-43de-8982-02ce4a14858e admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:27.737962 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b13f247a-a3ae-43de-8982-02ce4a14858e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd67a14d6fb46fc82aaf76d7c24260b'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:27.745181 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b13f247a-a3ae-43de-8982-02ce4a14858e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd67a14d6fb46fc82aaf76d7c24260b'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:27.745811 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b13f247a-a3ae-43de-8982-02ce4a14858e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd67a14d6fb46fc82aaf76d7c24260b'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:27.746678 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b13f247a-a3ae-43de-8982-02ce4a14858e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd67a14d6fb46fc82aaf76d7c24260b'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:27.755934 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-b13f247a-a3ae-43de-8982-02ce4a14858e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd67a14d6fb46fc82aaf76d7c24260b'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:27.773184 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1434/2865] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:58:27 2022] DELETE /identity/v3/users/7dd67a14d6fb46fc82aaf76d7c24260b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:58:27.778267 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c3690-14bb-4833-8599-bcaa1f585b42 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:27.778744 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c3690-14bb-4833-8599-bcaa1f585b42 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:27.778846 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c3690-14bb-4833-8599-bcaa1f585b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:27.798363 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-048c3690-14bb-4833-8599-bcaa1f585b42 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:27.799608 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-048c3690-14bb-4833-8599-bcaa1f585b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:27.857064 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1432/2866] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:58:27.866752 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f247a-a3ae-43de-8982-02ce4a14858e admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:27.868180 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b13f247a-a3ae-43de-8982-02ce4a14858e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:27.923521 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f247a-a3ae-43de-8982-02ce4a14858e admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:27.927083 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71c0dd-a2d5-4331-bd40-6fcedbf745d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:27.927668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71c0dd-a2d5-4331-bd40-6fcedbf745d2 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:27.927943 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71c0dd-a2d5-4331-bd40-6fcedbf745d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:27.928212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71c0dd-a2d5-4331-bd40-6fcedbf745d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:27.936935 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71c0dd-a2d5-4331-bd40-6fcedbf745d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:27.938337 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71c0dd-a2d5-4331-bd40-6fcedbf745d2 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:27.947474 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1435/2867] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:58:28.205176 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c3690-14bb-4833-8599-bcaa1f585b42 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:28.206576 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-048c3690-14bb-4833-8599-bcaa1f585b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:28.220185 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c3690-14bb-4833-8599-bcaa1f585b42 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:28.225755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708408c1-22f4-4676-80b9-47a57ab90042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:28.226385 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708408c1-22f4-4676-80b9-47a57ab90042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:28.226661 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708408c1-22f4-4676-80b9-47a57ab90042 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:28.226930 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708408c1-22f4-4676-80b9-47a57ab90042 admin admin] PATH_INFO: `/v3/projects/3c089987de984dae9e76ae876eada563` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:28.228057 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708408c1-22f4-4676-80b9-47a57ab90042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c089987de984dae9e76ae876eada563)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:28.230765 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708408c1-22f4-4676-80b9-47a57ab90042 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:28.279158 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-708408c1-22f4-4676-80b9-47a57ab90042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c089987de984dae9e76ae876eada563', 'request_id': 'req-708408c1-22f4-4676-80b9-47a57ab90042'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:28.285477 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-708408c1-22f4-4676-80b9-47a57ab90042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c089987de984dae9e76ae876eada563', 'request_id': 'req-708408c1-22f4-4676-80b9-47a57ab90042'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:28.292697 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-708408c1-22f4-4676-80b9-47a57ab90042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c089987de984dae9e76ae876eada563', 'request_id': 'req-708408c1-22f4-4676-80b9-47a57ab90042'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:28.302774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-708408c1-22f4-4676-80b9-47a57ab90042 admin admin] The token cache is being invalidate because project 3c089987de984dae9e76ae876eada563 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:58:28.303059 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-708408c1-22f4-4676-80b9-47a57ab90042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:28.303672 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-708408c1-22f4-4676-80b9-47a57ab90042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:28.305394 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1433/2868] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:58:28 2022] DELETE /identity/v3/projects/3c089987de984dae9e76ae876eada563 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:58:28.310302 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d80888-8d6b-4b6c-9a5c-e59457aea1ea None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:28.310594 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d80888-8d6b-4b6c-9a5c-e59457aea1ea None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:28.310873 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d80888-8d6b-4b6c-9a5c-e59457aea1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:28.330927 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-f9d80888-8d6b-4b6c-9a5c-e59457aea1ea None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:28.332123 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-f9d80888-8d6b-4b6c-9a5c-e59457aea1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:28.349519 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:28.393718 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1436/2869] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:58:28.401797 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42454dc0-5012-417b-ab18-a57718746a97 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:28.402079 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42454dc0-5012-417b-ab18-a57718746a97 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:28.402349 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42454dc0-5012-417b-ab18-a57718746a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:28.423036 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-42454dc0-5012-417b-ab18-a57718746a97 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:28.424245 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-42454dc0-5012-417b-ab18-a57718746a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:28.432667 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1434/2870] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 10:58:28.436745 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d80888-8d6b-4b6c-9a5c-e59457aea1ea None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:28.446145 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d80888-8d6b-4b6c-9a5c-e59457aea1ea None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:28.451212 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339b9f3-1ef0-4c56-b38e-80013b732448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:28.451793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339b9f3-1ef0-4c56-b38e-80013b732448 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:28.452072 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339b9f3-1ef0-4c56-b38e-80013b732448 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:28.452351 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339b9f3-1ef0-4c56-b38e-80013b732448 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:28.453049 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339b9f3-1ef0-4c56-b38e-80013b732448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:58:28.453351 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339b9f3-1ef0-4c56-b38e-80013b732448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:28.454919 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339b9f3-1ef0-4c56-b38e-80013b732448 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:28.466484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1437/2871] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:58:28.470588 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42454dc0-5012-417b-ab18-a57718746a97 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:28.479674 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42454dc0-5012-417b-ab18-a57718746a97 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:28.484421 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a65f92-02f1-4923-86a6-5cc3e2d36f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:28.485087 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a65f92-02f1-4923-86a6-5cc3e2d36f85 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:28.485401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a65f92-02f1-4923-86a6-5cc3e2d36f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:28.485674 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a65f92-02f1-4923-86a6-5cc3e2d36f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:28.486295 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a65f92-02f1-4923-86a6-5cc3e2d36f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:28.488239 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a65f92-02f1-4923-86a6-5cc3e2d36f85 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:28.519119 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1435/2872] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:58:28 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:58:28.520174 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339b9f3-1ef0-4c56-b38e-80013b732448 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:28.529920 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339b9f3-1ef0-4c56-b38e-80013b732448 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:28.584649 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b01055-72b0-45d1-8985-984f767c5815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:28.585238 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b01055-72b0-45d1-8985-984f767c5815 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:28.585516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b01055-72b0-45d1-8985-984f767c5815 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:28.585787 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b01055-72b0-45d1-8985-984f767c5815 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:28.586417 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b01055-72b0-45d1-8985-984f767c5815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:28.588326 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b01055-72b0-45d1-8985-984f767c5815 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:28.607991 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1438/2873] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:58:28 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:58:28.612577 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a65f92-02f1-4923-86a6-5cc3e2d36f85 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:28.623322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a65f92-02f1-4923-86a6-5cc3e2d36f85 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:28.627870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97986863-5fac-4fa6-9f45-28cf1f22acea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:28.628462 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97986863-5fac-4fa6-9f45-28cf1f22acea admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:28.628772 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97986863-5fac-4fa6-9f45-28cf1f22acea admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:28.629045 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97986863-5fac-4fa6-9f45-28cf1f22acea admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:28.629686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97986863-5fac-4fa6-9f45-28cf1f22acea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:28.631266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97986863-5fac-4fa6-9f45-28cf1f22acea admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:28.642101 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1436/2874] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:58:28.646024 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b01055-72b0-45d1-8985-984f767c5815 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:28.656078 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b01055-72b0-45d1-8985-984f767c5815 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:28.660830 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6d45d-da71-4a15-9e83-0a3486463ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:28.661419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6d45d-da71-4a15-9e83-0a3486463ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:28.661701 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6d45d-da71-4a15-9e83-0a3486463ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:28.661976 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6d45d-da71-4a15-9e83-0a3486463ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:28.662619 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6d45d-da71-4a15-9e83-0a3486463ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:28.664226 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6d45d-da71-4a15-9e83-0a3486463ef7 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:28.674704 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1439/2875] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:58:28.678629 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97986863-5fac-4fa6-9f45-28cf1f22acea admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:28.688796 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97986863-5fac-4fa6-9f45-28cf1f22acea admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:28.693354 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a2b31-da0e-4e0a-ac14-cffe356ec5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:28.693988 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a2b31-da0e-4e0a-ac14-cffe356ec5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:28.694266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a2b31-da0e-4e0a-ac14-cffe356ec5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:28.694538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a2b31-da0e-4e0a-ac14-cffe356ec5c6 admin admin] PATH_INFO: `/v3/projects/af4063dbc829442ab7bed6c6c1324d05/users/2c9abec351ba43078a06cf6c1dbf1843/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:28.709538 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a2b31-da0e-4e0a-ac14-cffe356ec5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af4063dbc829442ab7bed6c6c1324d05, user_id=2c9abec351ba43078a06cf6c1dbf1843, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:28.713195 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a2b31-da0e-4e0a-ac14-cffe356ec5c6 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:28.725593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1437/2876] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:58:28 2022] PUT /identity/v3/projects/af4063dbc829442ab7bed6c6c1324d05/users/2c9abec351ba43078a06cf6c1dbf1843/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:58:28.735783 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bae09-9e6b-4f27-a5dc-fcc895e28cb9 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:28.736065 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bae09-9e6b-4f27-a5dc-fcc895e28cb9 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:28.736363 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bae09-9e6b-4f27-a5dc-fcc895e28cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:28.764694 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-3a3bae09-9e6b-4f27-a5dc-fcc895e28cb9 None None] MFA Rules not processed for user `2c9abec351ba43078a06cf6c1dbf1843`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:28.765910 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3a3bae09-9e6b-4f27-a5dc-fcc895e28cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:28.829417 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1440/2877] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:58:28.840807 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a2b31-da0e-4e0a-ac14-cffe356ec5c6 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:28.842526 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4f5a2b31-da0e-4e0a-ac14-cffe356ec5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:28.864217 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:28.900857 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a2b31-da0e-4e0a-ac14-cffe356ec5c6 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:28.904463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a540cf2-c2b5-4f94-8436-07174a8157f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:28.905089 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a540cf2-c2b5-4f94-8436-07174a8157f5 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:28.905372 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a540cf2-c2b5-4f94-8436-07174a8157f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:28.905646 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a540cf2-c2b5-4f94-8436-07174a8157f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:28.913761 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a540cf2-c2b5-4f94-8436-07174a8157f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:28.915669 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a540cf2-c2b5-4f94-8436-07174a8157f5 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:28.924648 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1438/2878] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:58:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:58:31.465258 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bae09-9e6b-4f27-a5dc-fcc895e28cb9 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:31.484389 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:31.527767 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bae09-9e6b-4f27-a5dc-fcc895e28cb9 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:31.532240 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5eacf5-1dd1-4cff-820e-66113a29b114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:31.532895 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5eacf5-1dd1-4cff-820e-66113a29b114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:31.533179 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5eacf5-1dd1-4cff-820e-66113a29b114 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:31.533455 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5eacf5-1dd1-4cff-820e-66113a29b114 admin admin] PATH_INFO: `/v3/users/2c9abec351ba43078a06cf6c1dbf1843` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:31.534574 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5eacf5-1dd1-4cff-820e-66113a29b114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c9abec351ba43078a06cf6c1dbf1843)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:31.536482 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5eacf5-1dd1-4cff-820e-66113a29b114 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:31.581911 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4c5eacf5-1dd1-4cff-820e-66113a29b114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c9abec351ba43078a06cf6c1dbf1843'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:31.590152 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4c5eacf5-1dd1-4cff-820e-66113a29b114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c9abec351ba43078a06cf6c1dbf1843'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:31.590760 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4c5eacf5-1dd1-4cff-820e-66113a29b114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c9abec351ba43078a06cf6c1dbf1843'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:31.591377 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4c5eacf5-1dd1-4cff-820e-66113a29b114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c9abec351ba43078a06cf6c1dbf1843'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:31.598249 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-4c5eacf5-1dd1-4cff-820e-66113a29b114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c9abec351ba43078a06cf6c1dbf1843'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:31.615533 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1441/2879] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:58:31 2022] DELETE /identity/v3/users/2c9abec351ba43078a06cf6c1dbf1843 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:58:31.620051 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4a9d9-c1fc-46c8-b014-1199de0fdb5c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:31.620575 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4a9d9-c1fc-46c8-b014-1199de0fdb5c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:31.620707 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4a9d9-c1fc-46c8-b014-1199de0fdb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:31.639771 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b3c4a9d9-c1fc-46c8-b014-1199de0fdb5c None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:31.641459 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b3c4a9d9-c1fc-46c8-b014-1199de0fdb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:31.698900 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1439/2880] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:58:31.708780 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5eacf5-1dd1-4cff-820e-66113a29b114 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:31.710193 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-4c5eacf5-1dd1-4cff-820e-66113a29b114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:31.768330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5eacf5-1dd1-4cff-820e-66113a29b114 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:31.771903 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9d690-d0e0-4d6e-8740-f9077cd92f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:31.772495 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9d690-d0e0-4d6e-8740-f9077cd92f05 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:31.772800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9d690-d0e0-4d6e-8740-f9077cd92f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:31.773070 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9d690-d0e0-4d6e-8740-f9077cd92f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:31.782799 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9d690-d0e0-4d6e-8740-f9077cd92f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:31.784205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9d690-d0e0-4d6e-8740-f9077cd92f05 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:31.794050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1442/2881] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:58:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:58:32.055102 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4a9d9-c1fc-46c8-b014-1199de0fdb5c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:32.057327 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b3c4a9d9-c1fc-46c8-b014-1199de0fdb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:32.068814 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4a9d9-c1fc-46c8-b014-1199de0fdb5c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:32.073870 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4a401-2351-42ed-983c-75807184352a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:32.074496 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4a401-2351-42ed-983c-75807184352a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:32.074774 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4a401-2351-42ed-983c-75807184352a admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:32.075042 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4a401-2351-42ed-983c-75807184352a admin admin] PATH_INFO: `/v3/projects/af4063dbc829442ab7bed6c6c1324d05` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:32.076705 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4a401-2351-42ed-983c-75807184352a admin admin] RBAC: Authorizing `identity:delete_project(project_id=af4063dbc829442ab7bed6c6c1324d05)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:32.078656 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4a401-2351-42ed-983c-75807184352a admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:32.126434 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3ec4a401-2351-42ed-983c-75807184352a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af4063dbc829442ab7bed6c6c1324d05', 'request_id': 'req-3ec4a401-2351-42ed-983c-75807184352a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:32.132618 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3ec4a401-2351-42ed-983c-75807184352a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af4063dbc829442ab7bed6c6c1324d05', 'request_id': 'req-3ec4a401-2351-42ed-983c-75807184352a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:32.140223 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3ec4a401-2351-42ed-983c-75807184352a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af4063dbc829442ab7bed6c6c1324d05', 'request_id': 'req-3ec4a401-2351-42ed-983c-75807184352a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:32.151143 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3ec4a401-2351-42ed-983c-75807184352a admin admin] The token cache is being invalidate because project af4063dbc829442ab7bed6c6c1324d05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:58:32.151427 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3ec4a401-2351-42ed-983c-75807184352a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:32.152036 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3ec4a401-2351-42ed-983c-75807184352a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:32.153520 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1440/2882] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:58:32 2022] DELETE /identity/v3/projects/af4063dbc829442ab7bed6c6c1324d05 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:58:32.158386 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e9c18-f811-4e5f-bb24-1768a1b64c08 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:32.158668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e9c18-f811-4e5f-bb24-1768a1b64c08 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:32.158956 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e9c18-f811-4e5f-bb24-1768a1b64c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:32.177841 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-972e9c18-f811-4e5f-bb24-1768a1b64c08 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:32.179026 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-972e9c18-f811-4e5f-bb24-1768a1b64c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:32.215148 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:32.241799 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1443/2883] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:58:32.251210 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb324a31-0c35-4dc2-a345-ce2d9c195572 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:32.251492 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb324a31-0c35-4dc2-a345-ce2d9c195572 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:32.251768 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb324a31-0c35-4dc2-a345-ce2d9c195572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:32.271875 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-cb324a31-0c35-4dc2-a345-ce2d9c195572 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:32.273098 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cb324a31-0c35-4dc2-a345-ce2d9c195572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:32.280922 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1441/2884] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:58:32.285171 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e9c18-f811-4e5f-bb24-1768a1b64c08 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:32.294802 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e9c18-f811-4e5f-bb24-1768a1b64c08 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:32.299272 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb2547-e82e-4f9d-b8fe-e15a7cdb8c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:32.299859 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb2547-e82e-4f9d-b8fe-e15a7cdb8c38 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:32.300144 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb2547-e82e-4f9d-b8fe-e15a7cdb8c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:32.300419 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb2547-e82e-4f9d-b8fe-e15a7cdb8c38 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:32.301099 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb2547-e82e-4f9d-b8fe-e15a7cdb8c38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:58:32.301403 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb2547-e82e-4f9d-b8fe-e15a7cdb8c38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:32.303000 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb2547-e82e-4f9d-b8fe-e15a7cdb8c38 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:32.314800 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1444/2885] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:58:32.318961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb324a31-0c35-4dc2-a345-ce2d9c195572 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:32.328741 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb324a31-0c35-4dc2-a345-ce2d9c195572 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:32.333635 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7d2d3-6d88-48f0-a89c-9b5c6082ed93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:32.334219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7d2d3-6d88-48f0-a89c-9b5c6082ed93 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:32.334496 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7d2d3-6d88-48f0-a89c-9b5c6082ed93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:32.334769 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7d2d3-6d88-48f0-a89c-9b5c6082ed93 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:32.335394 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7d2d3-6d88-48f0-a89c-9b5c6082ed93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:32.337331 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7d2d3-6d88-48f0-a89c-9b5c6082ed93 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:32.363220 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1442/2886] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:58:32 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:58:32.367839 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb2547-e82e-4f9d-b8fe-e15a7cdb8c38 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:32.378717 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb2547-e82e-4f9d-b8fe-e15a7cdb8c38 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:32.433708 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16470554-ce08-47e5-ae8f-6f6666e01cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:32.434301 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16470554-ce08-47e5-ae8f-6f6666e01cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:32.434582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16470554-ce08-47e5-ae8f-6f6666e01cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:32.434858 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16470554-ce08-47e5-ae8f-6f6666e01cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:32.435491 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16470554-ce08-47e5-ae8f-6f6666e01cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:32.437405 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16470554-ce08-47e5-ae8f-6f6666e01cb2 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:32.458006 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1445/2887] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:58:32 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:58:32.462456 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7d2d3-6d88-48f0-a89c-9b5c6082ed93 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:32.472450 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7d2d3-6d88-48f0-a89c-9b5c6082ed93 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:32.477382 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84816d66-653f-43c6-b8f0-2eea58301558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:32.477986 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84816d66-653f-43c6-b8f0-2eea58301558 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:32.478266 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84816d66-653f-43c6-b8f0-2eea58301558 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:32.478537 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84816d66-653f-43c6-b8f0-2eea58301558 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:32.479174 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84816d66-653f-43c6-b8f0-2eea58301558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:32.480839 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84816d66-653f-43c6-b8f0-2eea58301558 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:32.490883 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1443/2888] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:58:32.496296 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16470554-ce08-47e5-ae8f-6f6666e01cb2 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:32.506237 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16470554-ce08-47e5-ae8f-6f6666e01cb2 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:32.511394 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccba038-8ca8-4e11-b2ec-3140ffd9b499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:32.511986 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccba038-8ca8-4e11-b2ec-3140ffd9b499 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:32.512266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccba038-8ca8-4e11-b2ec-3140ffd9b499 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:32.512538 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccba038-8ca8-4e11-b2ec-3140ffd9b499 admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:32.513201 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccba038-8ca8-4e11-b2ec-3140ffd9b499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:32.514792 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccba038-8ca8-4e11-b2ec-3140ffd9b499 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:32.525207 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1446/2889] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:58:32.529347 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84816d66-653f-43c6-b8f0-2eea58301558 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:32.539206 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84816d66-653f-43c6-b8f0-2eea58301558 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:32.544251 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d72eea-42a8-4aad-ba75-12b8042e6414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:32.544935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d72eea-42a8-4aad-ba75-12b8042e6414 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:32.545219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d72eea-42a8-4aad-ba75-12b8042e6414 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:32.545497 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d72eea-42a8-4aad-ba75-12b8042e6414 admin admin] PATH_INFO: `/v3/projects/e58343863e8945e5a97fbe11dd8a18bf/users/6a55bd11d84f4f9595d26ba11392c4b3/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:32.547694 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:32.562553 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d72eea-42a8-4aad-ba75-12b8042e6414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58343863e8945e5a97fbe11dd8a18bf, user_id=6a55bd11d84f4f9595d26ba11392c4b3, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:32.565228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d72eea-42a8-4aad-ba75-12b8042e6414 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:32.577540 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1444/2890] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:58:32 2022] PUT /identity/v3/projects/e58343863e8945e5a97fbe11dd8a18bf/users/6a55bd11d84f4f9595d26ba11392c4b3/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:58:32.588071 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f11cff-6adc-40f6-92f2-e3d5a4f7231e None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:32.588339 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f11cff-6adc-40f6-92f2-e3d5a4f7231e None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:32.588650 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f11cff-6adc-40f6-92f2-e3d5a4f7231e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:32.616401 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-07f11cff-6adc-40f6-92f2-e3d5a4f7231e None None] MFA Rules not processed for user `6a55bd11d84f4f9595d26ba11392c4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:32.617644 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-07f11cff-6adc-40f6-92f2-e3d5a4f7231e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:32.681780 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1447/2891] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:58:32.692231 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d72eea-42a8-4aad-ba75-12b8042e6414 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:32.694061 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-67d72eea-42a8-4aad-ba75-12b8042e6414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:32.752125 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d72eea-42a8-4aad-ba75-12b8042e6414 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:32.755727 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a0088-f2d6-498d-b8b5-ab1bd9a13f3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:32.756322 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a0088-f2d6-498d-b8b5-ab1bd9a13f3b service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:32.756636 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a0088-f2d6-498d-b8b5-ab1bd9a13f3b service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:32.756913 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a0088-f2d6-498d-b8b5-ab1bd9a13f3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:32.765030 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a0088-f2d6-498d-b8b5-ab1bd9a13f3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:32.766435 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a0088-f2d6-498d-b8b5-ab1bd9a13f3b service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:32.775022 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1445/2892] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:58:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:58:42.598011 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f11cff-6adc-40f6-92f2-e3d5a4f7231e None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:42.636304 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:42.660724 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f11cff-6adc-40f6-92f2-e3d5a4f7231e None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:42.665850 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe27a66-7c26-4ca3-b74e-2cb8f9928897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:42.666473 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe27a66-7c26-4ca3-b74e-2cb8f9928897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:42.666753 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe27a66-7c26-4ca3-b74e-2cb8f9928897 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:42.667027 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe27a66-7c26-4ca3-b74e-2cb8f9928897 admin admin] PATH_INFO: `/v3/users/6a55bd11d84f4f9595d26ba11392c4b3` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:42.668135 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe27a66-7c26-4ca3-b74e-2cb8f9928897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a55bd11d84f4f9595d26ba11392c4b3)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:42.670116 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe27a66-7c26-4ca3-b74e-2cb8f9928897 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:42.715383 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6fe27a66-7c26-4ca3-b74e-2cb8f9928897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a55bd11d84f4f9595d26ba11392c4b3'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:42.722734 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6fe27a66-7c26-4ca3-b74e-2cb8f9928897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a55bd11d84f4f9595d26ba11392c4b3'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:42.723354 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6fe27a66-7c26-4ca3-b74e-2cb8f9928897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a55bd11d84f4f9595d26ba11392c4b3'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:42.724070 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6fe27a66-7c26-4ca3-b74e-2cb8f9928897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a55bd11d84f4f9595d26ba11392c4b3'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:42.731843 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-6fe27a66-7c26-4ca3-b74e-2cb8f9928897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a55bd11d84f4f9595d26ba11392c4b3'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:42.749009 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1448/2893] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 10:58:42 2022] DELETE /identity/v3/users/6a55bd11d84f4f9595d26ba11392c4b3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 10:58:42.753401 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e39a-8bcb-4705-9f85-27e03fc93f80 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:42.753901 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e39a-8bcb-4705-9f85-27e03fc93f80 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:42.754007 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e39a-8bcb-4705-9f85-27e03fc93f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:42.772393 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-bb96e39a-8bcb-4705-9f85-27e03fc93f80 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:42.773624 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bb96e39a-8bcb-4705-9f85-27e03fc93f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:42.832912 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1446/2894] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:58:42.843550 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe27a66-7c26-4ca3-b74e-2cb8f9928897 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:42.845024 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-6fe27a66-7c26-4ca3-b74e-2cb8f9928897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:42.901816 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe27a66-7c26-4ca3-b74e-2cb8f9928897 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:42.905385 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aaa671-dcf6-4c3a-9882-901e0a4e85d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:42.905975 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aaa671-dcf6-4c3a-9882-901e0a4e85d3 service neutron] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:42.906253 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aaa671-dcf6-4c3a-9882-901e0a4e85d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:42.906523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aaa671-dcf6-4c3a-9882-901e0a4e85d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:42.915942 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aaa671-dcf6-4c3a-9882-901e0a4e85d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:42.917372 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aaa671-dcf6-4c3a-9882-901e0a4e85d3 service neutron] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:42.926523 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1449/2895] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:58:43.189448 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96e39a-8bcb-4705-9f85-27e03fc93f80 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:43.191131 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bb96e39a-8bcb-4705-9f85-27e03fc93f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:43.204947 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96e39a-8bcb-4705-9f85-27e03fc93f80 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:43.209959 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45092ae9-6dbc-436d-a767-a3cdc25df2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:43.210587 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45092ae9-6dbc-436d-a767-a3cdc25df2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:43.210885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45092ae9-6dbc-436d-a767-a3cdc25df2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:43.211219 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45092ae9-6dbc-436d-a767-a3cdc25df2ef admin admin] PATH_INFO: `/v3/projects/e58343863e8945e5a97fbe11dd8a18bf` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:43.212465 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45092ae9-6dbc-436d-a767-a3cdc25df2ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=e58343863e8945e5a97fbe11dd8a18bf)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:43.214380 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45092ae9-6dbc-436d-a767-a3cdc25df2ef admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:43.260364 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-45092ae9-6dbc-436d-a767-a3cdc25df2ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e58343863e8945e5a97fbe11dd8a18bf', 'request_id': 'req-45092ae9-6dbc-436d-a767-a3cdc25df2ef'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:43.266798 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-45092ae9-6dbc-436d-a767-a3cdc25df2ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e58343863e8945e5a97fbe11dd8a18bf', 'request_id': 'req-45092ae9-6dbc-436d-a767-a3cdc25df2ef'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:43.274488 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-45092ae9-6dbc-436d-a767-a3cdc25df2ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e58343863e8945e5a97fbe11dd8a18bf', 'request_id': 'req-45092ae9-6dbc-436d-a767-a3cdc25df2ef'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:43.284840 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-45092ae9-6dbc-436d-a767-a3cdc25df2ef admin admin] The token cache is being invalidate because project e58343863e8945e5a97fbe11dd8a18bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 10:58:43.285130 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-45092ae9-6dbc-436d-a767-a3cdc25df2ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:43.285762 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-45092ae9-6dbc-436d-a767-a3cdc25df2ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 10:58:43.287252 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1447/2896] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 10:58:43 2022] DELETE /identity/v3/projects/e58343863e8945e5a97fbe11dd8a18bf => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:58:43.292697 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70a092-8589-4eac-96fd-22c2b7adf6a6 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:43.292987 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70a092-8589-4eac-96fd-22c2b7adf6a6 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:43.293265 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70a092-8589-4eac-96fd-22c2b7adf6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:43.313002 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-3e70a092-8589-4eac-96fd-22c2b7adf6a6 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:43.314199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-3e70a092-8589-4eac-96fd-22c2b7adf6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:43.363753 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:43.375137 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1450/2897] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:58:43.382935 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f478cc9-a15f-45b1-9653-d7b11c794fdb None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:43.383224 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f478cc9-a15f-45b1-9653-d7b11c794fdb None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:43.383499 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f478cc9-a15f-45b1-9653-d7b11c794fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:43.403593 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-5f478cc9-a15f-45b1-9653-d7b11c794fdb None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:43.404823 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5f478cc9-a15f-45b1-9653-d7b11c794fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:43.412484 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1448/2898] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:58:43.417240 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70a092-8589-4eac-96fd-22c2b7adf6a6 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:43.426671 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70a092-8589-4eac-96fd-22c2b7adf6a6 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:43.431182 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336c050-2eee-4690-b6e3-78ebbf7b4e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:43.431767 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336c050-2eee-4690-b6e3-78ebbf7b4e97 admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:43.432046 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336c050-2eee-4690-b6e3-78ebbf7b4e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:43.432318 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336c050-2eee-4690-b6e3-78ebbf7b4e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:43.432998 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336c050-2eee-4690-b6e3-78ebbf7b4e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 10:58:43.433302 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336c050-2eee-4690-b6e3-78ebbf7b4e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:43.434875 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336c050-2eee-4690-b6e3-78ebbf7b4e97 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:43.446266 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1451/2899] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 10:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 10:58:43.450225 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f478cc9-a15f-45b1-9653-d7b11c794fdb None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:43.454510 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:43.462124 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f478cc9-a15f-45b1-9653-d7b11c794fdb None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:43.467985 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93374cbf-9037-44f2-94f0-419a3feddfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:43.468686 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93374cbf-9037-44f2-94f0-419a3feddfa3 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:43.468964 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93374cbf-9037-44f2-94f0-419a3feddfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:43.469228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93374cbf-9037-44f2-94f0-419a3feddfa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:43.469857 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93374cbf-9037-44f2-94f0-419a3feddfa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:43.471747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93374cbf-9037-44f2-94f0-419a3feddfa3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:43.498610 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1449/2900] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 10:58:43 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 10:58:43.502792 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336c050-2eee-4690-b6e3-78ebbf7b4e97 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:43.512494 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336c050-2eee-4690-b6e3-78ebbf7b4e97 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:43.567151 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10370ec7-6993-43f7-8097-4358cb5525f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:43.567773 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10370ec7-6993-43f7-8097-4358cb5525f7 admin admin] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:43.568055 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10370ec7-6993-43f7-8097-4358cb5525f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:43.568335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10370ec7-6993-43f7-8097-4358cb5525f7 admin admin] PATH_INFO: `/v3/users` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:43.568986 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10370ec7-6993-43f7-8097-4358cb5525f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:43.570901 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10370ec7-6993-43f7-8097-4358cb5525f7 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:43.592199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1452/2901] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 10:58:43 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 10:58:43.596585 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93374cbf-9037-44f2-94f0-419a3feddfa3 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:43.607367 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93374cbf-9037-44f2-94f0-419a3feddfa3 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:43.612105 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58ab11-d2a9-4dea-891c-b9b814fead3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:43.612734 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58ab11-d2a9-4dea-891c-b9b814fead3b admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:43.613037 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58ab11-d2a9-4dea-891c-b9b814fead3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:43.613310 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58ab11-d2a9-4dea-891c-b9b814fead3b admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:43.614018 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58ab11-d2a9-4dea-891c-b9b814fead3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:43.615595 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58ab11-d2a9-4dea-891c-b9b814fead3b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:43.625493 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1450/2902] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:58:43.629356 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10370ec7-6993-43f7-8097-4358cb5525f7 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:43.639535 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10370ec7-6993-43f7-8097-4358cb5525f7 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:43.644022 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbaebfa-99ae-447d-b91e-895a049d14db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:43.644625 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaebfa-99ae-447d-b91e-895a049d14db admin admin] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:43.644903 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaebfa-99ae-447d-b91e-895a049d14db admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:43.645173 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaebfa-99ae-447d-b91e-895a049d14db admin admin] PATH_INFO: `/v3/roles` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:43.645806 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbaebfa-99ae-447d-b91e-895a049d14db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:43.647375 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbaebfa-99ae-447d-b91e-895a049d14db admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:43.658207 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1453/2903] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 10:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 10:58:43.662228 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58ab11-d2a9-4dea-891c-b9b814fead3b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:43.672540 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58ab11-d2a9-4dea-891c-b9b814fead3b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:43.677112 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb11e79-aabe-43b3-89f9-10eee25f71d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:43.677747 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb11e79-aabe-43b3-89f9-10eee25f71d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:43.678136 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb11e79-aabe-43b3-89f9-10eee25f71d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:43.678417 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb11e79-aabe-43b3-89f9-10eee25f71d4 admin admin] PATH_INFO: `/v3/projects/5ad11b5af4514617a1fce2d24b3c96b2/users/4e4c23b1505144ef8cea8ef9df5052d2/roles/344db47133bb4fb2843696759f71b2c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:43.695263 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb11e79-aabe-43b3-89f9-10eee25f71d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad11b5af4514617a1fce2d24b3c96b2, user_id=4e4c23b1505144ef8cea8ef9df5052d2, role_id=344db47133bb4fb2843696759f71b2c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:43.697907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb11e79-aabe-43b3-89f9-10eee25f71d4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:43.710889 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1451/2904] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 10:58:43 2022] PUT /identity/v3/projects/5ad11b5af4514617a1fce2d24b3c96b2/users/4e4c23b1505144ef8cea8ef9df5052d2/roles/344db47133bb4fb2843696759f71b2c7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 10:58:43.716590 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12892d33-41f1-45aa-9a66-e1fbf798e7fc None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:43.716876 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12892d33-41f1-45aa-9a66-e1fbf798e7fc None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:43.717142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12892d33-41f1-45aa-9a66-e1fbf798e7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:43.736727 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-12892d33-41f1-45aa-9a66-e1fbf798e7fc None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:43.737918 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-12892d33-41f1-45aa-9a66-e1fbf798e7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:43.795412 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1454/2905] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:58:43.805137 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb11e79-aabe-43b3-89f9-10eee25f71d4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:43.806932 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bfb11e79-aabe-43b3-89f9-10eee25f71d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:43.862551 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb11e79-aabe-43b3-89f9-10eee25f71d4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:43.866139 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa79e66-d14c-4bfa-9403-87a6b6062867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:43.866728 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa79e66-d14c-4bfa-9403-87a6b6062867 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:43.867003 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa79e66-d14c-4bfa-9403-87a6b6062867 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:43.867302 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa79e66-d14c-4bfa-9403-87a6b6062867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:43.876090 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa79e66-d14c-4bfa-9403-87a6b6062867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:43.877460 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa79e66-d14c-4bfa-9403-87a6b6062867 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:43.887402 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1452/2906] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:58:44.487970 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a728492-3a01-466c-a6ee-f8a8dc2328db None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:44.488276 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a728492-3a01-466c-a6ee-f8a8dc2328db None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:44.488573 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a728492-3a01-466c-a6ee-f8a8dc2328db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:44.516871 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-7a728492-3a01-466c-a6ee-f8a8dc2328db None None] MFA Rules not processed for user `4e4c23b1505144ef8cea8ef9df5052d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:44.518086 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-7a728492-3a01-466c-a6ee-f8a8dc2328db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:44.574004 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:44.585942 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1455/2907] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:58:44.596798 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa79e66-d14c-4bfa-9403-87a6b6062867 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:44.598236 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-afa79e66-d14c-4bfa-9403-87a6b6062867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:44.655419 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa79e66-d14c-4bfa-9403-87a6b6062867 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:44.659067 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783418ef-e4e3-4986-87cb-61794563abcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa0d9fe3d4942be8901876e57d1e561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:44.659700 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783418ef-e4e3-4986-87cb-61794563abcb service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:44.659981 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783418ef-e4e3-4986-87cb-61794563abcb service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:44.660259 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783418ef-e4e3-4986-87cb-61794563abcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:44.669463 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783418ef-e4e3-4986-87cb-61794563abcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:44.670729 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783418ef-e4e3-4986-87cb-61794563abcb service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:44.679739 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1453/2908] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:58:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:58:46.213652 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca2e5f-b64f-4ebc-88c9-77c5b526db16 None None] REQUEST_METHOD: `POST` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:46.214486 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca2e5f-b64f-4ebc-88c9-77c5b526db16 None None] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:46.214698 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca2e5f-b64f-4ebc-88c9-77c5b526db16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:46.234057 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.auth.core [None req-21ca2e5f-b64f-4ebc-88c9-77c5b526db16 None None] MFA Rules not processed for user `4e4c23b1505144ef8cea8ef9df5052d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:58:46.235215 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-21ca2e5f-b64f-4ebc-88c9-77c5b526db16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:46.242043 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1456/2909] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:58:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:58:46.479113 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783418ef-e4e3-4986-87cb-61794563abcb service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:46.488466 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783418ef-e4e3-4986-87cb-61794563abcb service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:46.491907 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74c6a5-5250-4376-a0be-e1f8f4403cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '133c5864d9544973a30ff77866522f15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:46.492492 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74c6a5-5250-4376-a0be-e1f8f4403cfb service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:46.492801 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74c6a5-5250-4376-a0be-e1f8f4403cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:46.493073 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74c6a5-5250-4376-a0be-e1f8f4403cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:46.494755 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4d74c6a5-5250-4376-a0be-e1f8f4403cfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:46.504024 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74c6a5-5250-4376-a0be-e1f8f4403cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:46.505457 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74c6a5-5250-4376-a0be-e1f8f4403cfb service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:46.513292 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1454/2910] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:58:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:58:47.082317 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca2e5f-b64f-4ebc-88c9-77c5b526db16 None None] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:47.084354 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-21ca2e5f-b64f-4ebc-88c9-77c5b526db16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:47.154810 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca2e5f-b64f-4ebc-88c9-77c5b526db16 None None] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:47.159665 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cbfea-b4db-45b9-b9af-8c7b3a90d83d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0211a05cca4e72b30d64eef4ba527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:47.160263 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cbfea-b4db-45b9-b9af-8c7b3a90d83d service placement] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:47.160542 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cbfea-b4db-45b9-b9af-8c7b3a90d83d service placement] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:47.160840 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cbfea-b4db-45b9-b9af-8c7b3a90d83d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:47.162659 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-604cbfea-b4db-45b9-b9af-8c7b3a90d83d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:47.174110 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604cbfea-b4db-45b9-b9af-8c7b3a90d83d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:47.175662 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604cbfea-b4db-45b9-b9af-8c7b3a90d83d service placement] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:47.185961 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1457/2911] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:58:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 10:58:49.594151 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74c6a5-5250-4376-a0be-e1f8f4403cfb service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:49.595885 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4d74c6a5-5250-4376-a0be-e1f8f4403cfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:49.641329 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:58:49.677122 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74c6a5-5250-4376-a0be-e1f8f4403cfb service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:49.682690 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe70a2e-7c19-42ee-9e37-b004bb234f6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:49.683905 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe70a2e-7c19-42ee-9e37-b004bb234f6b service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:49.684375 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe70a2e-7c19-42ee-9e37-b004bb234f6b service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:49.684684 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe70a2e-7c19-42ee-9e37-b004bb234f6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:49.686425 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5fe70a2e-7c19-42ee-9e37-b004bb234f6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:49.701088 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe70a2e-7c19-42ee-9e37-b004bb234f6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:49.703167 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe70a2e-7c19-42ee-9e37-b004bb234f6b service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:49.716226 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1455/2912] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:58:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:58:56.263805 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cbfea-b4db-45b9-b9af-8c7b3a90d83d service placement] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:58:56.277425 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cbfea-b4db-45b9-b9af-8c7b3a90d83d service placement] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:58:56.282894 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc19b5-9a68-4452-ac47-604dbe58303e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:58:56.283497 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc19b5-9a68-4452-ac47-604dbe58303e service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:58:56.283777 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc19b5-9a68-4452-ac47-604dbe58303e service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:58:56.284051 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc19b5-9a68-4452-ac47-604dbe58303e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:58:56.285795 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b3bc19b5-9a68-4452-ac47-604dbe58303e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:58:56.298026 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc19b5-9a68-4452-ac47-604dbe58303e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:58:56.299601 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc19b5-9a68-4452-ac47-604dbe58303e service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:58:56.310767 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1458/2913] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:58:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:58:59.712005 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=17 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:59:06.306791 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=44 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:59:12.715001 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd29d3f-988c-4a0c-bfca-c738fe3d8b3d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:59:12.715554 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd29d3f-988c-4a0c-bfca-c738fe3d8b3d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:59:12.715554 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd29d3f-988c-4a0c-bfca-c738fe3d8b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:59:12.735247 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2bd29d3f-988c-4a0c-bfca-c738fe3d8b3d None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:59:12.736428 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2bd29d3f-988c-4a0c-bfca-c738fe3d8b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:59:12.743940 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1456/2914] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Sep 11 10:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:59:12.758963 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc19b5-9a68-4452-ac47-604dbe58303e service nova] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:59:12.760434 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-b3bc19b5-9a68-4452-ac47-604dbe58303e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:59:12.773824 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc19b5-9a68-4452-ac47-604dbe58303e service nova] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:59:12.779688 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9f6ce-347f-4241-a51f-bafd8517eb6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:59:12.780303 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9f6ce-347f-4241-a51f-bafd8517eb6a service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:59:12.780607 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9f6ce-347f-4241-a51f-bafd8517eb6a service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:59:12.780879 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9f6ce-347f-4241-a51f-bafd8517eb6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:59:12.788763 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9f6ce-347f-4241-a51f-bafd8517eb6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:59:12.790308 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9f6ce-347f-4241-a51f-bafd8517eb6a service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:59:12.800038 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1459/2915] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:59:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:59:17.816527 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f3130-de64-4765-84a2-fa424d7e2814 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:59:17.817131 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f3130-de64-4765-84a2-fa424d7e2814 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:59:17.817131 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f3130-de64-4765-84a2-fa424d7e2814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:59:17.839065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-720f3130-de64-4765-84a2-fa424d7e2814 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:59:17.840274 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-720f3130-de64-4765-84a2-fa424d7e2814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:59:17.848289 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1457/2916] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Sep 11 10:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:59:17.862300 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9f6ce-347f-4241-a51f-bafd8517eb6a service nova] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:59:17.873553 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9f6ce-347f-4241-a51f-bafd8517eb6a service nova] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:59:17.879026 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c89df9-afc5-4f2b-9967-ffc7656f4337 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:59:17.879615 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c89df9-afc5-4f2b-9967-ffc7656f4337 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:59:17.879924 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c89df9-afc5-4f2b-9967-ffc7656f4337 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:59:17.880199 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c89df9-afc5-4f2b-9967-ffc7656f4337 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:59:17.888129 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c89df9-afc5-4f2b-9967-ffc7656f4337 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:59:17.889714 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c89df9-afc5-4f2b-9967-ffc7656f4337 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:59:17.898929 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1460/2917] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:59:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:59:21.079354 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed0e2d-ec58-495d-b2e9-b8e5a1e415b4 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:59:21.079940 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed0e2d-ec58-495d-b2e9-b8e5a1e415b4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:59:21.079940 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed0e2d-ec58-495d-b2e9-b8e5a1e415b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:59:21.099950 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-cfed0e2d-ec58-495d-b2e9-b8e5a1e415b4 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:59:21.101158 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cfed0e2d-ec58-495d-b2e9-b8e5a1e415b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:59:21.109431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1458/2918] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Sep 11 10:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:59:21.124134 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c89df9-afc5-4f2b-9967-ffc7656f4337 service nova] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:59:21.135111 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c89df9-afc5-4f2b-9967-ffc7656f4337 service nova] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:59:21.140440 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b41dbc-11c2-406c-aa26-b977269df80b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:59:21.141068 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b41dbc-11c2-406c-aa26-b977269df80b service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:59:21.141336 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b41dbc-11c2-406c-aa26-b977269df80b service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:59:21.141612 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b41dbc-11c2-406c-aa26-b977269df80b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:59:21.149487 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b41dbc-11c2-406c-aa26-b977269df80b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:59:21.151528 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b41dbc-11c2-406c-aa26-b977269df80b service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:59:21.160706 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1461/2919] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:59:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:59:24.167919 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd774b83-d803-47d3-8bd9-28775f89c12a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:59:24.168444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd774b83-d803-47d3-8bd9-28775f89c12a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:59:24.168444 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd774b83-d803-47d3-8bd9-28775f89c12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:59:24.187311 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-cd774b83-d803-47d3-8bd9-28775f89c12a None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:59:24.188504 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cd774b83-d803-47d3-8bd9-28775f89c12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:59:24.196123 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1459/2920] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Sep 11 10:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:59:24.213012 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b41dbc-11c2-406c-aa26-b977269df80b service nova] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:59:24.224155 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b41dbc-11c2-406c-aa26-b977269df80b service nova] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:59:24.230437 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe779fc-bb86-4bbf-b4d8-85a861dcf89f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:59:24.231025 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe779fc-bb86-4bbf-b4d8-85a861dcf89f service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:59:24.231301 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe779fc-bb86-4bbf-b4d8-85a861dcf89f service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:59:24.231569 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe779fc-bb86-4bbf-b4d8-85a861dcf89f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:59:24.240676 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe779fc-bb86-4bbf-b4d8-85a861dcf89f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:59:24.242240 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe779fc-bb86-4bbf-b4d8-85a861dcf89f service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:59:24.251554 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1462/2921] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:59:27.330127 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87003a27-8d6e-4050-87d2-53b409d1f441 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:59:27.330612 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87003a27-8d6e-4050-87d2-53b409d1f441 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:59:27.330713 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87003a27-8d6e-4050-87d2-53b409d1f441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:59:27.351803 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-87003a27-8d6e-4050-87d2-53b409d1f441 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:59:27.353037 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-87003a27-8d6e-4050-87d2-53b409d1f441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:59:27.360827 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1460/2922] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Sep 11 10:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:59:27.379146 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe779fc-bb86-4bbf-b4d8-85a861dcf89f service nova] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:59:27.390742 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe779fc-bb86-4bbf-b4d8-85a861dcf89f service nova] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:59:27.396200 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d993dd5-db8c-4a5d-8d16-4cd2d2f191d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:59:27.396822 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d993dd5-db8c-4a5d-8d16-4cd2d2f191d3 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:59:27.397100 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d993dd5-db8c-4a5d-8d16-4cd2d2f191d3 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:59:27.397371 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d993dd5-db8c-4a5d-8d16-4cd2d2f191d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:59:27.405932 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d993dd5-db8c-4a5d-8d16-4cd2d2f191d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:59:27.407484 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d993dd5-db8c-4a5d-8d16-4cd2d2f191d3 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:59:27.417373 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1463/2923] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:59:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:59:30.503259 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092aa9ea-74c3-423b-a710-efe5c77c5d17 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:59:30.503773 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092aa9ea-74c3-423b-a710-efe5c77c5d17 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:59:30.503880 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092aa9ea-74c3-423b-a710-efe5c77c5d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:59:30.522558 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-092aa9ea-74c3-423b-a710-efe5c77c5d17 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:59:30.523738 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-092aa9ea-74c3-423b-a710-efe5c77c5d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:59:30.531323 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1461/2924] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Sep 11 10:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:59:30.547668 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d993dd5-db8c-4a5d-8d16-4cd2d2f191d3 service nova] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:59:30.559587 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d993dd5-db8c-4a5d-8d16-4cd2d2f191d3 service nova] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:59:30.565158 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cfb47-baea-45ce-999e-d79ed8c68c62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:59:30.565752 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cfb47-baea-45ce-999e-d79ed8c68c62 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:59:30.566034 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cfb47-baea-45ce-999e-d79ed8c68c62 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:59:30.566310 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cfb47-baea-45ce-999e-d79ed8c68c62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:59:30.574492 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22cfb47-baea-45ce-999e-d79ed8c68c62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:59:30.576056 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22cfb47-baea-45ce-999e-d79ed8c68c62 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:59:30.585724 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1464/2925] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:59:40.517412 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=18 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:59:40.581197 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=36 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:59:44.475532 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b68dd-9f73-46d7-a24a-844c612921e4 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:59:44.476039 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b68dd-9f73-46d7-a24a-844c612921e4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:59:44.476163 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b68dd-9f73-46d7-a24a-844c612921e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:59:44.494770 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4b8b68dd-9f73-46d7-a24a-844c612921e4 None None] MFA Rules not processed for user `4e4c23b1505144ef8cea8ef9df5052d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:59:44.495961 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4b8b68dd-9f73-46d7-a24a-844c612921e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:59:44.502719 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1462/2926] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 10:59:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:59:49.340928 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cfb47-baea-45ce-999e-d79ed8c68c62 service nova] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:59:49.356006 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cfb47-baea-45ce-999e-d79ed8c68c62 service nova] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:59:49.362652 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b4a3a-15bb-470a-93f8-c4d28aafea9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0211a05cca4e72b30d64eef4ba527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:59:49.363255 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b4a3a-15bb-470a-93f8-c4d28aafea9f service placement] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:59:49.363542 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b4a3a-15bb-470a-93f8-c4d28aafea9f service placement] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:59:49.363823 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b4a3a-15bb-470a-93f8-c4d28aafea9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:59:49.366379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-8d8b4a3a-15bb-470a-93f8-c4d28aafea9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:59:49.378582 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b4a3a-15bb-470a-93f8-c4d28aafea9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:59:49.380156 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b4a3a-15bb-470a-93f8-c4d28aafea9f service placement] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:59:49.390048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1465/2927] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:59:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:59:54.489653 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 10:59:56.143601 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc551d8e-ccb6-4547-8922-edcd03b27e25 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:59:56.144192 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc551d8e-ccb6-4547-8922-edcd03b27e25 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:59:56.144192 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc551d8e-ccb6-4547-8922-edcd03b27e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:59:56.163065 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-dc551d8e-ccb6-4547-8922-edcd03b27e25 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:59:56.164269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-dc551d8e-ccb6-4547-8922-edcd03b27e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:59:56.177356 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1463/2928] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Sep 11 10:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:59:56.193172 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b4a3a-15bb-470a-93f8-c4d28aafea9f service placement] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:59:56.205926 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b4a3a-15bb-470a-93f8-c4d28aafea9f service placement] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:59:56.211904 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21507c-06cd-4666-b129-54bd4edb0d3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:59:56.212501 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21507c-06cd-4666-b129-54bd4edb0d3e service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:59:56.212844 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21507c-06cd-4666-b129-54bd4edb0d3e service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:59:56.213120 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21507c-06cd-4666-b129-54bd4edb0d3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:59:56.221381 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21507c-06cd-4666-b129-54bd4edb0d3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:59:56.222942 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21507c-06cd-4666-b129-54bd4edb0d3e service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:59:56.232402 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1466/2929] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 10:59:59.395900 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67ea4d-eead-4828-847a-b393a7b2c026 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:59:59.396431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67ea4d-eead-4828-847a-b393a7b2c026 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:59:59.396431 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67ea4d-eead-4828-847a-b393a7b2c026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:59:59.415528 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7f67ea4d-eead-4828-847a-b393a7b2c026 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 10:59:59.416746 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7f67ea4d-eead-4828-847a-b393a7b2c026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 10:59:59.425104 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1464/2930] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Sep 11 10:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 10:59:59.441398 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21507c-06cd-4666-b129-54bd4edb0d3e service nova] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 10:59:59.452720 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21507c-06cd-4666-b129-54bd4edb0d3e service nova] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 10:59:59.460163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107f435-64fb-451c-9718-f49ea82f0856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 10:59:59.460798 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107f435-64fb-451c-9718-f49ea82f0856 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 10:59:59.461204 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107f435-64fb-451c-9718-f49ea82f0856 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 10:59:59.461611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107f435-64fb-451c-9718-f49ea82f0856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 10:59:59.470845 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107f435-64fb-451c-9718-f49ea82f0856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 10:59:59.472390 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107f435-64fb-451c-9718-f49ea82f0856 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 10:59:59.481566 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1467/2931] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 10:59:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 11:00:02.489581 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dccc36-a340-47e1-9fb7-eb813b56f7e0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 11:00:02.490081 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dccc36-a340-47e1-9fb7-eb813b56f7e0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 11:00:02.490187 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dccc36-a340-47e1-9fb7-eb813b56f7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 11:00:02.509300 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-65dccc36-a340-47e1-9fb7-eb813b56f7e0 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 11:00:02.510487 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-65dccc36-a340-47e1-9fb7-eb813b56f7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 11:00:02.518876 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1465/2932] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Sep 11 11:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 11:00:02.535143 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107f435-64fb-451c-9718-f49ea82f0856 service nova] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 11:00:02.546142 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107f435-64fb-451c-9718-f49ea82f0856 service nova] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 11:00:02.551451 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81338f34-0e97-4071-8816-0185c2074edc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 11:00:02.552031 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81338f34-0e97-4071-8816-0185c2074edc service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 11:00:02.552330 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81338f34-0e97-4071-8816-0185c2074edc service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 11:00:02.552626 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81338f34-0e97-4071-8816-0185c2074edc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 11:00:02.560379 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81338f34-0e97-4071-8816-0185c2074edc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 11:00:02.561954 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81338f34-0e97-4071-8816-0185c2074edc service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 11:00:02.571050 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1468/2933] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 11:00:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 11:00:05.650076 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9ba5e-cd2a-4005-87c9-bd53df43eaba None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 11:00:05.650581 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9ba5e-cd2a-4005-87c9-bd53df43eaba None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 11:00:05.650718 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9ba5e-cd2a-4005-87c9-bd53df43eaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 11:00:05.670365 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-60a9ba5e-cd2a-4005-87c9-bd53df43eaba None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 11:00:05.671674 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-60a9ba5e-cd2a-4005-87c9-bd53df43eaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 11:00:05.679957 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1466/2934] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Sep 11 11:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 11:00:05.699580 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81338f34-0e97-4071-8816-0185c2074edc service nova] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 11:00:05.712145 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81338f34-0e97-4071-8816-0185c2074edc service nova] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 11:00:05.717793 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4b0e5-7835-4f6c-8080-3dbf4c3b730c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 11:00:05.718390 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4b0e5-7835-4f6c-8080-3dbf4c3b730c service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 11:00:05.718673 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4b0e5-7835-4f6c-8080-3dbf4c3b730c service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 11:00:05.718947 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4b0e5-7835-4f6c-8080-3dbf4c3b730c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 11:00:05.727311 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4b0e5-7835-4f6c-8080-3dbf4c3b730c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 11:00:05.728933 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4b0e5-7835-4f6c-8080-3dbf4c3b730c service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 11:00:05.738278 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1469/2935] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 11:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 11:00:08.822324 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961ee2-918a-42fd-b785-1846718853c9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 11:00:08.822815 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961ee2-918a-42fd-b785-1846718853c9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 11:00:08.822921 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961ee2-918a-42fd-b785-1846718853c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 11:00:08.842756 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9b961ee2-918a-42fd-b785-1846718853c9 None None] MFA Rules not processed for user `f5c1185c0be14e5a840b375a991df2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 11:00:08.843949 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9b961ee2-918a-42fd-b785-1846718853c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 11:00:08.851933 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1467/2936] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Sep 11 11:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 11:00:08.867395 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4b0e5-7835-4f6c-8080-3dbf4c3b730c service nova] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 11:00:08.879584 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4b0e5-7835-4f6c-8080-3dbf4c3b730c service nova] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 11:00:08.884928 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfb158-a278-4142-b116-53679fa63c54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b642a1d00de940429fc1cc6131ac22b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 11:00:08.885515 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfb158-a278-4142-b116-53679fa63c54 service nova] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 11:00:08.885801 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfb158-a278-4142-b116-53679fa63c54 service nova] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 11:00:08.886072 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfb158-a278-4142-b116-53679fa63c54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 11:00:08.894654 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfb158-a278-4142-b116-53679fa63c54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 11:00:08.896205 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfb158-a278-4142-b116-53679fa63c54 service nova] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 11:00:08.905430 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1470/2937] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 11:00:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 11:00:18.837590 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=15 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:00:18.901301 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=36 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:00:36.620969 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b961ee2-918a-42fd-b785-1846718853c9 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 11:00:36.632148 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b961ee2-918a-42fd-b785-1846718853c9 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 11:00:36.637475 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fc83a-8827-4a96-a340-a9b6dfbd0d49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0211a05cca4e72b30d64eef4ba527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 11:00:36.638134 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fc83a-8827-4a96-a340-a9b6dfbd0d49 service placement] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 11:00:36.638406 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fc83a-8827-4a96-a340-a9b6dfbd0d49 service placement] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 11:00:36.638682 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fc83a-8827-4a96-a340-a9b6dfbd0d49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 11:00:36.640451 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ac3fc83a-8827-4a96-a340-a9b6dfbd0d49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 11:00:36.652978 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fc83a-8827-4a96-a340-a9b6dfbd0d49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 11:00:36.654568 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fc83a-8827-4a96-a340-a9b6dfbd0d49 service placement] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 11:00:36.665589 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1468/2938] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 11:00:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 11:00:36.687634 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfb158-a278-4142-b116-53679fa63c54 service nova] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 11:00:36.697457 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfb158-a278-4142-b116-53679fa63c54 service nova] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 11:00:36.702089 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb663543-20db-4cf9-bdb8-3cf0f0d32902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 11:00:36.702704 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb663543-20db-4cf9-bdb8-3cf0f0d32902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 11:00:36.702983 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb663543-20db-4cf9-bdb8-3cf0f0d32902 admin admin] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 11:00:36.703254 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb663543-20db-4cf9-bdb8-3cf0f0d32902 admin admin] PATH_INFO: `/v3/users/4e4c23b1505144ef8cea8ef9df5052d2` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 11:00:36.704516 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb663543-20db-4cf9-bdb8-3cf0f0d32902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e4c23b1505144ef8cea8ef9df5052d2)` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 11:00:36.707926 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb663543-20db-4cf9-bdb8-3cf0f0d32902 admin admin] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 11:00:36.764176 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bb663543-20db-4cf9-bdb8-3cf0f0d32902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e4c23b1505144ef8cea8ef9df5052d2'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 11:00:36.772114 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bb663543-20db-4cf9-bdb8-3cf0f0d32902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e4c23b1505144ef8cea8ef9df5052d2'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 11:00:36.772729 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bb663543-20db-4cf9-bdb8-3cf0f0d32902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e4c23b1505144ef8cea8ef9df5052d2'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 11:00:36.773335 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bb663543-20db-4cf9-bdb8-3cf0f0d32902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e4c23b1505144ef8cea8ef9df5052d2'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 11:00:36.780499 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.notifications [None req-bb663543-20db-4cf9-bdb8-3cf0f0d32902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e4c23b1505144ef8cea8ef9df5052d2'} {{(pid=88076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 11:00:36.797980 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1471/2939] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 11:00:36 2022] DELETE /identity/v3/users/4e4c23b1505144ef8cea8ef9df5052d2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 11:00:36.965566 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fc83a-8827-4a96-a340-a9b6dfbd0d49 service placement] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 11:00:36.976531 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fc83a-8827-4a96-a340-a9b6dfbd0d49 service placement] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 11:00:37.035852 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf739e81-e627-43c1-8259-6672ce8569ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5c1185c0be14e5a840b375a991df2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1c2ee49dc945b2a0f435c605ac4ed3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 11:00:37.036503 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf739e81-e627-43c1-8259-6672ce8569ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 11:00:37.037060 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf739e81-e627-43c1-8259-6672ce8569ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 11:00:37.037340 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf739e81-e627-43c1-8259-6672ce8569ec admin admin] PATH_INFO: `/v3/projects/5ad11b5af4514617a1fce2d24b3c96b2` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 11:00:37.038521 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf739e81-e627-43c1-8259-6672ce8569ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad11b5af4514617a1fce2d24b3c96b2)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 11:00:37.040467 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf739e81-e627-43c1-8259-6672ce8569ec admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 11:00:37.090843 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bf739e81-e627-43c1-8259-6672ce8569ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad11b5af4514617a1fce2d24b3c96b2', 'request_id': 'req-bf739e81-e627-43c1-8259-6672ce8569ec'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 11:00:37.097355 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bf739e81-e627-43c1-8259-6672ce8569ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad11b5af4514617a1fce2d24b3c96b2', 'request_id': 'req-bf739e81-e627-43c1-8259-6672ce8569ec'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 11:00:37.105353 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bf739e81-e627-43c1-8259-6672ce8569ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad11b5af4514617a1fce2d24b3c96b2', 'request_id': 'req-bf739e81-e627-43c1-8259-6672ce8569ec'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 11:00:37.116394 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bf739e81-e627-43c1-8259-6672ce8569ec admin admin] The token cache is being invalidate because project 5ad11b5af4514617a1fce2d24b3c96b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 11:00:37.116716 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bf739e81-e627-43c1-8259-6672ce8569ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 11:00:37.117269 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bf739e81-e627-43c1-8259-6672ce8569ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 11:00:37.118767 dv-cinder-856460-3-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1469/2940] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 11:00:36 2022] DELETE /identity/v3/projects/5ad11b5af4514617a1fce2d24b3c96b2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 11:00:46.794449 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:00:47.113132 dv-cinder-856460-3-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 11:04:53.318048 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb663543-20db-4cf9-bdb8-3cf0f0d32902 admin admin] Authenticating user token {{(pid=88076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 11:04:53.319489 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-bb663543-20db-4cf9-bdb8-3cf0f0d32902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 11:04:53.456391 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb663543-20db-4cf9-bdb8-3cf0f0d32902 admin admin] Validating token access rules against request {{(pid=88076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 11:04:53.513021 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d50d7-dadc-4853-a348-4d935a41581d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0211a05cca4e72b30d64eef4ba527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd477d464e9f48149879362d04db9b9e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 11:04:53.513618 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d50d7-dadc-4853-a348-4d935a41581d service placement] REQUEST_METHOD: `GET` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 11:04:53.513893 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d50d7-dadc-4853-a348-4d935a41581d service placement] SCRIPT_NAME: `/identity` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 11:04:53.514163 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d50d7-dadc-4853-a348-4d935a41581d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 11:04:53.515860 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.fernet_utils [None req-760d50d7-dadc-4853-a348-4d935a41581d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 11:04:53.526611 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d50d7-dadc-4853-a348-4d935a41581d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 11:04:53.528707 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d50d7-dadc-4853-a348-4d935a41581d service placement] RBAC: Authorization granted {{(pid=88076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 11:04:53.538339 dv-cinder-856460-3-smb devstack@keystone.service[88076]: [pid: 88076|app: 0|req: 1472/2941] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 11:04:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 11:05:03.534160 dv-cinder-856460-3-smb devstack@keystone.service[88076]: DEBUG dbcounter [-] [88076] Writing DB stats keystone:SELECT=89 {{(pid=88076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}